-- Logs begin at Thu 2022-06-02 15:08:57 UTC, end at Thu 2022-06-02 16:22:22 UTC. -- Jun 02 15:44:00.792449 dv-cinder-797608-27-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 02 15:44:00.799529 dv-cinder-797608-27-smb devstack@keystone.service[80301]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 02 15:44:00.801530 dv-cinder-797608-27-smb devstack@keystone.service[80301]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 15:44:00 2022] *** Jun 02 15:44:00.801530 dv-cinder-797608-27-smb devstack@keystone.service[80301]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 15:44:00.801530 dv-cinder-797608-27-smb devstack@keystone.service[80301]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 15:44:00.801530 dv-cinder-797608-27-smb devstack@keystone.service[80301]: nodename: dv-cinder-797608-27-smb Jun 02 15:44:00.801530 dv-cinder-797608-27-smb devstack@keystone.service[80301]: machine: x86_64 Jun 02 15:44:00.801530 dv-cinder-797608-27-smb devstack@keystone.service[80301]: clock source: unix Jun 02 15:44:00.801954 dv-cinder-797608-27-smb devstack@keystone.service[80301]: pcre jit disabled Jun 02 15:44:00.801954 dv-cinder-797608-27-smb devstack@keystone.service[80301]: detected number of CPU cores: 4 Jun 02 15:44:00.801954 dv-cinder-797608-27-smb devstack@keystone.service[80301]: current working directory: / Jun 02 15:44:00.801954 dv-cinder-797608-27-smb devstack@keystone.service[80301]: detected binary path: /usr/bin/uwsgi-core Jun 02 15:44:00.801954 dv-cinder-797608-27-smb devstack@keystone.service[80301]: your processes number limit is 47680 Jun 02 15:44:00.801954 dv-cinder-797608-27-smb devstack@keystone.service[80301]: your memory page size is 4096 bytes Jun 02 15:44:00.801954 dv-cinder-797608-27-smb devstack@keystone.service[80301]: detected max file descriptor number: 2048 Jun 02 15:44:00.801954 dv-cinder-797608-27-smb devstack@keystone.service[80301]: lock engine: pthread robust mutexes Jun 02 15:44:00.801954 dv-cinder-797608-27-smb devstack@keystone.service[80301]: thunder lock: enabled Jun 02 15:44:00.801954 dv-cinder-797608-27-smb devstack@keystone.service[80301]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 02 15:44:00.801954 dv-cinder-797608-27-smb devstack@keystone.service[80301]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 15:44:00.848252 dv-cinder-797608-27-smb devstack@keystone.service[80301]: Python main interpreter initialized at 0x559d854479c0 Jun 02 15:44:00.848252 dv-cinder-797608-27-smb devstack@keystone.service[80301]: python threads support enabled Jun 02 15:44:00.848252 dv-cinder-797608-27-smb devstack@keystone.service[80301]: your server socket listen backlog is limited to 100 connections Jun 02 15:44:00.848252 dv-cinder-797608-27-smb devstack@keystone.service[80301]: your mercy for graceful operations on workers is 90 seconds Jun 02 15:44:00.848642 dv-cinder-797608-27-smb devstack@keystone.service[80301]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 15:44:00.848722 dv-cinder-797608-27-smb devstack@keystone.service[80301]: *** Operational MODE: preforking *** Jun 02 15:44:00.848982 dv-cinder-797608-27-smb devstack@keystone.service[80301]: *** uWSGI is running in multiple interpreter mode *** Jun 02 15:44:00.848982 dv-cinder-797608-27-smb devstack@keystone.service[80301]: spawned uWSGI master process (pid: 80301) Jun 02 15:44:00.849183 dv-cinder-797608-27-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 02 15:44:00.850435 dv-cinder-797608-27-smb devstack@keystone.service[80301]: spawned uWSGI worker 1 (pid: 80315, cores: 1) Jun 02 15:44:00.850435 dv-cinder-797608-27-smb devstack@keystone.service[80301]: spawned uWSGI worker 2 (pid: 80316, cores: 1) Jun 02 15:44:00.850435 dv-cinder-797608-27-smb devstack@keystone.service[80301]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 15:44:06.596244 dv-cinder-797608-27-smb devstack@keystone.service[80316]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 15:44:06.596244 dv-cinder-797608-27-smb devstack@keystone.service[80316]: from cryptography.utils import int_from_bytes Jun 02 15:44:06.597037 dv-cinder-797608-27-smb devstack@keystone.service[80316]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 15:44:06.597037 dv-cinder-797608-27-smb devstack@keystone.service[80316]: from cryptography.utils import int_from_bytes Jun 02 15:44:06.603906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 15:44:06.603906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: from cryptography.utils import int_from_bytes Jun 02 15:44:06.604556 dv-cinder-797608-27-smb devstack@keystone.service[80315]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 15:44:06.604556 dv-cinder-797608-27-smb devstack@keystone.service[80315]: from cryptography.utils import int_from_bytes Jun 02 15:44:06.647955 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 15:44:06.648133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 15:44:06.648303 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] command line args: [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 15:44:06.648579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 15:44:06.649285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ================================================================================ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 15:44:06.649557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] admin_token = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.649808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] config_dir = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.650003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.650191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] config_source = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.650378 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] debug = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.650583 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.651949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.651949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.651949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.651949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.651949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.652278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_config_append = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.652278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.652384 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_dir = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.652563 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.652804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.653059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.653314 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.653569 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.653754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.653936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.654187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.654442 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.654686 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.654926 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.655166 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.655406 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.655664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.655917 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.656102 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 15:44:06.656225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.656315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 15:44:06.656494 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] command line args: [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 15:44:06.656724 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.656815 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 15:44:06.656923 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] publish_errors = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.657008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ================================================================================ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 15:44:06.657165 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.657243 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] admin_token = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.657406 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.657491 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] config_dir = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.657593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.657677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.657777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] config_source = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.657897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.657985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] debug = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.658079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.658164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.658320 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] standard_threads = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.658399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.658557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.658638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.658810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.658887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.658992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.659077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.659176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_journal = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.659287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.659377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_json = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.659472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_config_append = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.659554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_stderr = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.659654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.659734 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_syslog = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.659836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_dir = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.659920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.660039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.660194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.660285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.660440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.660519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.660706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.660784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.660951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.661038 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.661170 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.661248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.661340 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.661492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.661573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.661679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.661822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.661908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.662060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.662151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.662297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.662401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.662533 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.662656 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.662770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.662896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.663030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.663147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.663279 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.663387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.663559 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.663650 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.663879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.664080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.664163 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.664270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] publish_errors = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.664442 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.665104 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.665239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.665351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.665455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.665544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.665698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.665778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.665941 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.666018 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.666181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] standard_threads = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.666271 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.666419 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.666505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.666670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.666750 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.666853 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.666940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.667019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_journal = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.667156 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.667235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_json = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.667371 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_stderr = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.667455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.667607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_syslog = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.667687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.667765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 15:44:06.667842 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.668041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.668124 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.668288 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.668368 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.668553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.668631 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.668798 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.668887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.669049 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.669126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.669291 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.669373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.669543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.669628 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.669780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.669859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.670023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.670100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.670265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.670355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.670502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.670587 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.670740 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.670824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.670978 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.671065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.671216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.671301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.671458 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.671538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.671708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.671794 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.671943 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.672050 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.672211 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.672298 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.672451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.672539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.672694 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.672773 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.672934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.673046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.673190 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.673305 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.673434 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.673539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.673660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.673775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.673903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.673993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.674146 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.674227 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.674389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.674467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.674627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.674717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.674863 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.674940 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.675113 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.675194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.675353 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.675443 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.675589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.675676 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.675823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.675910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.676097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.676178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.676338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.676425 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.676574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.676699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.676817 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.676904 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.677053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.677138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.677295 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.677374 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.677551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.677634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.677789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.677885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.678025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.678105 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.678260 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.678375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.678498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.678581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.678726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.678806 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.678980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.679065 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.679216 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.679304 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.679459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.679545 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.679695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.679775 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.679927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.680062 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.680209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.680289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.680462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.680542 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.680698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.680779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.680942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.681026 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.681182 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.681261 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.681424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.681504 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.681666 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.681745 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.681907 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.681992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.682144 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.682230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.682388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.682466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.682625 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.682703 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.682867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.682958 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.683104 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.683183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.683338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.683418 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.683575 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.683656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.683817 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.683898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.684078 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.684161 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.684320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.684410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.684558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.684643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.684812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.684891 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.685055 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.685147 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.685300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.685379 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.685541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.685621 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.685781 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.685870 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.686021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.686108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.external = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.686256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.686334 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.686507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.686594 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.686751 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.686837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.687000 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.687079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.password = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.687243 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.token = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.687329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.687486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.687565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.687726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.687804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.687965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.688106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.688230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.688309 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.688484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.688564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.688729 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.688815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.688965 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.689089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.689207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.689286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.689451 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.689538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.689696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.689776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.689937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.690016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.690178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.690287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.690411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.690499 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.690646 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.690735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.690883 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.690964 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.691121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.691213 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.691357 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.691437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.691602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.691689 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.691842 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.691931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.692118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.692200 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.692362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.692442 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.692623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.692718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.692893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.692974 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.693136 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.693215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.693371 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.external = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.693525 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.693602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.693674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.693860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.693939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.694094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.694182 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.694345 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.694455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.password = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.694581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.token = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.694667 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.694829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.694917 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.695069 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.695148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.695322 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.695402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.695561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.695673 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.695844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.695925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.696114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.696196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.696353 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.696434 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.696595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.696675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.696837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.696917 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.697084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.697240 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.697335 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.697459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.697571 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.697651 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.697815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.697898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.698052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.698131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.698316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.698395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.698555 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.698637 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.698790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.698870 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.699028 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.699116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.699278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.699359 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.699531 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.699611 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.699783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.699864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.700066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.700151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.700320 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.700401 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.700558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.700643 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.700802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.700882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.701053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.701176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.701287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.701367 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.701529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.701610 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.701764 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.701844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.702006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.702087 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.702252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.702333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.702493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.702572 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.702749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.702828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.702987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.703069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.703239 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.703318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.703481 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.703560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.703721 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.703801 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.703973 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.704072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.704235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.704315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.704471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.704551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.704718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.704798 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.704953 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.705031 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.705196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.705282 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.705440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.705520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.705686 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.705766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.705923 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.706003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.706161 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.706241 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.706398 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.706485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.706648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.706730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.706889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.706969 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.707126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.707206 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.707381 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.707501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.707631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.707711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.707871 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.707958 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.708135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.708218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.708379 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.708460 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.708616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.708712 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.708859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.708938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.709095 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.709233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.709336 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.709476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.709580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.709730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.709811 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.709987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.710068 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.710244 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.710331 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.710488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.710568 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.710727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.710807 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.710971 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.711053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.711214 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.711818 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.712012 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.712096 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.712257 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.712339 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.712501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.712580 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.712737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.712817 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.712983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.713063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.713228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.713308 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.713480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.713559 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.713718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.713799 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.713959 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.714037 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.714204 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.714284 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.714446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.714528 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.714684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.714762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.714924 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.715003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.715173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.715253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.715426 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.715512 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.715669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.715749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.715910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.716011 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.716176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.716255 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.716413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.716495 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.716658 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.716738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.716899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.716980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.717143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.717221 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.717395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.717478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.717643 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.717722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.717882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.717962 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.718118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.718198 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.718351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.718431 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.718590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.718670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.718829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.718911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.719079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.719178 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.719337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.719417 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.719598 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.719680 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.719841 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.719922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.720120 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.720203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.720366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.720449 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.720615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.720696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.720871 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] role.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.720949 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.721102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] role.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.721189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.721341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.721421 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.721585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.721663 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.721829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.721909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.722070 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.722157 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.722322 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.722410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.722573 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.722652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.722815 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.722894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.723065 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.723152 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.723307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.723385 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.723541 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.723620 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.723786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.723872 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.724054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.724139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.724299 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.724379 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.724551 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.724642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.724796 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.724951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.725031 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.725195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.725274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.725453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.725535 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.725708 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.725788 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.725962 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.726043 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.726207 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.726287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.726446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.726525 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.726708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.726787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.727007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.727591 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.727766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.727847 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.728023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.728105 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.728269 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.728357 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.728508 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.728590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] role.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.728761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] role.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.728839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.729001 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.729082 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.729256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.729337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.729495 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.729573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.729735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.729816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.729972 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.730053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.730212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.730296 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.730455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.730536 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.730703 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.730782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.730942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.731028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.731193 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.731272 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.731444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.731522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.731684 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.731773 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.731935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.732034 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.732205 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.732285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.732458 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.732599 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.732701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.732842 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.732944 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.733101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.733182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.733362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.733443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.733617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.733696 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.733869 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.733949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.734110 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.734192 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.734370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.734450 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.734630 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.734711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.734875 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.734969 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.735114 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.735195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.735354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.735434 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.735591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.735679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.735830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.735915 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.736095 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.736179 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.736339 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.736432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.736582 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.736663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.736827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.736906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.737063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.737151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.737304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.737385 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.737545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.737624 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.737796 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.737884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.738036 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.738116 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.738285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.738364 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.738524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.738612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.738762 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.738841 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.738999 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.739325 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.739425 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 15:44:06.739584 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.739738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.739978 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.740312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.740552 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.740804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.741055 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.741291 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.741540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.741838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.742102 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.742351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.742630 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.742874 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.743120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.743366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.743607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.743847 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.744116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.744367 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.744609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.744859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.745100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.745353 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.745603 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.745863 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.746101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.746347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.746586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 15:44:06.746762 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 15:44:06.768535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.768773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.769006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.771118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.771354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.771583 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.778221 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.781126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.806977 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.807210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.807702 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.807942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.861696 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.861892 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.911428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.911561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.911649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.911739 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.979613 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.979754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.979855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.979942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.980114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.980201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.980353 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.980475 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.980561 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.980653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.980785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:06.980873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.004124 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.004358 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.004497 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.004602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.004740 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.004832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.004969 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.005055 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.005199 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.005284 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.005412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.005493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.005634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.005857 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.017143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.017572 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.030306 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.030538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.030640 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.030772 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.030885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.031031 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.031147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.031230 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.031321 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.031435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.031547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.031654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.031773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.032020 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 15:44:07.048632 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.048844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 15:44:07.049182 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.049385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 15:44:07.049648 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.049749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.049866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 15:44:07.049952 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.050156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.050240 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.050396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 15:44:07.050480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.050673 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.050950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.051212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.051471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.061370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.061651 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.061920 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.062200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.062627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.062909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.063182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.063465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.070253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.072142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.074084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.074367 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.074653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.075044 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.075332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.075416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.075598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.075682 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.075871 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.075956 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.076176 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.076274 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.076452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.076535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.076735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.076894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.076987 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.077173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.077456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.077733 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.078012 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.078285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.103930 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.104981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.105566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.105845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.106690 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.106975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.111135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.111424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.111715 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.112255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.112538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.112825 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.119309 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.119595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.120366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.120652 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.124276 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.124571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.124857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.125131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.125216 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.125417 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.125529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.125694 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.125816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.125965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.126103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.126235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.126387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.126670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.126945 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.127219 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.145244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.145521 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.146280 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.146565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.150634 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.151805 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.154257 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.154555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.155470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.155771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.159541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.160779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.163141 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.164444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.168189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.168496 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.168785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.169070 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.169354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.169521 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.169638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.169829 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.170119 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.170405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.170693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.170973 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.188425 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.188805 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.189078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.189356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.189824 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.190113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.190386 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.190669 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.197729 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.199171 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.199436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.199718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.200927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.201210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.202744 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.203038 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.203319 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.203601 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.203899 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.204268 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.204560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.204844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.205135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.205426 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.217728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.218010 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.218294 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.218578 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.218860 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.219136 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.219292 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.219412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.219576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.219862 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.220174 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.220464 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.220746 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.221021 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.237357 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.239044 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.240861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.242620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.244182 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.245784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.245937 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.247439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.247537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.247718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.248026 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.249220 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.249501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.249783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.255392 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.257030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.257197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.259343 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.260752 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.261046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.261329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.261605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.262566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.262861 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.263148 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.263429 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.270763 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.271055 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.271339 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.272484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.272776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.273167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.279274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.279558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.279841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.280143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.280420 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.280711 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.281026 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.281121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 15:44:07.281307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.281394 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.281584 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.281668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.281855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.281941 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.282127 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.282213 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.282404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.282487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.282678 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.282763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.282937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.283021 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.283289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.283563 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.283837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.284212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.284484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.284747 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 15:44:07.322698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x559d854479c0 pid: 80315 (default app) Jun 02 15:44:07.323411 dv-cinder-797608-27-smb devstack@keystone.service[80316]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x559d854479c0 pid: 80316 (default app) Jun 02 15:44:07.326071 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54add8c3-38bb-4b52-999c-99bdba9fbd27 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:07.326373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54add8c3-38bb-4b52-999c-99bdba9fbd27 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:07.326660 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54add8c3-38bb-4b52-999c-99bdba9fbd27 None None] PATH_INFO: `/v3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:07.330905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Thu Jun 2 15:44:07 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:16.565773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0071a7c-88bc-45fb-9f01-7a786d188a15 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:16.566321 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0071a7c-88bc-45fb-9f01-7a786d188a15 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:16.566321 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0071a7c-88bc-45fb-9f01-7a786d188a15 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:16.571303 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1/2] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:16.576562 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82551d06-e457-4ac4-bc2a-7fba7c00285f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:16.576941 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82551d06-e457-4ac4-bc2a-7fba7c00285f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:16.577128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82551d06-e457-4ac4-bc2a-7fba7c00285f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:16.644129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: INFO dbcounter [None req-82551d06-e457-4ac4-bc2a-7fba7c00285f None None] Registered counter for database keystone Jun 02 15:44:16.671092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG oslo_db.sqlalchemy.engines [None req-82551d06-e457-4ac4-bc2a-7fba7c00285f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 15:44:16.679075 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writer thread running {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 15:44:16.959375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG passlib.handlers.bcrypt [None req-82551d06-e457-4ac4-bc2a-7fba7c00285f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80315) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 15:44:16.959950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG passlib.handlers.bcrypt [None req-82551d06-e457-4ac4-bc2a-7fba7c00285f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80315) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 15:44:17.017804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-82551d06-e457-4ac4-bc2a-7fba7c00285f None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:17.019423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-82551d06-e457-4ac4-bc2a-7fba7c00285f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:17.141949 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 566 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 02 15:44:17.294381 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0071a7c-88bc-45fb-9f01-7a786d188a15 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:17.362176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: INFO dbcounter [None req-c0071a7c-88bc-45fb-9f01-7a786d188a15 None None] Registered counter for database keystone Jun 02 15:44:17.381398 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG oslo_db.sqlalchemy.engines [None req-c0071a7c-88bc-45fb-9f01-7a786d188a15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 15:44:17.387531 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writer thread running {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 15:44:17.609324 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0071a7c-88bc-45fb-9f01-7a786d188a15 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:17.613643 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e266a-b7fa-46e0-ae91-19cac2b24de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:17.614301 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e266a-b7fa-46e0-ae91-19cac2b24de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:17.614848 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e266a-b7fa-46e0-ae91-19cac2b24de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:17.615138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e266a-b7fa-46e0-ae91-19cac2b24de3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:17.623198 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e266a-b7fa-46e0-ae91-19cac2b24de3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:17.674264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: WARNING keystone.common.rbac_enforcer.enforcer [None req-324e266a-b7fa-46e0-ae91-19cac2b24de3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 15:44:17.674613 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e266a-b7fa-46e0-ae91-19cac2b24de3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:17.683834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 2/4] 10.222.0.50 () {58 vars in 1324 bytes} [Thu Jun 2 15:44:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 15:44:17.689843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82551d06-e457-4ac4-bc2a-7fba7c00285f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:17.704548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82551d06-e457-4ac4-bc2a-7fba7c00285f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:17.709047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39bc4e-de98-4ac7-ba35-d3c3e0180ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:17.710162 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39bc4e-de98-4ac7-ba35-d3c3e0180ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:17.710450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39bc4e-de98-4ac7-ba35-d3c3e0180ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:17.710731 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39bc4e-de98-4ac7-ba35-d3c3e0180ba2 admin admin] PATH_INFO: `/v3/projects/6cbd1e15210e404da74f1144aa119ef8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:17.712833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39bc4e-de98-4ac7-ba35-d3c3e0180ba2 admin admin] RBAC: Authorizing `identity:get_project(project_id=6cbd1e15210e404da74f1144aa119ef8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:17.764452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1a39bc4e-de98-4ac7-ba35-d3c3e0180ba2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 15:44:17.764797 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39bc4e-de98-4ac7-ba35-d3c3e0180ba2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:17.769430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 3/5] 10.222.0.50 () {56 vars in 1207 bytes} [Thu Jun 2 15:44:17 2022] GET /identity/v3/projects/6cbd1e15210e404da74f1144aa119ef8 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:19.967612 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07943c-c49d-4471-bfcd-c25b0fa65d6a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:19.968168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07943c-c49d-4471-bfcd-c25b0fa65d6a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:19.968267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07943c-c49d-4471-bfcd-c25b0fa65d6a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:19.972377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 3/6] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:19.978310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da4111-214f-4c53-a097-4fd3176afb15 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:19.978722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da4111-214f-4c53-a097-4fd3176afb15 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:19.978867 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da4111-214f-4c53-a097-4fd3176afb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:19.998348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-52da4111-214f-4c53-a097-4fd3176afb15 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:19.999924 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-52da4111-214f-4c53-a097-4fd3176afb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:20.007873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 4/7] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 15:44:20.030226 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07943c-c49d-4471-bfcd-c25b0fa65d6a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:20.042846 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07943c-c49d-4471-bfcd-c25b0fa65d6a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:20.047036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920efaf3-d77d-4583-bcb6-efcf740027fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:20.047664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920efaf3-d77d-4583-bcb6-efcf740027fe admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:20.047955 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920efaf3-d77d-4583-bcb6-efcf740027fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:20.048267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920efaf3-d77d-4583-bcb6-efcf740027fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:20.057404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920efaf3-d77d-4583-bcb6-efcf740027fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:20.059166 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920efaf3-d77d-4583-bcb6-efcf740027fe admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:20.068090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 4/8] 10.222.0.50 () {58 vars in 1324 bytes} [Thu Jun 2 15:44:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 15:44:20.073403 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da4111-214f-4c53-a097-4fd3176afb15 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:20.082208 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da4111-214f-4c53-a097-4fd3176afb15 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:20.086593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545a22d-70c3-438b-afc8-26dba5097d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:20.087443 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545a22d-70c3-438b-afc8-26dba5097d4f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:20.087730 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545a22d-70c3-438b-afc8-26dba5097d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:20.088035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545a22d-70c3-438b-afc8-26dba5097d4f admin admin] PATH_INFO: `/v3/users/1c6d5baab170407ca73cb1da472cac82` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:20.089409 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545a22d-70c3-438b-afc8-26dba5097d4f admin admin] RBAC: Authorizing `identity:get_user(user_id=1c6d5baab170407ca73cb1da472cac82)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:20.091222 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545a22d-70c3-438b-afc8-26dba5097d4f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:20.092859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 5/9] 10.222.0.50 () {56 vars in 1198 bytes} [Thu Jun 2 15:44:20 2022] GET /identity/v3/users/1c6d5baab170407ca73cb1da472cac82 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:22.423774 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a270c68-b63e-4048-a481-cc9d28ff723a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:22.424311 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a270c68-b63e-4048-a481-cc9d28ff723a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:22.424397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a270c68-b63e-4048-a481-cc9d28ff723a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:22.425718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 5/10] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:22.430788 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c854e-0dd7-4f69-96b5-023d35cbb41d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:22.431283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c854e-0dd7-4f69-96b5-023d35cbb41d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:22.431745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c854e-0dd7-4f69-96b5-023d35cbb41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:22.432802 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab530e3-298c-48b7-a0ff-9308b1e22fb3 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:22.433099 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab530e3-298c-48b7-a0ff-9308b1e22fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:22.433541 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab530e3-298c-48b7-a0ff-9308b1e22fb3 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:22.434799 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 6/11] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:44:22.439672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f784e7d-023b-4af6-8ed4-297e2b2b1f65 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:22.439965 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f784e7d-023b-4af6-8ed4-297e2b2b1f65 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:22.440284 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f784e7d-023b-4af6-8ed4-297e2b2b1f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:22.448393 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9f7c854e-0dd7-4f69-96b5-023d35cbb41d None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:22.449566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9f7c854e-0dd7-4f69-96b5-023d35cbb41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:22.480965 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG passlib.handlers.bcrypt [None req-0f784e7d-023b-4af6-8ed4-297e2b2b1f65 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80316) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 15:44:22.481403 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG passlib.handlers.bcrypt [None req-0f784e7d-023b-4af6-8ed4-297e2b2b1f65 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80316) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 15:44:22.527517 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 6/12] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:22.528031 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0f784e7d-023b-4af6-8ed4-297e2b2b1f65 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:22.529668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0f784e7d-023b-4af6-8ed4-297e2b2b1f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:22.549482 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c854e-0dd7-4f69-96b5-023d35cbb41d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:22.572964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:22.627856 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 7/13] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:44:22.651553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c854e-0dd7-4f69-96b5-023d35cbb41d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:22.651698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f784e7d-023b-4af6-8ed4-297e2b2b1f65 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:22.684793 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b228b-0ff2-42fc-8d16-ee7bbf67c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:22.685446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b228b-0ff2-42fc-8d16-ee7bbf67c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:22.685738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b228b-0ff2-42fc-8d16-ee7bbf67c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:22.686025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b228b-0ff2-42fc-8d16-ee7bbf67c9a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:22.756617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b228b-0ff2-42fc-8d16-ee7bbf67c9a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:22.756909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f784e7d-023b-4af6-8ed4-297e2b2b1f65 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:22.758651 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b228b-0ff2-42fc-8d16-ee7bbf67c9a3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:22.759816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:22.782644 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:22.796503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a928e1-f4f0-47dd-af01-2f6fe3a0a9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:22.797544 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a928e1-f4f0-47dd-af01-2f6fe3a0a9dd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:22.797834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a928e1-f4f0-47dd-af01-2f6fe3a0a9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:22.798118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a928e1-f4f0-47dd-af01-2f6fe3a0a9dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:22.810400 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a928e1-f4f0-47dd-af01-2f6fe3a0a9dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:22.822232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-34a928e1-f4f0-47dd-af01-2f6fe3a0a9dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:44:22.822232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:22.822232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:22.822232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:22.822232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:22.822232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:22.822232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:22.822232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:22.822232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:22.822232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:22.822232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:22.822232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:22.822232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:22.822232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:22.822232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:22.822232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:22.827331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:22.827331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:22.827331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:22.827331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:22.827331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:22.827331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:22.827331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:22.827331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:22.827331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:22.827331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:22.827331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:22.827331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:22.827331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:22.827331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:22.827331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:22.827331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:22.828201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:22.828201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:22.828201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:22.828201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:22.828201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:22.828201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:22.828201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:22.828201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:22.828201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:22.828201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:22.828201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:44:22.828201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:44:22.828201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 8/14] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:44:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:44:22.829332 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a928e1-f4f0-47dd-af01-2f6fe3a0a9dd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:22.856263 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 7/15] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:44:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 15:44:22.861495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b228b-0ff2-42fc-8d16-ee7bbf67c9a3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:22.927338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a928e1-f4f0-47dd-af01-2f6fe3a0a9dd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:22.956840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b228b-0ff2-42fc-8d16-ee7bbf67c9a3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:22.959476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52aec9-5d22-4d29-a743-d4fbce926e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:22.960175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52aec9-5d22-4d29-a743-d4fbce926e76 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:22.960468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52aec9-5d22-4d29-a743-d4fbce926e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:22.960752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52aec9-5d22-4d29-a743-d4fbce926e76 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:22.962121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52aec9-5d22-4d29-a743-d4fbce926e76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:22.962438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52aec9-5d22-4d29-a743-d4fbce926e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:22.963887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52aec9-5d22-4d29-a743-d4fbce926e76 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:22.975583 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 9/16] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:22.978523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:22.981210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52aec9-5d22-4d29-a743-d4fbce926e76 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:22.989505 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367774c0-535f-44dd-99a9-0cf8f07eabc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:22.992128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367774c0-535f-44dd-99a9-0cf8f07eabc5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:22.992128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367774c0-535f-44dd-99a9-0cf8f07eabc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:22.992128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367774c0-535f-44dd-99a9-0cf8f07eabc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:23.001530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367774c0-535f-44dd-99a9-0cf8f07eabc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:23.003056 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367774c0-535f-44dd-99a9-0cf8f07eabc5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:23.006882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:23.024531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-367774c0-535f-44dd-99a9-0cf8f07eabc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:44:23.024531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:23.024531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:23.024531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:23.024531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:23.024531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:23.024531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:23.024531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:23.024531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:23.024531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:23.024531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:23.024531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:23.024531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:44:23.024531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:44:23.024531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:23.025498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:23.026342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:44:23.026342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:44:23.026342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:44:23.026342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:44:23.026342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 8/17] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:44:23.031473 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367774c0-535f-44dd-99a9-0cf8f07eabc5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:23.078249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52aec9-5d22-4d29-a743-d4fbce926e76 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:23.113874 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c2815-33b2-45da-9035-9fb6b857ac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:23.115011 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c2815-33b2-45da-9035-9fb6b857ac3e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:23.115294 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c2815-33b2-45da-9035-9fb6b857ac3e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:23.115570 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c2815-33b2-45da-9035-9fb6b857ac3e None admin] PATH_INFO: `/v3/users/1c6d5baab170407ca73cb1da472cac82` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:23.117109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c2815-33b2-45da-9035-9fb6b857ac3e None admin] RBAC: Authorizing `identity:get_user(user_id=1c6d5baab170407ca73cb1da472cac82)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:23.119074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c2815-33b2-45da-9035-9fb6b857ac3e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:23.120804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 10/18] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:22 2022] GET /identity/v3/users/1c6d5baab170407ca73cb1da472cac82 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:23.126391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c2815-33b2-45da-9035-9fb6b857ac3e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:23.129654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367774c0-535f-44dd-99a9-0cf8f07eabc5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:23.162568 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3228c-0e93-497a-873f-bcedf82b998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:23.163225 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3228c-0e93-497a-873f-bcedf82b998d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:23.163515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3228c-0e93-497a-873f-bcedf82b998d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:23.163798 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3228c-0e93-497a-873f-bcedf82b998d None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:23.164550 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3228c-0e93-497a-873f-bcedf82b998d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:23.164866 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3228c-0e93-497a-873f-bcedf82b998d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:23.166257 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3228c-0e93-497a-873f-bcedf82b998d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:23.183477 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 9/19] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:23.220935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:23.227455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c2815-33b2-45da-9035-9fb6b857ac3e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:23.265363 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d5ae0-73f7-4189-aaef-aedec7245786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:23.266176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d5ae0-73f7-4189-aaef-aedec7245786 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:23.266462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d5ae0-73f7-4189-aaef-aedec7245786 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:23.266737 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d5ae0-73f7-4189-aaef-aedec7245786 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:23.267967 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d5ae0-73f7-4189-aaef-aedec7245786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:23.269471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d5ae0-73f7-4189-aaef-aedec7245786 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:23.271137 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 11/20] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:44:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:23.277191 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3228c-0e93-497a-873f-bcedf82b998d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:23.313223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:23.385640 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3228c-0e93-497a-873f-bcedf82b998d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:23.419014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83508c3-aaa3-48c6-83ee-3746cfcdc0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:23.419660 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83508c3-aaa3-48c6-83ee-3746cfcdc0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:23.419953 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83508c3-aaa3-48c6-83ee-3746cfcdc0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:23.420269 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83508c3-aaa3-48c6-83ee-3746cfcdc0e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:23.421142 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83508c3-aaa3-48c6-83ee-3746cfcdc0e7 None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.domain.id=default, user.id=1c6d5baab170407ca73cb1da472cac82) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:23.421467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83508c3-aaa3-48c6-83ee-3746cfcdc0e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:23.422934 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83508c3-aaa3-48c6-83ee-3746cfcdc0e7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:23.429665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 10/21] 10.222.0.50 () {56 vars in 1322 bytes} [Thu Jun 2 15:44:23 2022] GET /identity/v3/role_assignments?user.id=1c6d5baab170407ca73cb1da472cac82&scope.domain.id=default&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:25.686975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b48b3-4abb-4039-8dc3-2a02bfee59d1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:25.687485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b48b3-4abb-4039-8dc3-2a02bfee59d1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:25.687485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b48b3-4abb-4039-8dc3-2a02bfee59d1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:25.688913 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 12/22] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:25.706139 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ddbc7-9871-4aa9-9961-fd8bc18329e9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:25.706648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ddbc7-9871-4aa9-9961-fd8bc18329e9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:25.706911 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ddbc7-9871-4aa9-9961-fd8bc18329e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:25.730083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a49ddbc7-9871-4aa9-9961-fd8bc18329e9 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:25.731312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a49ddbc7-9871-4aa9-9961-fd8bc18329e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:25.823479 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 11/23] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:25.863547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b48b3-4abb-4039-8dc3-2a02bfee59d1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:25.997717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b48b3-4abb-4039-8dc3-2a02bfee59d1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:26.044894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d39d21-1635-44d1-9daa-95ca84794ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:26.046072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d39d21-1635-44d1-9daa-95ca84794ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:26.046560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d39d21-1635-44d1-9daa-95ca84794ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:26.047038 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d39d21-1635-44d1-9daa-95ca84794ff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:26.071704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d39d21-1635-44d1-9daa-95ca84794ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:26.082735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d39d21-1635-44d1-9daa-95ca84794ff6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:26.104922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e3d39d21-1635-44d1-9daa-95ca84794ff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:44:26.104922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:26.104922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:26.104922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:26.104922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:26.104922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:26.104922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:26.104922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:26.104922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:26.104922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:26.104922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:26.104922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:26.104922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:44:26.104922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:44:26.104922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:26.105804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:26.106615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:44:26.106615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:44:26.106615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:44:26.106615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:44:26.106615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 13/24] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:26.117134 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ddbc7-9871-4aa9-9961-fd8bc18329e9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:26.148863 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c429f-14a0-4651-96fd-4e37d815a0a4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:26.149160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c429f-14a0-4651-96fd-4e37d815a0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:26.149438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c429f-14a0-4651-96fd-4e37d815a0a4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:26.151296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 14/25] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:26.154536 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:26.156426 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb98ad-9729-4082-a2fd-03fa18f4b90d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:26.156718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb98ad-9729-4082-a2fd-03fa18f4b90d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:26.157003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb98ad-9729-4082-a2fd-03fa18f4b90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:26.188369 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-54bb98ad-9729-4082-a2fd-03fa18f4b90d None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:26.190359 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-54bb98ad-9729-4082-a2fd-03fa18f4b90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:26.220473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:26.260479 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ddbc7-9871-4aa9-9961-fd8bc18329e9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:26.300175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91938b-b4ed-44ee-8685-565f0cc1a099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:26.300874 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91938b-b4ed-44ee-8685-565f0cc1a099 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:26.301171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91938b-b4ed-44ee-8685-565f0cc1a099 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:26.301462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91938b-b4ed-44ee-8685-565f0cc1a099 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:26.302221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91938b-b4ed-44ee-8685-565f0cc1a099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:26.302543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91938b-b4ed-44ee-8685-565f0cc1a099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:26.304019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91938b-b4ed-44ee-8685-565f0cc1a099 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:26.324275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 12/26] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:26.332967 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91938b-b4ed-44ee-8685-565f0cc1a099 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:26.382838 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 15/27] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:26.389499 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3e81-4325-4d93-a6d4-0c5567115cb5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:26.389796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3e81-4325-4d93-a6d4-0c5567115cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:26.390083 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3e81-4325-4d93-a6d4-0c5567115cb5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:26.391927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 16/28] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:26.409501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06725b87-67f1-4356-999f-4ff344490dd4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:26.409798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06725b87-67f1-4356-999f-4ff344490dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:26.410084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06725b87-67f1-4356-999f-4ff344490dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:26.441053 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-06725b87-67f1-4356-999f-4ff344490dd4 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:26.442267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-06725b87-67f1-4356-999f-4ff344490dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:26.456610 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:26.472290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91938b-b4ed-44ee-8685-565f0cc1a099 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:26.540777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58245ab5-2bed-4c80-b80c-f5adb775b7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:26.541365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58245ab5-2bed-4c80-b80c-f5adb775b7f8 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:26.541658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58245ab5-2bed-4c80-b80c-f5adb775b7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:26.541944 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58245ab5-2bed-4c80-b80c-f5adb775b7f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:26.543688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58245ab5-2bed-4c80-b80c-f5adb775b7f8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:26.545184 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58245ab5-2bed-4c80-b80c-f5adb775b7f8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:26.577123 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 17/29] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:26.587096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06725b87-67f1-4356-999f-4ff344490dd4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:26.673155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:26.702452 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06725b87-67f1-4356-999f-4ff344490dd4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:26.740700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de549ee-8e44-4661-96ba-0840405d3904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:26.741868 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de549ee-8e44-4661-96ba-0840405d3904 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:26.742938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de549ee-8e44-4661-96ba-0840405d3904 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:26.743426 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de549ee-8e44-4661-96ba-0840405d3904 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:26.755563 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de549ee-8e44-4661-96ba-0840405d3904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:26.764784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5de549ee-8e44-4661-96ba-0840405d3904 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:44:26.764784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:26.764784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:26.764784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:26.764784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:26.764784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:26.764784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:26.764784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:26.764784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:26.764784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:26.764784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:26.764784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:26.764784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:26.764784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:26.764784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:26.764784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:26.765670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:26.765670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:26.765670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:26.765670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:26.765670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:26.765670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:26.765670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:26.765670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:26.765670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:26.765670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:26.765670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:26.765670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:26.765670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:26.765670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:26.765670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:26.765670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:26.766480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:26.766480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:26.766480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:26.766480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:26.766480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:26.766480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:26.766480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:26.766480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:26.766480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:26.766480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:26.766480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:44:26.766480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:44:26.768897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 18/30] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:44:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:26.770364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff6f0a-9cb5-453a-8c4a-e14ae7f7122c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:26.770873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff6f0a-9cb5-453a-8c4a-e14ae7f7122c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:26.771374 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff6f0a-9cb5-453a-8c4a-e14ae7f7122c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:26.777231 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 19/31] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:26.778293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff6f0a-9cb5-453a-8c4a-e14ae7f7122c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:26.810582 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 13/32] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Jun 2 15:44:26 2022] POST /identity/v3/projects => generated 301 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:44:26.817831 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79735598-39ed-4ed5-afbc-af04e0404d67 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:26.818179 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79735598-39ed-4ed5-afbc-af04e0404d67 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:26.818418 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79735598-39ed-4ed5-afbc-af04e0404d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:26.857245 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-79735598-39ed-4ed5-afbc-af04e0404d67 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:26.858989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-79735598-39ed-4ed5-afbc-af04e0404d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:26.902993 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff6f0a-9cb5-453a-8c4a-e14ae7f7122c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:26.945439 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb142b-3b2a-4f24-bb6a-b08442f3a3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:26.946553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb142b-3b2a-4f24-bb6a-b08442f3a3c5 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:26.947044 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb142b-3b2a-4f24-bb6a-b08442f3a3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:26.947571 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb142b-3b2a-4f24-bb6a-b08442f3a3c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:26.948556 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb142b-3b2a-4f24-bb6a-b08442f3a3c5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:26.950395 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb142b-3b2a-4f24-bb6a-b08442f3a3c5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:26.954318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:26.995975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 14/33] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:26.997433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79735598-39ed-4ed5-afbc-af04e0404d67 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:27.121844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:27.161310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79735598-39ed-4ed5-afbc-af04e0404d67 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:27.205564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4a261-71f2-446e-b756-a6780ead053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:27.206928 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4a261-71f2-446e-b756-a6780ead053a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:27.207467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4a261-71f2-446e-b756-a6780ead053a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:27.207958 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4a261-71f2-446e-b756-a6780ead053a None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:27.211752 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4a261-71f2-446e-b756-a6780ead053a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:27.212393 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4a261-71f2-446e-b756-a6780ead053a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:27.214258 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4a261-71f2-446e-b756-a6780ead053a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:27.216674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 20/34] 10.222.0.50 () {60 vars in 1131 bytes} [Thu Jun 2 15:44:26 2022] POST /identity/v3/roles => generated 219 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:44:27.217750 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb142b-3b2a-4f24-bb6a-b08442f3a3c5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:27.235549 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 15/35] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:27.259944 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4a261-71f2-446e-b756-a6780ead053a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:27.340549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb142b-3b2a-4f24-bb6a-b08442f3a3c5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:27.380820 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0f389-3d76-4064-a664-84f07bd1bc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:27.381504 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0f389-3d76-4064-a664-84f07bd1bc14 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:27.381821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0f389-3d76-4064-a664-84f07bd1bc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:27.382072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0f389-3d76-4064-a664-84f07bd1bc14 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:27.384999 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0f389-3d76-4064-a664-84f07bd1bc14 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:27.384999 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0f389-3d76-4064-a664-84f07bd1bc14 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:27.412966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4a261-71f2-446e-b756-a6780ead053a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:27.448419 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:27.454065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f6589-e21a-4038-9987-828c7cc329ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:27.454970 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f6589-e21a-4038-9987-828c7cc329ae None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:27.455264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f6589-e21a-4038-9987-828c7cc329ae None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:27.455551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f6589-e21a-4038-9987-828c7cc329ae None admin] PATH_INFO: `/v3/users/1c6d5baab170407ca73cb1da472cac82` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:27.456851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f6589-e21a-4038-9987-828c7cc329ae None admin] RBAC: Authorizing `identity:get_user(user_id=1c6d5baab170407ca73cb1da472cac82)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:27.463394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f6589-e21a-4038-9987-828c7cc329ae None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:27.463394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 16/36] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:27 2022] GET /identity/v3/users/1c6d5baab170407ca73cb1da472cac82 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:27.463394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977a283-be80-44ee-bb7b-89266654d03e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:27.463394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977a283-be80-44ee-bb7b-89266654d03e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:27.463394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977a283-be80-44ee-bb7b-89266654d03e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:27.463758 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 17/37] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:27.468008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977a283-be80-44ee-bb7b-89266654d03e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:27.501062 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 21/38] 10.222.0.50 () {60 vars in 1131 bytes} [Thu Jun 2 15:44:27 2022] POST /identity/v3/roles => generated 225 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:44:27.503001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b1cd5-308b-4fff-902f-37cbdcbad2ff None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:27.503307 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b1cd5-308b-4fff-902f-37cbdcbad2ff None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:27.503600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b1cd5-308b-4fff-902f-37cbdcbad2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:27.537855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-661b1cd5-308b-4fff-902f-37cbdcbad2ff None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:27.540181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-661b1cd5-308b-4fff-902f-37cbdcbad2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:27.620320 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:27.620745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977a283-be80-44ee-bb7b-89266654d03e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:27.649296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 22/39] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:27.651786 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b99c3-5a16-454b-8f5f-47a217ac5b1f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:27.652362 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b99c3-5a16-454b-8f5f-47a217ac5b1f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:27.653157 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b99c3-5a16-454b-8f5f-47a217ac5b1f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:27.654797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 23/40] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:27.660477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b77dd-8135-4623-8c7c-5fed9f96dabd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:27.660773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b77dd-8135-4623-8c7c-5fed9f96dabd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:27.661063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b77dd-8135-4623-8c7c-5fed9f96dabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:27.670246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff571e3-7949-495d-9f27-f85422fc9870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:27.671095 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff571e3-7949-495d-9f27-f85422fc9870 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:27.671389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff571e3-7949-495d-9f27-f85422fc9870 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:27.671726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff571e3-7949-495d-9f27-f85422fc9870 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:27.673039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff571e3-7949-495d-9f27-f85422fc9870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:27.674715 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff571e3-7949-495d-9f27-f85422fc9870 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:27.676757 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 18/41] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:44:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:27.677695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff571e3-7949-495d-9f27-f85422fc9870 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:27.683850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bd2b77dd-8135-4623-8c7c-5fed9f96dabd None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:27.685162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bd2b77dd-8135-4623-8c7c-5fed9f96dabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:27.764128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:27.766939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 24/42] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:44:27.767858 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b77dd-8135-4623-8c7c-5fed9f96dabd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:27.800391 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff571e3-7949-495d-9f27-f85422fc9870 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:27.833935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b13e0-5edc-4ecd-8e46-7b386167e5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:27.834724 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b13e0-5edc-4ecd-8e46-7b386167e5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:27.835010 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b13e0-5edc-4ecd-8e46-7b386167e5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:27.835290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b13e0-5edc-4ecd-8e46-7b386167e5b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:27.836997 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b13e0-5edc-4ecd-8e46-7b386167e5b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:27.838480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b13e0-5edc-4ecd-8e46-7b386167e5b7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:27.840088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 19/43] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:44:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:27.841336 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b13e0-5edc-4ecd-8e46-7b386167e5b7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:27.870370 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b77dd-8135-4623-8c7c-5fed9f96dabd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:27.883888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:27.904062 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aab865-4045-47ab-88ba-b46bcb7b39b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:27.904869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aab865-4045-47ab-88ba-b46bcb7b39b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:27.905157 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aab865-4045-47ab-88ba-b46bcb7b39b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:27.905448 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aab865-4045-47ab-88ba-b46bcb7b39b9 None admin] PATH_INFO: `/v3/domains/default/users/1c6d5baab170407ca73cb1da472cac82/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:27.907675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aab865-4045-47ab-88ba-b46bcb7b39b9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1c6d5baab170407ca73cb1da472cac82, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:27.909167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aab865-4045-47ab-88ba-b46bcb7b39b9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:27.939874 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b13e0-5edc-4ecd-8e46-7b386167e5b7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:27.972447 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668e391-5e76-494f-bcc9-14992e31a699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:27.973111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668e391-5e76-494f-bcc9-14992e31a699 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:27.973404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668e391-5e76-494f-bcc9-14992e31a699 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:27.973689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668e391-5e76-494f-bcc9-14992e31a699 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:27.974426 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668e391-5e76-494f-bcc9-14992e31a699 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:27.975862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668e391-5e76-494f-bcc9-14992e31a699 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:27.980216 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:28.016529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 25/44] 10.222.0.50 () {58 vars in 1361 bytes} [Thu Jun 2 15:44:27 2022] PUT /identity/v3/domains/default/users/1c6d5baab170407ca73cb1da472cac82/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:44:28.017423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aab865-4045-47ab-88ba-b46bcb7b39b9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:28.104023 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 20/45] 10.222.0.50 () {60 vars in 1131 bytes} [Thu Jun 2 15:44:27 2022] POST /identity/v3/roles => generated 223 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:44:28.151733 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aab865-4045-47ab-88ba-b46bcb7b39b9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:28.192115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c7184-dea9-431b-a8b6-72665e8769f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:28.192729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c7184-dea9-431b-a8b6-72665e8769f3 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:28.193058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c7184-dea9-431b-a8b6-72665e8769f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:28.193308 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c7184-dea9-431b-a8b6-72665e8769f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:28.194062 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c7184-dea9-431b-a8b6-72665e8769f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:28.196208 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c7184-dea9-431b-a8b6-72665e8769f3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:28.321975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 26/46] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Jun 2 15:44:28 2022] POST /identity/v3/projects => generated 312 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:44:30.308176 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714b830-e4fa-4804-91be-1d58424ed530 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:30.308718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714b830-e4fa-4804-91be-1d58424ed530 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:30.308803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714b830-e4fa-4804-91be-1d58424ed530 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:30.310133 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 21/47] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:30.315401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4280b-2938-4838-b96a-d7f020e8a768 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:30.315816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4280b-2938-4838-b96a-d7f020e8a768 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:30.316008 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4280b-2938-4838-b96a-d7f020e8a768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:30.333719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a6b4280b-2938-4838-b96a-d7f020e8a768 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:30.334920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a6b4280b-2938-4838-b96a-d7f020e8a768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:30.357421 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:30.404290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 27/48] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:30.427317 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714b830-e4fa-4804-91be-1d58424ed530 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:30.526265 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714b830-e4fa-4804-91be-1d58424ed530 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:30.558487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b8e92-314c-49e7-9a91-336b6bd69f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:30.559210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b8e92-314c-49e7-9a91-336b6bd69f97 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:30.559500 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b8e92-314c-49e7-9a91-336b6bd69f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:30.559778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b8e92-314c-49e7-9a91-336b6bd69f97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:30.564745 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5c3ce-a4c9-4f87-9042-5b0b7d7ccbb9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:30.565046 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5c3ce-a4c9-4f87-9042-5b0b7d7ccbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:30.565334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5c3ce-a4c9-4f87-9042-5b0b7d7ccbb9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:30.566704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 28/49] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:44:30.571495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b8e92-314c-49e7-9a91-336b6bd69f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:30.571928 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aa3a6-a05e-400c-a9bc-3d0c0ec55473 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:30.572256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aa3a6-a05e-400c-a9bc-3d0c0ec55473 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:30.572543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aa3a6-a05e-400c-a9bc-3d0c0ec55473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:30.580368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b37b8e92-314c-49e7-9a91-336b6bd69f97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:44:30.580368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:30.580368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:30.580368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:30.580368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:30.580368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:30.580368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:30.580368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:30.580368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:30.580368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:30.580368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:30.580368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:30.580368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:30.580368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:30.580368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:30.580368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:30.581242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:30.581242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:30.581242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:30.581242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:30.581242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:30.581242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:30.581242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:30.581242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:30.581242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:30.581242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:30.581242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:30.581242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:30.581242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:30.581242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:30.581242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:30.581242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:30.582002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:30.582002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:30.582002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:30.582002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:30.582002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:30.582002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:30.582002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:30.582002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:30.582002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:30.582002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:30.582002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:44:30.582002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:44:30.582002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 22/50] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:44:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:30.587753 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b8e92-314c-49e7-9a91-336b6bd69f97 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:30.590706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6d4aa3a6-a05e-400c-a9bc-3d0c0ec55473 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:30.591883 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6d4aa3a6-a05e-400c-a9bc-3d0c0ec55473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:30.642463 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:30.657610 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 29/51] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:44:30.680643 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aa3a6-a05e-400c-a9bc-3d0c0ec55473 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:30.684734 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b8e92-314c-49e7-9a91-336b6bd69f97 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:30.718788 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82ae5f-7b0d-4649-92d3-de61d49f05f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:30.719478 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82ae5f-7b0d-4649-92d3-de61d49f05f1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:30.719770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82ae5f-7b0d-4649-92d3-de61d49f05f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:30.720085 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82ae5f-7b0d-4649-92d3-de61d49f05f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:30.720849 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82ae5f-7b0d-4649-92d3-de61d49f05f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:30.721146 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82ae5f-7b0d-4649-92d3-de61d49f05f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:30.722550 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82ae5f-7b0d-4649-92d3-de61d49f05f1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:30.730723 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 23/52] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:30.736172 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82ae5f-7b0d-4649-92d3-de61d49f05f1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:30.763491 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:30.778304 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aa3a6-a05e-400c-a9bc-3d0c0ec55473 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:30.816802 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e2974-e9b1-4224-9256-e33028d994ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:30.817920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e2974-e9b1-4224-9256-e33028d994ee None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:30.818419 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e2974-e9b1-4224-9256-e33028d994ee None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:30.818970 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e2974-e9b1-4224-9256-e33028d994ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:30.821611 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e2974-e9b1-4224-9256-e33028d994ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:30.824075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e2974-e9b1-4224-9256-e33028d994ee None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:30.825906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 30/53] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:44:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:30.831233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e2974-e9b1-4224-9256-e33028d994ee None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:30.841984 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82ae5f-7b0d-4649-92d3-de61d49f05f1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:30.858292 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:30.875179 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effd3b9-0e0e-4030-87d0-ae341416dd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:30.876090 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effd3b9-0e0e-4030-87d0-ae341416dd11 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:30.876381 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effd3b9-0e0e-4030-87d0-ae341416dd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:30.876670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effd3b9-0e0e-4030-87d0-ae341416dd11 None admin] PATH_INFO: `/v3/users/1c6d5baab170407ca73cb1da472cac82` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:30.877854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effd3b9-0e0e-4030-87d0-ae341416dd11 None admin] RBAC: Authorizing `identity:get_user(user_id=1c6d5baab170407ca73cb1da472cac82)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:30.879307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effd3b9-0e0e-4030-87d0-ae341416dd11 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:30.880943 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 24/54] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:30 2022] GET /identity/v3/users/1c6d5baab170407ca73cb1da472cac82 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:30.886816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effd3b9-0e0e-4030-87d0-ae341416dd11 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:30.928520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e2974-e9b1-4224-9256-e33028d994ee None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:30.962253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358ee14-b819-43e8-9ab5-3d6a61876285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:30.962913 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358ee14-b819-43e8-9ab5-3d6a61876285 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:30.963206 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358ee14-b819-43e8-9ab5-3d6a61876285 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:30.963494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358ee14-b819-43e8-9ab5-3d6a61876285 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:30.964256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358ee14-b819-43e8-9ab5-3d6a61876285 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:30.965749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358ee14-b819-43e8-9ab5-3d6a61876285 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:30.983176 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effd3b9-0e0e-4030-87d0-ae341416dd11 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:31.015942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb851f5-a825-4bea-902b-59b857ce5030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:31.016760 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb851f5-a825-4bea-902b-59b857ce5030 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:31.017053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb851f5-a825-4bea-902b-59b857ce5030 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:31.017340 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb851f5-a825-4bea-902b-59b857ce5030 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:31.018518 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb851f5-a825-4bea-902b-59b857ce5030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:31.020008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb851f5-a825-4bea-902b-59b857ce5030 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:31.021630 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 25/55] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:44:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:31.027429 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb851f5-a825-4bea-902b-59b857ce5030 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:31.035117 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 31/56] 10.222.0.50 () {60 vars in 1140 bytes} [Thu Jun 2 15:44:30 2022] POST /identity/v3/projects => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:44:31.085560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:31.134168 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb851f5-a825-4bea-902b-59b857ce5030 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:31.169839 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8ecbc-2b69-4464-94fc-0fbe701a2a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:31.170520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8ecbc-2b69-4464-94fc-0fbe701a2a59 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:31.170813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8ecbc-2b69-4464-94fc-0fbe701a2a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:31.171095 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8ecbc-2b69-4464-94fc-0fbe701a2a59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:31.171941 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8ecbc-2b69-4464-94fc-0fbe701a2a59 None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.domain.id=default, user.id=1c6d5baab170407ca73cb1da472cac82) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:31.172289 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8ecbc-2b69-4464-94fc-0fbe701a2a59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:31.173777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8ecbc-2b69-4464-94fc-0fbe701a2a59 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:31.181083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 26/57] 10.222.0.50 () {56 vars in 1322 bytes} [Thu Jun 2 15:44:31 2022] GET /identity/v3/role_assignments?user.id=1c6d5baab170407ca73cb1da472cac82&scope.domain.id=default&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:33.274196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53ec74-a039-4983-b6e4-4dc347cac041 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:33.274707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53ec74-a039-4983-b6e4-4dc347cac041 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:33.274814 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53ec74-a039-4983-b6e4-4dc347cac041 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:33.276140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 32/58] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:33.281318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991ab81-aaba-488b-96ac-c8a3573c135b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:33.281671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991ab81-aaba-488b-96ac-c8a3573c135b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:33.281890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991ab81-aaba-488b-96ac-c8a3573c135b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:33.298191 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7991ab81-aaba-488b-96ac-c8a3573c135b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:33.299378 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7991ab81-aaba-488b-96ac-c8a3573c135b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:33.363299 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 27/59] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:33.388127 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53ec74-a039-4983-b6e4-4dc347cac041 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:33.397506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:33.486460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53ec74-a039-4983-b6e4-4dc347cac041 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:33.518720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8173fc7-7bef-4a09-b229-ba4e32e897fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:33.519502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8173fc7-7bef-4a09-b229-ba4e32e897fa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:33.519797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8173fc7-7bef-4a09-b229-ba4e32e897fa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:33.520115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8173fc7-7bef-4a09-b229-ba4e32e897fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:33.521289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8173fc7-7bef-4a09-b229-ba4e32e897fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:33.522756 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8173fc7-7bef-4a09-b229-ba4e32e897fa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:33.524994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 33/60] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:44:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:33.530497 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991ab81-aaba-488b-96ac-c8a3573c135b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:33.576586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:33.625621 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991ab81-aaba-488b-96ac-c8a3573c135b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:33.657374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a9050-4e65-4728-8329-dcb544866760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:33.658035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a9050-4e65-4728-8329-dcb544866760 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:33.658324 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a9050-4e65-4728-8329-dcb544866760 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:33.658608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a9050-4e65-4728-8329-dcb544866760 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:33.659306 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a9050-4e65-4728-8329-dcb544866760 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:33.660772 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a9050-4e65-4728-8329-dcb544866760 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:33.764867 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 28/61] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:44:33 2022] POST /identity/v3/users => generated 275 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:44:37.113853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983f65a-b81b-4208-ae9f-2e4e93848d5a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:37.114883 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983f65a-b81b-4208-ae9f-2e4e93848d5a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:37.115640 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983f65a-b81b-4208-ae9f-2e4e93848d5a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:37.117313 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 34/62] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:37.122888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d2e2e-e08a-4adc-8906-15e0144170cf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:37.123311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d2e2e-e08a-4adc-8906-15e0144170cf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:37.123460 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d2e2e-e08a-4adc-8906-15e0144170cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:37.149152 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bd4d2e2e-e08a-4adc-8906-15e0144170cf None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:37.150570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bd4d2e2e-e08a-4adc-8906-15e0144170cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:37.235822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 29/63] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:37.271518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983f65a-b81b-4208-ae9f-2e4e93848d5a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:37.328506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98afa6-6e70-4232-850c-ffd3a6999eae None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:37.329138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98afa6-6e70-4232-850c-ffd3a6999eae None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:37.329618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98afa6-6e70-4232-850c-ffd3a6999eae None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:37.331220 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 30/64] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:37.338491 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45513e7f-aabc-4a4c-b164-45faa28379c7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:37.339034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45513e7f-aabc-4a4c-b164-45faa28379c7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:37.339534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45513e7f-aabc-4a4c-b164-45faa28379c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:37.379278 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-45513e7f-aabc-4a4c-b164-45faa28379c7 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:37.381481 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-45513e7f-aabc-4a4c-b164-45faa28379c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:37.413104 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:37.441049 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983f65a-b81b-4208-ae9f-2e4e93848d5a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:37.453332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:37.477480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d53217-dd10-4484-a2b2-0d1b12079f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:37.478669 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d53217-dd10-4484-a2b2-0d1b12079f4a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:37.479188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d53217-dd10-4484-a2b2-0d1b12079f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:37.479670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d53217-dd10-4484-a2b2-0d1b12079f4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:37.491227 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d53217-dd10-4484-a2b2-0d1b12079f4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:37.499728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 31/65] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:37.504815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-70d53217-dd10-4484-a2b2-0d1b12079f4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:44:37.504815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:37.504815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:37.504815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:37.504815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:37.504815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:37.504815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:37.504815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:37.504815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:37.504815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:37.504815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:37.504815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:37.504815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:37.504815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:37.504815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:37.504815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:37.505809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:37.505809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:37.505809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:37.505809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:37.505809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:37.505809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:37.505809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:37.505809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:37.505809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:37.505809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:37.505809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:37.505809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:37.505809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:37.505809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:37.505809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:37.505809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:37.506577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:37.506577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:37.506577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:37.506577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:37.506577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:37.506577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:37.506577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:37.506577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:37.506577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:37.506577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:37.506577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:44:37.506577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:44:37.506577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 35/66] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:37.506577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ec0a6-406c-4ee9-a743-a4d62cb95c0e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:37.507267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ec0a6-406c-4ee9-a743-a4d62cb95c0e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:37.507267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ec0a6-406c-4ee9-a743-a4d62cb95c0e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:37.507267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 36/67] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:37.510594 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be820-5b00-4444-bfd3-b11097f5d629 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:37.511002 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be820-5b00-4444-bfd3-b11097f5d629 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:37.511404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be820-5b00-4444-bfd3-b11097f5d629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:37.512097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45513e7f-aabc-4a4c-b164-45faa28379c7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:37.539143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-221be820-5b00-4444-bfd3-b11097f5d629 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:37.540664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-221be820-5b00-4444-bfd3-b11097f5d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:37.619715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 37/68] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:37.620914 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221be820-5b00-4444-bfd3-b11097f5d629 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:37.645983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45513e7f-aabc-4a4c-b164-45faa28379c7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:37.684223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7f234-49ea-41c5-ad56-907a742eb468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:37.684904 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7f234-49ea-41c5-ad56-907a742eb468 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:37.685252 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7f234-49ea-41c5-ad56-907a742eb468 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:37.685544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7f234-49ea-41c5-ad56-907a742eb468 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:37.686300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7f234-49ea-41c5-ad56-907a742eb468 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:37.686615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7f234-49ea-41c5-ad56-907a742eb468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:37.688058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7f234-49ea-41c5-ad56-907a742eb468 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:37.697556 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 32/69] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:44:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:37.697968 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:37.698819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94e5cf-2b63-4115-a12b-8f93df27c33e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:37.699119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94e5cf-2b63-4115-a12b-8f93df27c33e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:37.699405 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94e5cf-2b63-4115-a12b-8f93df27c33e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:37.700857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 33/70] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:37.705175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94e5cf-2b63-4115-a12b-8f93df27c33e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:37.739485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221be820-5b00-4444-bfd3-b11097f5d629 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:37.740894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:37.776998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4938101-99b0-4362-9514-87ff5cd186f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:37.777804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4938101-99b0-4362-9514-87ff5cd186f1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:37.778094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4938101-99b0-4362-9514-87ff5cd186f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:37.778376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4938101-99b0-4362-9514-87ff5cd186f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:37.788506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4938101-99b0-4362-9514-87ff5cd186f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:37.796726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b4938101-99b0-4362-9514-87ff5cd186f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:44:37.796726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:37.796726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:37.796726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:37.796726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:37.796726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:37.796726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:37.796726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:37.796726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:37.796726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:37.796726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:37.796726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:37.796726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:37.796726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:37.796726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:37.796726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:37.797581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:37.797581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:37.797581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:37.797581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:37.797581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:37.797581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:37.797581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:37.797581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:37.797581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:37.797581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:37.797581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:37.797581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:37.797581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:37.797581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:37.797581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:37.797581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:37.803224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:37.803224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:37.803224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:37.803224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:37.803224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:37.803224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:37.803224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:37.803224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:37.803224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:37.803224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:37.803224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:44:37.803224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:44:37.803224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 38/71] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:44:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:37.803224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4938101-99b0-4362-9514-87ff5cd186f1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:37.830492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94e5cf-2b63-4115-a12b-8f93df27c33e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:37.866548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f59c6a-2b9b-4c7d-b8a7-d438c73f4b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:37.867878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f59c6a-2b9b-4c7d-b8a7-d438c73f4b66 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:37.868162 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f59c6a-2b9b-4c7d-b8a7-d438c73f4b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:37.868448 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f59c6a-2b9b-4c7d-b8a7-d438c73f4b66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:37.879702 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f59c6a-2b9b-4c7d-b8a7-d438c73f4b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:37.888373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-17f59c6a-2b9b-4c7d-b8a7-d438c73f4b66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:44:37.888373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:37.888373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:37.888373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:37.888373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:37.888373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:37.888373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:37.888373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:37.888373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:37.888373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:37.888373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:37.888373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:37.888373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:37.888373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:37.888373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:37.888373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:37.889231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:37.889231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:37.889231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:37.889231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:37.889231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:37.889231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:37.889231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:37.889231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:37.889231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:37.889231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:37.889231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:37.889231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:37.889231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:37.889231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:37.889231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:37.889231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:37.890116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:37.890116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:37.890116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:37.890116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:37.890116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:37.890116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:37.890116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:37.890116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:37.890116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:37.890116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:37.890116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:44:37.890116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:44:37.890116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 34/72] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:44:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:37.890940 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af7443-94c7-4823-b8c7-8fe19274c1c4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:37.891036 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af7443-94c7-4823-b8c7-8fe19274c1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:37.891322 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af7443-94c7-4823-b8c7-8fe19274c1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:37.906255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4938101-99b0-4362-9514-87ff5cd186f1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:37.907701 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-06af7443-94c7-4823-b8c7-8fe19274c1c4 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:37.908993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-06af7443-94c7-4823-b8c7-8fe19274c1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:37.928687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:37.939542 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff428afd-739b-4821-8ca0-db282c6c0910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:37.940715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428afd-739b-4821-8ca0-db282c6c0910 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:37.941158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428afd-739b-4821-8ca0-db282c6c0910 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:37.941437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428afd-739b-4821-8ca0-db282c6c0910 None admin] PATH_INFO: `/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:37.956253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff428afd-739b-4821-8ca0-db282c6c0910 None admin] RBAC: Authorizing `identity:get_user(user_id=85d51d7f1b3d4b0886d5e89e243c87c9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:37.957711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff428afd-739b-4821-8ca0-db282c6c0910 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:37.959700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 39/73] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:37 2022] GET /identity/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:37.960718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff428afd-739b-4821-8ca0-db282c6c0910 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:37.974418 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 35/74] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:37.975641 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02622690-a9a3-429c-ace7-45a0231f993e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:37.975942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02622690-a9a3-429c-ace7-45a0231f993e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:37.976257 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02622690-a9a3-429c-ace7-45a0231f993e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:37.977558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 36/75] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:37.978267 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02622690-a9a3-429c-ace7-45a0231f993e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:37.996435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:38.078966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff428afd-739b-4821-8ca0-db282c6c0910 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:38.079586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02622690-a9a3-429c-ace7-45a0231f993e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:38.111737 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d130c6b-dfef-4725-86d6-88b9c8d711ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:38.112421 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d130c6b-dfef-4725-86d6-88b9c8d711ac None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:38.112713 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d130c6b-dfef-4725-86d6-88b9c8d711ac None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:38.112806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe612df-a76e-4ebb-a8c7-35b3a34f36ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:38.112996 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d130c6b-dfef-4725-86d6-88b9c8d711ac None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:38.113424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe612df-a76e-4ebb-a8c7-35b3a34f36ed None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:38.113714 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe612df-a76e-4ebb-a8c7-35b3a34f36ed None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:38.113798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d130c6b-dfef-4725-86d6-88b9c8d711ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:38.113996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe612df-a76e-4ebb-a8c7-35b3a34f36ed None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:38.114084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d130c6b-dfef-4725-86d6-88b9c8d711ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:38.114741 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe612df-a76e-4ebb-a8c7-35b3a34f36ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:38.115306 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe612df-a76e-4ebb-a8c7-35b3a34f36ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:38.115660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d130c6b-dfef-4725-86d6-88b9c8d711ac None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:38.116718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe612df-a76e-4ebb-a8c7-35b3a34f36ed None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:38.124597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 40/76] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:38.129328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 37/77] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:44:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:38.129328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63980fe9-0a7c-4778-b50b-125fd575b78b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:38.129328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63980fe9-0a7c-4778-b50b-125fd575b78b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:38.129328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63980fe9-0a7c-4778-b50b-125fd575b78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:38.129993 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d130c6b-dfef-4725-86d6-88b9c8d711ac None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:38.143270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-63980fe9-0a7c-4778-b50b-125fd575b78b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:38.144511 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-63980fe9-0a7c-4778-b50b-125fd575b78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:38.174574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:38.209006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 38/78] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:38.209933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63980fe9-0a7c-4778-b50b-125fd575b78b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:38.219910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:38.239634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d130c6b-dfef-4725-86d6-88b9c8d711ac None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:38.273106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a87378-5619-4ff7-bd97-8e2110f43657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:38.274432 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a87378-5619-4ff7-bd97-8e2110f43657 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:38.274730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a87378-5619-4ff7-bd97-8e2110f43657 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:38.275015 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a87378-5619-4ff7-bd97-8e2110f43657 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:38.308551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63980fe9-0a7c-4778-b50b-125fd575b78b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:38.340579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a87378-5619-4ff7-bd97-8e2110f43657 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:38.340817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d9655-d858-457c-a250-442ed71567e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:38.341609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d9655-d858-457c-a250-442ed71567e5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:38.341894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d9655-d858-457c-a250-442ed71567e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:38.342062 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a87378-5619-4ff7-bd97-8e2110f43657 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:38.342173 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d9655-d858-457c-a250-442ed71567e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:38.355339 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d9655-d858-457c-a250-442ed71567e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:38.363713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6f0d9655-d858-457c-a250-442ed71567e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:44:38.363713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:38.363713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:38.363713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:38.363713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:38.363713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:38.363713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:38.363713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:38.363713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:38.363713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:38.363713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:38.363713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:38.363713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:38.363713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:38.363713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:38.363713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:38.364605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:38.364605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:38.364605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:38.364605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:38.364605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:38.364605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:38.364605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:38.364605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:38.364605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:38.364605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:38.364605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:38.364605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:38.364605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:38.364605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:38.364605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:38.364605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:38.365645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:38.365645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:38.365645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:38.365645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:38.365645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:38.365645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:38.365645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:38.365645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:38.365645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:38.365645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:38.365645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:44:38.365645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:44:38.365645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 39/79] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:38.365645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d9655-d858-457c-a250-442ed71567e5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:38.389486 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:38.434867 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:38.443300 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 41/80] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:44:38.444252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a87378-5619-4ff7-bd97-8e2110f43657 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:38.469997 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d9655-d858-457c-a250-442ed71567e5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:38.502879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbdb78-cb19-4729-8566-0f80a684ecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:38.503744 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbdb78-cb19-4729-8566-0f80a684ecfd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:38.504060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbdb78-cb19-4729-8566-0f80a684ecfd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:38.504348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbdb78-cb19-4729-8566-0f80a684ecfd None admin] PATH_INFO: `/v3/users/1c6d5baab170407ca73cb1da472cac82` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:38.505536 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbdb78-cb19-4729-8566-0f80a684ecfd None admin] RBAC: Authorizing `identity:get_user(user_id=1c6d5baab170407ca73cb1da472cac82)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:38.507025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbdb78-cb19-4729-8566-0f80a684ecfd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:38.509231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 40/81] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:38 2022] GET /identity/v3/users/1c6d5baab170407ca73cb1da472cac82 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:38.510002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbdb78-cb19-4729-8566-0f80a684ecfd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:38.543839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a87378-5619-4ff7-bd97-8e2110f43657 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:38.576151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf9aa7-5c87-4354-9598-5ec9fad42663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:38.577019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf9aa7-5c87-4354-9598-5ec9fad42663 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:38.577310 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf9aa7-5c87-4354-9598-5ec9fad42663 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:38.577592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf9aa7-5c87-4354-9598-5ec9fad42663 None admin] PATH_INFO: `/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:38.578780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf9aa7-5c87-4354-9598-5ec9fad42663 None admin] RBAC: Authorizing `identity:get_user(user_id=85d51d7f1b3d4b0886d5e89e243c87c9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:38.580249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf9aa7-5c87-4354-9598-5ec9fad42663 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:38.581866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 42/82] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:38 2022] GET /identity/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:38.582627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf9aa7-5c87-4354-9598-5ec9fad42663 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:38.596174 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:38.609005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbdb78-cb19-4729-8566-0f80a684ecfd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:38.642003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f49590-1e2f-45cc-8b6d-e10a9448f50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:38.642732 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f49590-1e2f-45cc-8b6d-e10a9448f50b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:38.643025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f49590-1e2f-45cc-8b6d-e10a9448f50b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:38.643310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f49590-1e2f-45cc-8b6d-e10a9448f50b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:38.644504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f49590-1e2f-45cc-8b6d-e10a9448f50b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:38.645956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f49590-1e2f-45cc-8b6d-e10a9448f50b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:38.647557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 41/83] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:44:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:38.652770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f49590-1e2f-45cc-8b6d-e10a9448f50b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:38.656205 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:38.678981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf9aa7-5c87-4354-9598-5ec9fad42663 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:38.711871 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521629fb-c563-4f92-bbc2-c0d6d214959b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:38.712564 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521629fb-c563-4f92-bbc2-c0d6d214959b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:38.712849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521629fb-c563-4f92-bbc2-c0d6d214959b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:38.713129 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521629fb-c563-4f92-bbc2-c0d6d214959b None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:38.713863 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521629fb-c563-4f92-bbc2-c0d6d214959b None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:38.714172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521629fb-c563-4f92-bbc2-c0d6d214959b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:38.715557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521629fb-c563-4f92-bbc2-c0d6d214959b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:38.723453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 43/84] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:44:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:38.724266 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521629fb-c563-4f92-bbc2-c0d6d214959b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:38.749692 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f49590-1e2f-45cc-8b6d-e10a9448f50b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:38.782440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1227a-5e49-470a-94b3-2f2c5174c9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:38.783297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1227a-5e49-470a-94b3-2f2c5174c9fa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:38.783586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1227a-5e49-470a-94b3-2f2c5174c9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:38.783866 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1227a-5e49-470a-94b3-2f2c5174c9fa None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:38.785066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1227a-5e49-470a-94b3-2f2c5174c9fa None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:38.786529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1227a-5e49-470a-94b3-2f2c5174c9fa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:38.788232 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 42/85] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:38 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:38.789588 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1227a-5e49-470a-94b3-2f2c5174c9fa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:38.800014 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:38.824502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521629fb-c563-4f92-bbc2-c0d6d214959b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:38.856351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:38.857643 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4e975-291d-49ce-b293-f2a7588b9502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:38.858264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4e975-291d-49ce-b293-f2a7588b9502 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:38.858552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4e975-291d-49ce-b293-f2a7588b9502 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:38.858839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4e975-291d-49ce-b293-f2a7588b9502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:38.889227 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1227a-5e49-470a-94b3-2f2c5174c9fa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:38.924059 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f00700-aed9-4fc7-aa57-ae799a4b7455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:38.924638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f00700-aed9-4fc7-aa57-ae799a4b7455 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:38.924930 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f00700-aed9-4fc7-aa57-ae799a4b7455 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:38.925217 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f00700-aed9-4fc7-aa57-ae799a4b7455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:38.925307 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4e975-291d-49ce-b293-f2a7588b9502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:38.926728 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4e975-291d-49ce-b293-f2a7588b9502 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:38.991661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f00700-aed9-4fc7-aa57-ae799a4b7455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:38.993727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f00700-aed9-4fc7-aa57-ae799a4b7455 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:38.998665 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:39.023795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 44/86] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:44:39.023795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4e975-291d-49ce-b293-f2a7588b9502 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:39.063006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:39.092461 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 43/87] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:44:39.093297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f00700-aed9-4fc7-aa57-ae799a4b7455 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:39.125858 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4e975-291d-49ce-b293-f2a7588b9502 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:39.159407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8e15a-634a-4b81-b632-0cec243d2f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:39.160094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8e15a-634a-4b81-b632-0cec243d2f56 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:39.160388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8e15a-634a-4b81-b632-0cec243d2f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:39.160669 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8e15a-634a-4b81-b632-0cec243d2f56 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:39.161380 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8e15a-634a-4b81-b632-0cec243d2f56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:39.162830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8e15a-634a-4b81-b632-0cec243d2f56 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:39.188218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f00700-aed9-4fc7-aa57-ae799a4b7455 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:39.221607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a6f0c-548a-4f45-8f2e-b53c73dcb64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:39.223661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a6f0c-548a-4f45-8f2e-b53c73dcb64e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:39.223661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a6f0c-548a-4f45-8f2e-b53c73dcb64e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:39.223661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a6f0c-548a-4f45-8f2e-b53c73dcb64e None admin] PATH_INFO: `/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:39.224285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a6f0c-548a-4f45-8f2e-b53c73dcb64e None admin] RBAC: Authorizing `identity:get_user(user_id=85d51d7f1b3d4b0886d5e89e243c87c9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:39.225753 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a6f0c-548a-4f45-8f2e-b53c73dcb64e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:39.228163 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 44/88] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:39 2022] GET /identity/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:39.228943 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a6f0c-548a-4f45-8f2e-b53c73dcb64e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:39.246295 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 45/89] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:44:39 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:44:39.247160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8e15a-634a-4b81-b632-0cec243d2f56 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:39.279402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:39.281436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:39.344650 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a6f0c-548a-4f45-8f2e-b53c73dcb64e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:39.362281 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8e15a-634a-4b81-b632-0cec243d2f56 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:39.385246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf589b7-9cd3-4b3b-a4cc-7703e26ae3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:39.385929 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf589b7-9cd3-4b3b-a4cc-7703e26ae3cf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:39.386218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf589b7-9cd3-4b3b-a4cc-7703e26ae3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:39.386508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf589b7-9cd3-4b3b-a4cc-7703e26ae3cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:39.387360 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf589b7-9cd3-4b3b-a4cc-7703e26ae3cf None admin] RBAC: Adding query filter params (role.id=6cae5979d0aa4dcca6467a7ba544d4b1, scope.project.id=eb120c9c3572435a8113ca1e458046c4, user.id=85d51d7f1b3d4b0886d5e89e243c87c9) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:39.387684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf589b7-9cd3-4b3b-a4cc-7703e26ae3cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:39.389222 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf589b7-9cd3-4b3b-a4cc-7703e26ae3cf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:39.395554 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 45/90] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:44:39 2022] GET /identity/v3/role_assignments?user.id=85d51d7f1b3d4b0886d5e89e243c87c9&scope.project.id=eb120c9c3572435a8113ca1e458046c4&role.id=6cae5979d0aa4dcca6467a7ba544d4b1 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:39.396276 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf589b7-9cd3-4b3b-a4cc-7703e26ae3cf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:39.407731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d416782-3c9c-4d20-98fd-d40e03417179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:39.410284 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d416782-3c9c-4d20-98fd-d40e03417179 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:39.410936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d416782-3c9c-4d20-98fd-d40e03417179 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:39.411438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d416782-3c9c-4d20-98fd-d40e03417179 None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:39.413215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d416782-3c9c-4d20-98fd-d40e03417179 None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:39.416826 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d416782-3c9c-4d20-98fd-d40e03417179 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:39.419834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 46/91] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:39 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:39.426503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d416782-3c9c-4d20-98fd-d40e03417179 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:39.541240 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf589b7-9cd3-4b3b-a4cc-7703e26ae3cf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:39.544033 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:39.574287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:39.578556 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d416782-3c9c-4d20-98fd-d40e03417179 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:39.596509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98776fe2-60db-4829-a5bd-b44760051940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:39.597407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98776fe2-60db-4829-a5bd-b44760051940 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:39.597703 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98776fe2-60db-4829-a5bd-b44760051940 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:39.597995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98776fe2-60db-4829-a5bd-b44760051940 None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:39.600028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98776fe2-60db-4829-a5bd-b44760051940 None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:39.600861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98776fe2-60db-4829-a5bd-b44760051940 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:39.603315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 46/92] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:39 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:39.603921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98776fe2-60db-4829-a5bd-b44760051940 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:39.622060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a0838-162f-4e0f-9733-6d3f881f2415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:39.622860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a0838-162f-4e0f-9733-6d3f881f2415 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:39.623155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a0838-162f-4e0f-9733-6d3f881f2415 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:39.623438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a0838-162f-4e0f-9733-6d3f881f2415 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:39.722167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a0838-162f-4e0f-9733-6d3f881f2415 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:39.724560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a0838-162f-4e0f-9733-6d3f881f2415 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:39.747695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98776fe2-60db-4829-a5bd-b44760051940 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:39.792693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61816263-7bf5-4cf3-a4d2-749634fcfba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:39.793282 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61816263-7bf5-4cf3-a4d2-749634fcfba3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:39.793850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61816263-7bf5-4cf3-a4d2-749634fcfba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:39.794141 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61816263-7bf5-4cf3-a4d2-749634fcfba3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:39.795249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61816263-7bf5-4cf3-a4d2-749634fcfba3 None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=eb120c9c3572435a8113ca1e458046c4, user.id=1c6d5baab170407ca73cb1da472cac82) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:39.796006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61816263-7bf5-4cf3-a4d2-749634fcfba3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:39.797997 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61816263-7bf5-4cf3-a4d2-749634fcfba3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:39.806288 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 47/93] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:44:39 2022] GET /identity/v3/role_assignments?user.id=1c6d5baab170407ca73cb1da472cac82&scope.project.id=eb120c9c3572435a8113ca1e458046c4&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:39.808848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61816263-7bf5-4cf3-a4d2-749634fcfba3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:39.875384 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:39.879087 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:39.880668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 47/94] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:44:39.886459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a0838-162f-4e0f-9733-6d3f881f2415 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:39.949545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61816263-7bf5-4cf3-a4d2-749634fcfba3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:39.987919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d48000-0289-48fe-b07a-46553a8f9677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:39.988633 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48000-0289-48fe-b07a-46553a8f9677 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:39.988929 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48000-0289-48fe-b07a-46553a8f9677 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:39.989218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d48000-0289-48fe-b07a-46553a8f9677 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:39.990322 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d48000-0289-48fe-b07a-46553a8f9677 None admin] RBAC: Adding query filter params (role.id=f9b113934dbd49218d427f6cacaabf8f, scope.project.id=eb120c9c3572435a8113ca1e458046c4, user.id=85d51d7f1b3d4b0886d5e89e243c87c9) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:39.990655 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d48000-0289-48fe-b07a-46553a8f9677 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:39.992228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d48000-0289-48fe-b07a-46553a8f9677 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:39.998522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 48/95] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:44:39 2022] GET /identity/v3/role_assignments?user.id=85d51d7f1b3d4b0886d5e89e243c87c9&scope.project.id=eb120c9c3572435a8113ca1e458046c4&role.id=f9b113934dbd49218d427f6cacaabf8f => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:40.022946 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a0838-162f-4e0f-9733-6d3f881f2415 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:40.116751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c19cf9-5cc2-41f8-9932-6888306f9adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:40.117723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c19cf9-5cc2-41f8-9932-6888306f9adf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:40.118018 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c19cf9-5cc2-41f8-9932-6888306f9adf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:40.118304 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c19cf9-5cc2-41f8-9932-6888306f9adf None admin] PATH_INFO: `/v3/projects/22ff581175ca44618b73c0d9f5425097` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:40.119719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c19cf9-5cc2-41f8-9932-6888306f9adf None admin] RBAC: Authorizing `identity:get_project(project_id=22ff581175ca44618b73c0d9f5425097)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:40.121319 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c19cf9-5cc2-41f8-9932-6888306f9adf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:40.123316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 48/96] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:39 2022] GET /identity/v3/projects/22ff581175ca44618b73c0d9f5425097 => generated 312 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:40.129057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d48000-0289-48fe-b07a-46553a8f9677 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:40.262076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:40.268577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d48000-0289-48fe-b07a-46553a8f9677 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:40.315494 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab85b9-8396-4b02-b6d9-7884a31aff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:40.316209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab85b9-8396-4b02-b6d9-7884a31aff77 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:40.316851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab85b9-8396-4b02-b6d9-7884a31aff77 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:40.317138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab85b9-8396-4b02-b6d9-7884a31aff77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:40.318043 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab85b9-8396-4b02-b6d9-7884a31aff77 None admin] RBAC: Adding query filter params (role.id=6cae5979d0aa4dcca6467a7ba544d4b1, scope.project.id=22ff581175ca44618b73c0d9f5425097, user.id=85d51d7f1b3d4b0886d5e89e243c87c9) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:40.318369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab85b9-8396-4b02-b6d9-7884a31aff77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:40.319845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab85b9-8396-4b02-b6d9-7884a31aff77 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:40.328313 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 49/97] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:44:40 2022] GET /identity/v3/role_assignments?user.id=85d51d7f1b3d4b0886d5e89e243c87c9&scope.project.id=22ff581175ca44618b73c0d9f5425097&role.id=6cae5979d0aa4dcca6467a7ba544d4b1 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:42.443868 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca26070-9190-4968-b763-3653fba8366f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:42.444902 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca26070-9190-4968-b763-3653fba8366f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:42.445913 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca26070-9190-4968-b763-3653fba8366f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:42.447755 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 49/98] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:42.453676 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989c162-80f8-4ac7-8e1c-9f7ae39a1f70 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:42.454503 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989c162-80f8-4ac7-8e1c-9f7ae39a1f70 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:42.455007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989c162-80f8-4ac7-8e1c-9f7ae39a1f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:42.476935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ab7f4-4006-4677-943d-f03aded1ad4d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:42.477556 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ab7f4-4006-4677-943d-f03aded1ad4d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:42.478099 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ab7f4-4006-4677-943d-f03aded1ad4d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:42.479676 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 50/99] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:44:42.483627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f989c162-80f8-4ac7-8e1c-9f7ae39a1f70 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:42.485085 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f989c162-80f8-4ac7-8e1c-9f7ae39a1f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:42.498253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8c99f-abef-47b4-8432-3438824f9ac0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:42.498850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8c99f-abef-47b4-8432-3438824f9ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:42.499336 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8c99f-abef-47b4-8432-3438824f9ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:42.535179 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6bd8c99f-abef-47b4-8432-3438824f9ac0 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:42.536780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6bd8c99f-abef-47b4-8432-3438824f9ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:42.603676 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 50/100] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:44:42.607239 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bbdd4-5445-46dc-96e9-0a3966bee102 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:42.607701 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bbdd4-5445-46dc-96e9-0a3966bee102 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:42.608166 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bbdd4-5445-46dc-96e9-0a3966bee102 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:42.609657 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 51/101] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:44:42.614771 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f774d-8ade-49b4-9540-8f60777a28f5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:42.615495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f774d-8ade-49b4-9540-8f60777a28f5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:42.615929 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f774d-8ade-49b4-9540-8f60777a28f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:42.649865 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8c4f774d-8ade-49b4-9540-8f60777a28f5 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:42.651496 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8c4f774d-8ade-49b4-9540-8f60777a28f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:42.685960 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:42.700396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 51/102] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:44:42.701171 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8c99f-abef-47b4-8432-3438824f9ac0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:42.727461 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 52/103] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:44:42.736861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f774d-8ade-49b4-9540-8f60777a28f5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:42.764160 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:42.845520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f774d-8ade-49b4-9540-8f60777a28f5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:42.884547 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebe2f4-8d58-492d-9dc1-f5ec186aba90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:42.886792 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8c99f-abef-47b4-8432-3438824f9ac0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:42.889429 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebe2f4-8d58-492d-9dc1-f5ec186aba90 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:42.890736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebe2f4-8d58-492d-9dc1-f5ec186aba90 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:42.891263 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebe2f4-8d58-492d-9dc1-f5ec186aba90 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:42.925379 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519e6b2-ebf1-47db-8e1d-64adf8af09fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:42.926679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519e6b2-ebf1-47db-8e1d-64adf8af09fd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:42.927196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519e6b2-ebf1-47db-8e1d-64adf8af09fd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:42.927689 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519e6b2-ebf1-47db-8e1d-64adf8af09fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:42.929309 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebe2f4-8d58-492d-9dc1-f5ec186aba90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:42.930524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519e6b2-ebf1-47db-8e1d-64adf8af09fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:42.932305 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519e6b2-ebf1-47db-8e1d-64adf8af09fd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:42.934953 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 52/104] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:44:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:42.936591 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519e6b2-ebf1-47db-8e1d-64adf8af09fd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:42.945749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-57ebe2f4-8d58-492d-9dc1-f5ec186aba90 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:44:42.945749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:42.945749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:42.945749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:42.945749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:42.945749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:42.945749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:42.945749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:42.945749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:42.945749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:42.945749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:42.945749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:42.945749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:42.945749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:42.945749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:42.945749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:42.946738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:42.946738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:42.946738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:42.946738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:42.946738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:42.946738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:42.946738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:42.946738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:42.946738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:42.946738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:42.946738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:42.946738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:42.946738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:42.946738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:42.946738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:42.946738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:42.947541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:42.947541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:42.947541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:42.947541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:42.947541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:42.947541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:42.947541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:42.947541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:42.947541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:42.947541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:42.947541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:44:42.947541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:44:42.948760 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 53/105] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:42.949449 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebe2f4-8d58-492d-9dc1-f5ec186aba90 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:43.032409 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:43.180869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519e6b2-ebf1-47db-8e1d-64adf8af09fd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:43.219936 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:43.242943 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebe2f4-8d58-492d-9dc1-f5ec186aba90 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:43.255916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56268f-3030-4fb3-940e-a89a2993f821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:43.256693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56268f-3030-4fb3-940e-a89a2993f821 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:43.256955 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56268f-3030-4fb3-940e-a89a2993f821 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:43.257293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56268f-3030-4fb3-940e-a89a2993f821 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:43.284663 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56268f-3030-4fb3-940e-a89a2993f821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:43.285558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533665b-5814-4c4b-a34f-77d6c1322e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:43.288612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533665b-5814-4c4b-a34f-77d6c1322e4e None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:43.289594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533665b-5814-4c4b-a34f-77d6c1322e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:43.289885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533665b-5814-4c4b-a34f-77d6c1322e4e None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:43.292729 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1533665b-5814-4c4b-a34f-77d6c1322e4e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:43.294337 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1533665b-5814-4c4b-a34f-77d6c1322e4e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:43.302291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5c56268f-3030-4fb3-940e-a89a2993f821 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:44:43.302291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:43.302291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:43.302291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:43.302291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:43.302291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:43.302291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:43.302291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:43.302291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:43.302291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:43.302291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:43.302291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:43.302291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:43.302291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:43.302291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:43.302291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:43.303181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:43.303181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:43.303181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:43.303181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:43.303181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:43.303181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:43.303181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:43.303181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:43.303181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:43.303181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:43.303181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:43.303181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:43.303181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:43.303181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:43.303181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:43.303181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:43.303954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:43.303954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:43.303954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:43.303954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:43.303954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:43.303954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:43.303954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:43.303954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:43.303954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:43.303954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:43.303954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:44:43.303954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:44:43.303954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 53/106] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:43.304729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56268f-3030-4fb3-940e-a89a2993f821 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:43.381552 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 54/107] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Jun 2 15:44:42 2022] POST /identity/v3/projects => generated 302 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:44:43.383308 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d612d-edaa-41dd-aab8-1ee8ea0d709c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:43.383612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d612d-edaa-41dd-aab8-1ee8ea0d709c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:43.384589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d612d-edaa-41dd-aab8-1ee8ea0d709c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:43.386323 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 55/108] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:43.387149 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d612d-edaa-41dd-aab8-1ee8ea0d709c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:43.437106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56268f-3030-4fb3-940e-a89a2993f821 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:43.465933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:43.477743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b4383-23e1-48c1-b348-6f01d46b8285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:43.479770 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b4383-23e1-48c1-b348-6f01d46b8285 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:43.479770 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b4383-23e1-48c1-b348-6f01d46b8285 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:43.479770 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b4383-23e1-48c1-b348-6f01d46b8285 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:43.479770 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b4383-23e1-48c1-b348-6f01d46b8285 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:43.480203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b4383-23e1-48c1-b348-6f01d46b8285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:43.481533 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b4383-23e1-48c1-b348-6f01d46b8285 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:43.502443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 54/109] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:44:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:43.506389 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b296f45-4240-4059-bdbc-69f85ebac1d7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:43.506692 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b296f45-4240-4059-bdbc-69f85ebac1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:43.506987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b296f45-4240-4059-bdbc-69f85ebac1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:43.525563 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3b296f45-4240-4059-bdbc-69f85ebac1d7 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:43.526808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3b296f45-4240-4059-bdbc-69f85ebac1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:43.544665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d612d-edaa-41dd-aab8-1ee8ea0d709c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:43.585549 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13306f5d-be17-4314-8cb5-7cb2e2c10962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:43.586378 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13306f5d-be17-4314-8cb5-7cb2e2c10962 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:43.586672 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13306f5d-be17-4314-8cb5-7cb2e2c10962 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:43.586955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13306f5d-be17-4314-8cb5-7cb2e2c10962 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:43.587712 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13306f5d-be17-4314-8cb5-7cb2e2c10962 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:43.588049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13306f5d-be17-4314-8cb5-7cb2e2c10962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:43.589605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13306f5d-be17-4314-8cb5-7cb2e2c10962 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:43.592607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:43.601112 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 55/110] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:43.601698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 56/111] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:44:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:43.602598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13306f5d-be17-4314-8cb5-7cb2e2c10962 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:43.609945 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257d149-3e0d-49d9-91a4-340d0693c9f8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:43.610262 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257d149-3e0d-49d9-91a4-340d0693c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:43.610530 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257d149-3e0d-49d9-91a4-340d0693c9f8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:43.612122 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 56/112] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:43 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:43.612936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257d149-3e0d-49d9-91a4-340d0693c9f8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:43.726065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13306f5d-be17-4314-8cb5-7cb2e2c10962 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:43.730616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257d149-3e0d-49d9-91a4-340d0693c9f8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:43.748743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:43.769436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7b3cb-6b69-4b46-8dce-18167d8de6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:43.770317 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7b3cb-6b69-4b46-8dce-18167d8de6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:43.770667 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7b3cb-6b69-4b46-8dce-18167d8de6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:43.770951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7b3cb-6b69-4b46-8dce-18167d8de6a0 None admin] PATH_INFO: `/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:43.772190 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7b3cb-6b69-4b46-8dce-18167d8de6a0 None admin] RBAC: Authorizing `identity:get_user(user_id=85d51d7f1b3d4b0886d5e89e243c87c9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:43.773434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bfc11-e20a-478b-a5fa-90d09c172e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:43.773787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7b3cb-6b69-4b46-8dce-18167d8de6a0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:43.774916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bfc11-e20a-478b-a5fa-90d09c172e69 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:43.775446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bfc11-e20a-478b-a5fa-90d09c172e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:43.775738 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 57/113] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:43 2022] GET /identity/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:43.776343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bfc11-e20a-478b-a5fa-90d09c172e69 None admin] PATH_INFO: `/v3/users/bf6b6a3f8c214396838d942b3e75f000` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:43.777056 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca1e36-ea4a-4213-b841-5d5e0e90c046 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:43.777355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca1e36-ea4a-4213-b841-5d5e0e90c046 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:43.777653 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca1e36-ea4a-4213-b841-5d5e0e90c046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:43.795535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-11ca1e36-ea4a-4213-b841-5d5e0e90c046 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:43.796318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bfc11-e20a-478b-a5fa-90d09c172e69 None admin] RBAC: Authorizing `identity:get_user(user_id=bf6b6a3f8c214396838d942b3e75f000)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:43.796767 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-11ca1e36-ea4a-4213-b841-5d5e0e90c046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:43.798338 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bfc11-e20a-478b-a5fa-90d09c172e69 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:43.801416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 57/114] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:43 2022] GET /identity/v3/users/bf6b6a3f8c214396838d942b3e75f000 => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:43.806065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bfc11-e20a-478b-a5fa-90d09c172e69 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:43.881988 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 58/115] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:43.883374 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca1e36-ea4a-4213-b841-5d5e0e90c046 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:43.901093 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:43.957715 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bfc11-e20a-478b-a5fa-90d09c172e69 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:43.994962 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434881a-3f3b-4ce1-a4cd-f6fd5fe1c3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:43.995234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434881a-3f3b-4ce1-a4cd-f6fd5fe1c3ab None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:43.995527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434881a-3f3b-4ce1-a4cd-f6fd5fe1c3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:43.995816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434881a-3f3b-4ce1-a4cd-f6fd5fe1c3ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:44.003027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca1e36-ea4a-4213-b841-5d5e0e90c046 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:44.006219 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434881a-3f3b-4ce1-a4cd-f6fd5fe1c3ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:44.014522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d434881a-3f3b-4ce1-a4cd-f6fd5fe1c3ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:44:44.014522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:44.014522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:44.014522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:44.014522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:44.014522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:44.014522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:44.014522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:44.014522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:44.014522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:44.014522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:44.014522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:44.014522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:44.014522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:44.014522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:44.014522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:44.015592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:44.015592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:44.015592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:44.015592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:44.015592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:44.015592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:44.015592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:44.015592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:44.015592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:44.015592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:44.015592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:44.015592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:44.015592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:44.015592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:44.015592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:44.015592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:44.016590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:44.016590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:44.016590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:44.016590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:44.016590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:44.016590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:44.016590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:44.016590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:44.016590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:44.016590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:44.016590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:44:44.016590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:44:44.016590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 58/116] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:44:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:44.016590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434881a-3f3b-4ce1-a4cd-f6fd5fe1c3ab None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:44.021371 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:44.045163 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132ade6-3368-4e0e-ad52-1005f73855c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:44.046148 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132ade6-3368-4e0e-ad52-1005f73855c2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:44.046494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132ade6-3368-4e0e-ad52-1005f73855c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:44.046836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132ade6-3368-4e0e-ad52-1005f73855c2 None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:44.048098 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132ade6-3368-4e0e-ad52-1005f73855c2 None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:44.049658 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132ade6-3368-4e0e-ad52-1005f73855c2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:44.051344 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 59/117] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:43 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:44.056616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132ade6-3368-4e0e-ad52-1005f73855c2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:44.132752 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434881a-3f3b-4ce1-a4cd-f6fd5fe1c3ab None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:44.150002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:44.161276 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132ade6-3368-4e0e-ad52-1005f73855c2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:44.168834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ec579-155a-421e-a90c-444cc0076d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:44.169504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec579-155a-421e-a90c-444cc0076d35 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:44.169795 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec579-155a-421e-a90c-444cc0076d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:44.170167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec579-155a-421e-a90c-444cc0076d35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:44.204739 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b0a36-9f2d-4217-8bbc-5c090f5d8493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:44.205636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b0a36-9f2d-4217-8bbc-5c090f5d8493 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:44.205997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b0a36-9f2d-4217-8bbc-5c090f5d8493 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:44.206380 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b0a36-9f2d-4217-8bbc-5c090f5d8493 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:44.216892 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b0a36-9f2d-4217-8bbc-5c090f5d8493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:44.224675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b72b0a36-9f2d-4217-8bbc-5c090f5d8493 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:44:44.224675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:44.224675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:44.224675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:44.224675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:44.224675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:44.224675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:44.224675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:44.224675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:44.224675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:44.224675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:44.224675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:44.224675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:44.224675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:44.224675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:44.224675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:44.225797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:44.225797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:44.225797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:44.225797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:44.225797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:44.225797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:44.225797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:44.225797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:44.225797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:44.225797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:44.225797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:44.225797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:44.225797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:44.225797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:44.225797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:44.225797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:44.226683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:44.226683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:44.226683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:44.226683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:44.226683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:44.226683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:44.226683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:44.226683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:44.226683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:44.226683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:44.226683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:44:44.226683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:44:44.226683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 60/118] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:44:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:44.232655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ac0a1-c29c-48cc-9ece-df64bb9f4786 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:44.232958 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ac0a1-c29c-48cc-9ece-df64bb9f4786 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:44.233253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ac0a1-c29c-48cc-9ece-df64bb9f4786 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:44.234724 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 61/119] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:44.235309 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ac0a1-c29c-48cc-9ece-df64bb9f4786 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:44.244604 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ec579-155a-421e-a90c-444cc0076d35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:44.246150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ec579-155a-421e-a90c-444cc0076d35 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:44.286755 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:44.344531 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ac0a1-c29c-48cc-9ece-df64bb9f4786 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:44.355235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 59/120] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:44:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:44:44.355235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ec579-155a-421e-a90c-444cc0076d35 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:44.375910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:44.387490 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920e9a4-d9f9-41a0-9515-ae6f3cc3ea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:44.388201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920e9a4-d9f9-41a0-9515-ae6f3cc3ea3e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:44.388493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920e9a4-d9f9-41a0-9515-ae6f3cc3ea3e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:44.391692 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920e9a4-d9f9-41a0-9515-ae6f3cc3ea3e None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:44.391692 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920e9a4-d9f9-41a0-9515-ae6f3cc3ea3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:44.391692 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920e9a4-d9f9-41a0-9515-ae6f3cc3ea3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:44.391692 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920e9a4-d9f9-41a0-9515-ae6f3cc3ea3e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:44.400159 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 62/121] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:44:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:44.400983 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920e9a4-d9f9-41a0-9515-ae6f3cc3ea3e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:44.470597 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ec579-155a-421e-a90c-444cc0076d35 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:44.506848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169441c5-bf4f-4839-a8d0-cf36b9ea5b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:44.508239 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169441c5-bf4f-4839-a8d0-cf36b9ea5b12 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:44.508646 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169441c5-bf4f-4839-a8d0-cf36b9ea5b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:44.508911 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169441c5-bf4f-4839-a8d0-cf36b9ea5b12 None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4/users/85d51d7f1b3d4b0886d5e89e243c87c9/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:44.510729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920e9a4-d9f9-41a0-9515-ae6f3cc3ea3e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:44.511158 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169441c5-bf4f-4839-a8d0-cf36b9ea5b12 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb120c9c3572435a8113ca1e458046c4, user_id=85d51d7f1b3d4b0886d5e89e243c87c9, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:44.512291 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169441c5-bf4f-4839-a8d0-cf36b9ea5b12 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:44.513939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:44.555514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859502be-07fd-4c95-9b1e-9601d57e093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:44.556225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859502be-07fd-4c95-9b1e-9601d57e093d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:44.556516 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859502be-07fd-4c95-9b1e-9601d57e093d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:44.556798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859502be-07fd-4c95-9b1e-9601d57e093d None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:44.557545 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859502be-07fd-4c95-9b1e-9601d57e093d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:44.557948 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859502be-07fd-4c95-9b1e-9601d57e093d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:44.559330 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859502be-07fd-4c95-9b1e-9601d57e093d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:44.567763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 63/122] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:44.569434 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3890e8-394a-4be3-93f1-c7ebbf3af8f7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:44.569434 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3890e8-394a-4be3-93f1-c7ebbf3af8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:44.569434 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3890e8-394a-4be3-93f1-c7ebbf3af8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:44.585568 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 60/123] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:44:44 2022] PUT /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4/users/85d51d7f1b3d4b0886d5e89e243c87c9/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:44:44.592220 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1d3890e8-394a-4be3-93f1-c7ebbf3af8f7 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:44.592220 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1d3890e8-394a-4be3-93f1-c7ebbf3af8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:44.593399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169441c5-bf4f-4839-a8d0-cf36b9ea5b12 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:44.677447 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 64/124] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:44.678646 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3890e8-394a-4be3-93f1-c7ebbf3af8f7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:44.719134 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:44.744851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169441c5-bf4f-4839-a8d0-cf36b9ea5b12 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:44.781711 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41973cba-7e2c-445e-a64e-82506da8904b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:44.782853 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41973cba-7e2c-445e-a64e-82506da8904b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:44.783337 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41973cba-7e2c-445e-a64e-82506da8904b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:44.783827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41973cba-7e2c-445e-a64e-82506da8904b None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:44.785344 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41973cba-7e2c-445e-a64e-82506da8904b None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:44.787071 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41973cba-7e2c-445e-a64e-82506da8904b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:44.789789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 61/125] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:44 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:44.791276 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41973cba-7e2c-445e-a64e-82506da8904b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:44.813396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:44.821203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3890e8-394a-4be3-93f1-c7ebbf3af8f7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:44.863837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649dc7c7-e5c2-4037-81c7-f4dab308c716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:44.864781 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dc7c7-e5c2-4037-81c7-f4dab308c716 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:44.865066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dc7c7-e5c2-4037-81c7-f4dab308c716 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:44.865608 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dc7c7-e5c2-4037-81c7-f4dab308c716 None admin] PATH_INFO: `/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:44.866808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649dc7c7-e5c2-4037-81c7-f4dab308c716 None admin] RBAC: Authorizing `identity:get_user(user_id=85d51d7f1b3d4b0886d5e89e243c87c9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:44.870109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649dc7c7-e5c2-4037-81c7-f4dab308c716 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:44.872110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 65/126] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:44 2022] GET /identity/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:44.872642 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649dc7c7-e5c2-4037-81c7-f4dab308c716 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:44.926602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41973cba-7e2c-445e-a64e-82506da8904b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:44.972420 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d8c42-477c-4ab7-aa34-f3b739c9c50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:44.973306 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d8c42-477c-4ab7-aa34-f3b739c9c50a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:44.973604 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d8c42-477c-4ab7-aa34-f3b739c9c50a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:44.974116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d8c42-477c-4ab7-aa34-f3b739c9c50a None admin] PATH_INFO: `/v3/users/1c6d5baab170407ca73cb1da472cac82` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:44.975816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d8c42-477c-4ab7-aa34-f3b739c9c50a None admin] RBAC: Authorizing `identity:get_user(user_id=1c6d5baab170407ca73cb1da472cac82)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:44.977612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d8c42-477c-4ab7-aa34-f3b739c9c50a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:44.980090 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 62/127] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:44 2022] GET /identity/v3/users/1c6d5baab170407ca73cb1da472cac82 => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:44.980732 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d8c42-477c-4ab7-aa34-f3b739c9c50a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:44.996770 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649dc7c7-e5c2-4037-81c7-f4dab308c716 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:45.001961 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:45.035147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7ac6b-f64a-4a11-baff-dad45d72b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:45.035877 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7ac6b-f64a-4a11-baff-dad45d72b81f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:45.036252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7ac6b-f64a-4a11-baff-dad45d72b81f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:45.036537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7ac6b-f64a-4a11-baff-dad45d72b81f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:45.047942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7ac6b-f64a-4a11-baff-dad45d72b81f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:45.056596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e1e7ac6b-f64a-4a11-baff-dad45d72b81f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:44:45.056596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:45.056596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:45.056596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:45.056596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:45.056596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:45.056596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:45.056596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:45.056596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:45.056596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:45.056596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:45.056596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:45.056596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:45.056596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:45.056596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:45.056596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:45.057501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:45.057501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:45.057501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:45.057501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:45.057501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:45.057501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:45.057501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:45.057501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:45.057501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:45.057501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:45.057501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:45.057501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:45.057501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:45.057501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:45.057501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:45.057501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:45.058277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:45.058277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:45.058277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:45.058277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:45.058277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:45.058277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:45.058277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:45.058277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:45.058277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:45.058277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:45.058277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:44:45.058277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:44:45.058277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 66/128] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:45.058918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7ac6b-f64a-4a11-baff-dad45d72b81f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:45.086660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:45.123152 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d8c42-477c-4ab7-aa34-f3b739c9c50a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:45.165449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7ac6b-f64a-4a11-baff-dad45d72b81f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:45.169947 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473668c-8d6b-41a0-957a-175764bb47b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:45.170813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473668c-8d6b-41a0-957a-175764bb47b8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:45.171275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473668c-8d6b-41a0-957a-175764bb47b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:45.171749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473668c-8d6b-41a0-957a-175764bb47b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:45.172786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473668c-8d6b-41a0-957a-175764bb47b8 None admin] RBAC: Adding query filter params (role.id=acc5ad0b34094944996d5c576ed82fc9, scope.project.id=eb120c9c3572435a8113ca1e458046c4, user.id=bf6b6a3f8c214396838d942b3e75f000) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:45.173783 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473668c-8d6b-41a0-957a-175764bb47b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:45.175975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473668c-8d6b-41a0-957a-175764bb47b8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:45.184481 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 63/129] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:44:44 2022] GET /identity/v3/role_assignments?user.id=bf6b6a3f8c214396838d942b3e75f000&scope.project.id=eb120c9c3572435a8113ca1e458046c4&role.id=acc5ad0b34094944996d5c576ed82fc9 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:45.185585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473668c-8d6b-41a0-957a-175764bb47b8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:45.249588 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18280871-65f0-4396-b11e-ebff1e8abe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:45.250601 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18280871-65f0-4396-b11e-ebff1e8abe55 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:45.250967 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18280871-65f0-4396-b11e-ebff1e8abe55 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:45.251325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18280871-65f0-4396-b11e-ebff1e8abe55 None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:45.253611 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18280871-65f0-4396-b11e-ebff1e8abe55 None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:45.255088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18280871-65f0-4396-b11e-ebff1e8abe55 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:45.258258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 67/130] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:45 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:45.263759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18280871-65f0-4396-b11e-ebff1e8abe55 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:45.280069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:45.308512 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473668c-8d6b-41a0-957a-175764bb47b8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:45.347895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82f058-a7d2-4c44-9594-e554a890f12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:45.349798 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82f058-a7d2-4c44-9594-e554a890f12c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:45.350294 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82f058-a7d2-4c44-9594-e554a890f12c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:45.350785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82f058-a7d2-4c44-9594-e554a890f12c None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:45.352931 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82f058-a7d2-4c44-9594-e554a890f12c None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:45.354607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82f058-a7d2-4c44-9594-e554a890f12c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:45.356700 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 64/131] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:45 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:45.357695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82f058-a7d2-4c44-9594-e554a890f12c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:45.471644 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:45.480127 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18280871-65f0-4396-b11e-ebff1e8abe55 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:45.491810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82f058-a7d2-4c44-9594-e554a890f12c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:45.530692 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5999b7-43ac-4849-b52f-4fc39107a588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:45.533898 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5999b7-43ac-4849-b52f-4fc39107a588 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:45.534426 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5999b7-43ac-4849-b52f-4fc39107a588 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:45.534923 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5999b7-43ac-4849-b52f-4fc39107a588 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:45.536553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5999b7-43ac-4849-b52f-4fc39107a588 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:45.537236 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5999b7-43ac-4849-b52f-4fc39107a588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:45.541470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5999b7-43ac-4849-b52f-4fc39107a588 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:45.550610 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23131ee8-ee0a-4e6f-a0bb-004ee7d61102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:45.551909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23131ee8-ee0a-4e6f-a0bb-004ee7d61102 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:45.553138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23131ee8-ee0a-4e6f-a0bb-004ee7d61102 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:45.554082 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23131ee8-ee0a-4e6f-a0bb-004ee7d61102 None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4/users/85d51d7f1b3d4b0886d5e89e243c87c9/roles/f9b113934dbd49218d427f6cacaabf8f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:45.558503 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23131ee8-ee0a-4e6f-a0bb-004ee7d61102 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb120c9c3572435a8113ca1e458046c4, user_id=85d51d7f1b3d4b0886d5e89e243c87c9, role_id=f9b113934dbd49218d427f6cacaabf8f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:45.560533 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23131ee8-ee0a-4e6f-a0bb-004ee7d61102 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:45.562684 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 68/132] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:44:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:45.563720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5999b7-43ac-4849-b52f-4fc39107a588 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:45.674587 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 65/133] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:44:45 2022] PUT /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4/users/85d51d7f1b3d4b0886d5e89e243c87c9/roles/f9b113934dbd49218d427f6cacaabf8f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:44:45.676333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23131ee8-ee0a-4e6f-a0bb-004ee7d61102 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:45.699610 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5999b7-43ac-4849-b52f-4fc39107a588 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:45.708382 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:45.770367 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e25bd7-a111-494a-9950-d03d4b8bd48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:45.772204 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e25bd7-a111-494a-9950-d03d4b8bd48b None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:45.772958 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e25bd7-a111-494a-9950-d03d4b8bd48b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:45.773801 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e25bd7-a111-494a-9950-d03d4b8bd48b None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4/users/1c6d5baab170407ca73cb1da472cac82/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:45.777389 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e25bd7-a111-494a-9950-d03d4b8bd48b None admin] RBAC: Authorizing `identity:create_grant(project_id=eb120c9c3572435a8113ca1e458046c4, user_id=1c6d5baab170407ca73cb1da472cac82, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:45.780025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e25bd7-a111-494a-9950-d03d4b8bd48b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:45.840889 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23131ee8-ee0a-4e6f-a0bb-004ee7d61102 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:45.880487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f837f8-42c1-49d7-bc32-3ef351fc6174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:45.881549 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f837f8-42c1-49d7-bc32-3ef351fc6174 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:45.881936 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f837f8-42c1-49d7-bc32-3ef351fc6174 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:45.882313 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f837f8-42c1-49d7-bc32-3ef351fc6174 None admin] PATH_INFO: `/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:45.884199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f837f8-42c1-49d7-bc32-3ef351fc6174 None admin] RBAC: Authorizing `identity:get_user(user_id=85d51d7f1b3d4b0886d5e89e243c87c9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:45.886000 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f837f8-42c1-49d7-bc32-3ef351fc6174 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:45.888127 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 66/134] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:45 2022] GET /identity/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:45.889602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d5e96-dc44-41e3-a0cf-f25e188ee758 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:45.897448 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 69/135] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:44:45 2022] PUT /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4/users/1c6d5baab170407ca73cb1da472cac82/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:44:45.899202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e25bd7-a111-494a-9950-d03d4b8bd48b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:45.900449 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d5e96-dc44-41e3-a0cf-f25e188ee758 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:45.900927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d5e96-dc44-41e3-a0cf-f25e188ee758 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:45.903295 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 67/136] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:45 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:45.918076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce686d-0f37-43f6-8854-2b614c99ace3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:45.918767 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce686d-0f37-43f6-8854-2b614c99ace3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:45.919282 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce686d-0f37-43f6-8854-2b614c99ace3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:45.927847 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:45.942880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-20ce686d-0f37-43f6-8854-2b614c99ace3 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:45.944562 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-20ce686d-0f37-43f6-8854-2b614c99ace3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:46.049402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 68/137] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:46.089120 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e25bd7-a111-494a-9950-d03d4b8bd48b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:46.098208 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce686d-0f37-43f6-8854-2b614c99ace3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:46.100807 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:46.169371 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b3a6b-79cc-468d-8a7d-9ac790116132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:46.170254 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b3a6b-79cc-468d-8a7d-9ac790116132 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:46.170549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b3a6b-79cc-468d-8a7d-9ac790116132 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:46.170833 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b3a6b-79cc-468d-8a7d-9ac790116132 None admin] PATH_INFO: `/v3/projects/22ff581175ca44618b73c0d9f5425097` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:46.174799 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b3a6b-79cc-468d-8a7d-9ac790116132 None admin] RBAC: Authorizing `identity:get_project(project_id=22ff581175ca44618b73c0d9f5425097)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:46.174799 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b3a6b-79cc-468d-8a7d-9ac790116132 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:46.176357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 70/138] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:45 2022] GET /identity/v3/projects/22ff581175ca44618b73c0d9f5425097 => generated 312 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:46.185510 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b3a6b-79cc-468d-8a7d-9ac790116132 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:46.253883 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce686d-0f37-43f6-8854-2b614c99ace3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:46.285469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:46.289939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c81a28-d4e7-4489-8e78-5258ec42e094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:46.290804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c81a28-d4e7-4489-8e78-5258ec42e094 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:46.291100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c81a28-d4e7-4489-8e78-5258ec42e094 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:46.291380 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c81a28-d4e7-4489-8e78-5258ec42e094 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:46.292678 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c81a28-d4e7-4489-8e78-5258ec42e094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:46.294148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c81a28-d4e7-4489-8e78-5258ec42e094 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:46.296092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 69/139] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:44:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:46.305300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c81a28-d4e7-4489-8e78-5258ec42e094 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:46.307814 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b3a6b-79cc-468d-8a7d-9ac790116132 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:46.345184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec237022-cde7-4319-8fc8-1b6de976960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:46.346595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec237022-cde7-4319-8fc8-1b6de976960d None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:46.347081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec237022-cde7-4319-8fc8-1b6de976960d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:46.347586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec237022-cde7-4319-8fc8-1b6de976960d None admin] PATH_INFO: `/v3/projects/22ff581175ca44618b73c0d9f5425097/users/85d51d7f1b3d4b0886d5e89e243c87c9/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:46.349879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec237022-cde7-4319-8fc8-1b6de976960d None admin] RBAC: Authorizing `identity:create_grant(project_id=22ff581175ca44618b73c0d9f5425097, user_id=85d51d7f1b3d4b0886d5e89e243c87c9, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:46.352169 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec237022-cde7-4319-8fc8-1b6de976960d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:46.441402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 71/140] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:44:46 2022] PUT /identity/v3/projects/22ff581175ca44618b73c0d9f5425097/users/85d51d7f1b3d4b0886d5e89e243c87c9/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:44:46.470618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:46.582515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c81a28-d4e7-4489-8e78-5258ec42e094 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:46.678022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e64433-89b0-467d-b7a2-6a690d0209c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:46.678640 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e64433-89b0-467d-b7a2-6a690d0209c5 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:46.678923 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e64433-89b0-467d-b7a2-6a690d0209c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:46.679212 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e64433-89b0-467d-b7a2-6a690d0209c5 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:46.680006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e64433-89b0-467d-b7a2-6a690d0209c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:46.688009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e64433-89b0-467d-b7a2-6a690d0209c5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:46.834811 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 70/141] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:44:46 2022] POST /identity/v3/users => generated 283 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:44:47.824356 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612981e-1d40-4c2f-89a7-c7fe71d9eaab None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:47.824884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612981e-1d40-4c2f-89a7-c7fe71d9eaab None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:47.824960 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612981e-1d40-4c2f-89a7-c7fe71d9eaab None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:47.826559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 72/142] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:47.831400 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d7ea2-2313-4de2-97e3-6269712f2323 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:47.831786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d7ea2-2313-4de2-97e3-6269712f2323 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:47.831965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d7ea2-2313-4de2-97e3-6269712f2323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:47.857345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-415d7ea2-2313-4de2-97e3-6269712f2323 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:47.858546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-415d7ea2-2313-4de2-97e3-6269712f2323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:47.935415 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 71/143] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:47.976328 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612981e-1d40-4c2f-89a7-c7fe71d9eaab None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:48.086443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612981e-1d40-4c2f-89a7-c7fe71d9eaab None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:48.118504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d262549-b305-455d-a7a7-b3ac11f45420 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:48.118803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d262549-b305-455d-a7a7-b3ac11f45420 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:48.119066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d262549-b305-455d-a7a7-b3ac11f45420 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:48.120715 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 72/144] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:48.126006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dcf29-7adc-4acf-b021-8d3cce6e31a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:48.126861 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dcf29-7adc-4acf-b021-8d3cce6e31a1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:48.127098 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dcf29-7adc-4acf-b021-8d3cce6e31a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:48.127378 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dcf29-7adc-4acf-b021-8d3cce6e31a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:48.137734 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e4422-43ed-4f61-a3a5-eb91796e419d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:48.138022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e4422-43ed-4f61-a3a5-eb91796e419d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:48.138303 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e4422-43ed-4f61-a3a5-eb91796e419d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:48.150981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dcf29-7adc-4acf-b021-8d3cce6e31a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:48.158776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-011dcf29-7adc-4acf-b021-8d3cce6e31a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:44:48.158776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:48.158776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:48.158776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:48.158776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:48.158776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:48.158776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:48.158776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:48.158776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:48.158776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:48.158776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:48.158776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:48.158776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:48.158776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:48.158776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:48.158776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:48.161253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:48.161253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:48.161253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:48.161253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:48.161253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:48.161253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:48.161253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:48.161253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:48.161253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:48.161253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:48.161253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:48.161253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:48.161253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:48.161253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:48.161253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:48.161253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:48.163128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:48.163128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:48.163128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:48.163128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:48.163128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:48.163128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:48.163128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:48.163128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:48.163128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:48.163128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:48.163128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:44:48.163128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:44:48.163128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 73/145] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:48.165164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-249e4422-43ed-4f61-a3a5-eb91796e419d None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:48.165164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-249e4422-43ed-4f61-a3a5-eb91796e419d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:48.166163 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dcf29-7adc-4acf-b021-8d3cce6e31a1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:48.172448 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:48.259699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:48.282442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 73/146] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:44:48.323221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e4422-43ed-4f61-a3a5-eb91796e419d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:48.359530 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dcf29-7adc-4acf-b021-8d3cce6e31a1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:48.429456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0faf01-7fbe-4768-81cf-2949b477d094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:48.430165 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0faf01-7fbe-4768-81cf-2949b477d094 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:48.430856 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0faf01-7fbe-4768-81cf-2949b477d094 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:48.430856 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0faf01-7fbe-4768-81cf-2949b477d094 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:48.431605 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0faf01-7fbe-4768-81cf-2949b477d094 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:48.431928 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0faf01-7fbe-4768-81cf-2949b477d094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:48.433390 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0faf01-7fbe-4768-81cf-2949b477d094 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:48.453402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 74/147] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:44:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:48.458896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0faf01-7fbe-4768-81cf-2949b477d094 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:48.490002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e4422-43ed-4f61-a3a5-eb91796e419d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:48.543455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3dcd-1b02-4232-907c-852254693a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:48.544676 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3dcd-1b02-4232-907c-852254693a54 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:48.545169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3dcd-1b02-4232-907c-852254693a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:48.545649 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3dcd-1b02-4232-907c-852254693a54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:48.559835 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:48.562792 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a3dcd-1b02-4232-907c-852254693a54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:48.577466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3b1a3dcd-1b02-4232-907c-852254693a54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:44:48.577466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:48.577466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:48.577466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:48.577466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:48.577466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:48.577466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:48.577466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:48.577466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:48.577466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:48.577466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:48.577466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:48.577466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:48.577466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:48.577466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:48.577466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:48.579256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:48.579256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:48.579256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:48.579256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:48.579256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:48.579256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:48.579256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:48.579256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:48.579256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:48.579256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:48.579256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:48.579256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:48.579256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:48.579256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:48.579256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:48.579256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:48.580077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:48.580077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:48.580077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:48.580077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:48.580077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:48.580077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:48.580077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:48.580077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:48.580077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:48.580077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:48.580077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:44:48.580077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:44:48.580077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 74/148] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:48.584610 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3dcd-1b02-4232-907c-852254693a54 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:48.639183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0faf01-7fbe-4768-81cf-2949b477d094 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:48.656002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:48.683798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67281117-bb44-4078-8ddd-d3e8e560cd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:48.685143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67281117-bb44-4078-8ddd-d3e8e560cd09 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:48.687896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67281117-bb44-4078-8ddd-d3e8e560cd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:48.692433 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67281117-bb44-4078-8ddd-d3e8e560cd09 None admin] PATH_INFO: `/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:48.694923 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67281117-bb44-4078-8ddd-d3e8e560cd09 None admin] RBAC: Authorizing `identity:get_user(user_id=85d51d7f1b3d4b0886d5e89e243c87c9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:48.697144 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67281117-bb44-4078-8ddd-d3e8e560cd09 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:48.700029 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 75/149] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:48 2022] GET /identity/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:48.720882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67281117-bb44-4078-8ddd-d3e8e560cd09 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:48.764906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3dcd-1b02-4232-907c-852254693a54 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:48.856806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2a7fe-60df-47f2-92ac-8e1665359751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:48.858193 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2a7fe-60df-47f2-92ac-8e1665359751 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:48.858476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67281117-bb44-4078-8ddd-d3e8e560cd09 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:48.859039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2a7fe-60df-47f2-92ac-8e1665359751 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:48.859461 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2a7fe-60df-47f2-92ac-8e1665359751 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:48.860401 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2a7fe-60df-47f2-92ac-8e1665359751 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:48.860864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2a7fe-60df-47f2-92ac-8e1665359751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:48.862414 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2a7fe-60df-47f2-92ac-8e1665359751 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:48.878196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 75/150] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:44:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:48.883970 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2a7fe-60df-47f2-92ac-8e1665359751 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:48.896746 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:48.907176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752245d4-a852-4f95-abc9-bb42a0123a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:48.908009 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752245d4-a852-4f95-abc9-bb42a0123a14 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:48.908312 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752245d4-a852-4f95-abc9-bb42a0123a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:48.908600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752245d4-a852-4f95-abc9-bb42a0123a14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:48.997578 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752245d4-a852-4f95-abc9-bb42a0123a14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:48.999289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752245d4-a852-4f95-abc9-bb42a0123a14 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:49.037870 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2a7fe-60df-47f2-92ac-8e1665359751 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:49.047547 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:49.083926 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798b18b-ed00-4335-b36e-375b06bbaf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:49.085201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798b18b-ed00-4335-b36e-375b06bbaf45 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:49.085863 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798b18b-ed00-4335-b36e-375b06bbaf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:49.086436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798b18b-ed00-4335-b36e-375b06bbaf45 None admin] PATH_INFO: `/v3/users/bf6b6a3f8c214396838d942b3e75f000` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:49.090182 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798b18b-ed00-4335-b36e-375b06bbaf45 None admin] RBAC: Authorizing `identity:get_user(user_id=bf6b6a3f8c214396838d942b3e75f000)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:49.091862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798b18b-ed00-4335-b36e-375b06bbaf45 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:49.093859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 76/151] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:48 2022] GET /identity/v3/users/bf6b6a3f8c214396838d942b3e75f000 => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:49.098979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798b18b-ed00-4335-b36e-375b06bbaf45 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:49.115672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 76/152] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:44:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 15:44:49.122678 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752245d4-a852-4f95-abc9-bb42a0123a14 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:49.161462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:49.216885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798b18b-ed00-4335-b36e-375b06bbaf45 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:49.253377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d341aba-5b69-4f24-b36e-dbd96c2bdc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:49.254244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d341aba-5b69-4f24-b36e-dbd96c2bdc6d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:49.254530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d341aba-5b69-4f24-b36e-dbd96c2bdc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:49.254808 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d341aba-5b69-4f24-b36e-dbd96c2bdc6d None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:49.260015 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d341aba-5b69-4f24-b36e-dbd96c2bdc6d None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:49.260015 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d341aba-5b69-4f24-b36e-dbd96c2bdc6d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:49.260015 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 77/153] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:49 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:49.265483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d341aba-5b69-4f24-b36e-dbd96c2bdc6d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:49.274048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752245d4-a852-4f95-abc9-bb42a0123a14 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:49.312860 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:49.331607 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145265f8-4bc3-4b77-bef9-eb2bbf7e1e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:49.333025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145265f8-4bc3-4b77-bef9-eb2bbf7e1e53 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:49.333512 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145265f8-4bc3-4b77-bef9-eb2bbf7e1e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:49.333956 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145265f8-4bc3-4b77-bef9-eb2bbf7e1e53 None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:49.340073 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145265f8-4bc3-4b77-bef9-eb2bbf7e1e53 None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:49.341676 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145265f8-4bc3-4b77-bef9-eb2bbf7e1e53 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:49.344018 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 77/154] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:49 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:49.352505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145265f8-4bc3-4b77-bef9-eb2bbf7e1e53 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:49.382467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d341aba-5b69-4f24-b36e-dbd96c2bdc6d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:49.417624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6c08a-3ed8-4c06-9dfc-08a777cf8c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:49.417990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6c08a-3ed8-4c06-9dfc-08a777cf8c83 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:49.418198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6c08a-3ed8-4c06-9dfc-08a777cf8c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:49.418479 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6c08a-3ed8-4c06-9dfc-08a777cf8c83 None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4/users/bf6b6a3f8c214396838d942b3e75f000/roles/acc5ad0b34094944996d5c576ed82fc9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:49.420549 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6c08a-3ed8-4c06-9dfc-08a777cf8c83 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb120c9c3572435a8113ca1e458046c4, user_id=bf6b6a3f8c214396838d942b3e75f000, role_id=acc5ad0b34094944996d5c576ed82fc9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:49.422057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6c08a-3ed8-4c06-9dfc-08a777cf8c83 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:49.500916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 78/155] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:44:49 2022] PUT /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4/users/bf6b6a3f8c214396838d942b3e75f000/roles/acc5ad0b34094944996d5c576ed82fc9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 15:44:49.522550 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:49.527129 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145265f8-4bc3-4b77-bef9-eb2bbf7e1e53 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:49.570511 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722ae72-8c9f-415b-a926-876fe0c09343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:49.571429 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722ae72-8c9f-415b-a926-876fe0c09343 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:49.571910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722ae72-8c9f-415b-a926-876fe0c09343 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:49.572571 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722ae72-8c9f-415b-a926-876fe0c09343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:49.573429 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722ae72-8c9f-415b-a926-876fe0c09343 None admin] RBAC: Adding query filter params (role.id=6cae5979d0aa4dcca6467a7ba544d4b1, scope.project.id=eb120c9c3572435a8113ca1e458046c4, user.id=85d51d7f1b3d4b0886d5e89e243c87c9) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:49.573752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722ae72-8c9f-415b-a926-876fe0c09343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:49.575207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722ae72-8c9f-415b-a926-876fe0c09343 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:49.587800 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 78/156] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:44:49 2022] GET /identity/v3/role_assignments?user.id=85d51d7f1b3d4b0886d5e89e243c87c9&scope.project.id=eb120c9c3572435a8113ca1e458046c4&role.id=6cae5979d0aa4dcca6467a7ba544d4b1 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:49.639642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f96b7-6dea-4fde-ba64-59ca7889d011 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:49.640053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f96b7-6dea-4fde-ba64-59ca7889d011 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:49.640237 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f96b7-6dea-4fde-ba64-59ca7889d011 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:49.641792 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 79/157] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:49.659550 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976a034-ccb3-43fc-be0b-36b126fde11d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:49.659882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976a034-ccb3-43fc-be0b-36b126fde11d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:49.660170 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976a034-ccb3-43fc-be0b-36b126fde11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:49.685233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7976a034-ccb3-43fc-be0b-36b126fde11d None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:49.686398 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7976a034-ccb3-43fc-be0b-36b126fde11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:49.766699 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 79/158] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:49.811504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f96b7-6dea-4fde-ba64-59ca7889d011 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:49.954412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f96b7-6dea-4fde-ba64-59ca7889d011 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:49.956832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:49.993251 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da17d7-4300-48e3-ab82-883877e15e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:49.994294 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da17d7-4300-48e3-ab82-883877e15e92 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:49.994587 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da17d7-4300-48e3-ab82-883877e15e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:49.995254 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da17d7-4300-48e3-ab82-883877e15e92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:50.006122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da17d7-4300-48e3-ab82-883877e15e92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:50.014540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-86da17d7-4300-48e3-ab82-883877e15e92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:44:50.014540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:50.014540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:50.014540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:50.014540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:50.014540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:50.014540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:50.014540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:50.014540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:50.014540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:50.014540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:50.014540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:50.014540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:50.014540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:50.014540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:50.014540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:50.015440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:50.015440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:50.015440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:50.015440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:50.015440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:50.015440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:50.015440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:50.015440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:50.015440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:50.015440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:50.015440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:50.015440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:50.015440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:50.015440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:50.015440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:50.015440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:50.016722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:50.016722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:50.016722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:50.016722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:50.016722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:50.016722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:50.016722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:50.016722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:50.016722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:50.016722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:50.016722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:44:50.016722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:44:50.016722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 80/159] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:44:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:50.023977 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976a034-ccb3-43fc-be0b-36b126fde11d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:50.124227 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b6eff-5fad-42f9-a39d-95617a5ee250 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:50.124567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b6eff-5fad-42f9-a39d-95617a5ee250 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:50.124795 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b6eff-5fad-42f9-a39d-95617a5ee250 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:50.126569 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 81/160] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:50.136021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae815b7e-2a7d-40d2-8c50-06a776b07865 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:50.136318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae815b7e-2a7d-40d2-8c50-06a776b07865 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:50.136594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae815b7e-2a7d-40d2-8c50-06a776b07865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:50.145829 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:50.153487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976a034-ccb3-43fc-be0b-36b126fde11d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:50.173047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ae815b7e-2a7d-40d2-8c50-06a776b07865 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:50.174259 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ae815b7e-2a7d-40d2-8c50-06a776b07865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:50.217055 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55606b-5236-4368-9bb4-faecfcbd8667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:50.218110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55606b-5236-4368-9bb4-faecfcbd8667 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:50.218621 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55606b-5236-4368-9bb4-faecfcbd8667 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:50.219105 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55606b-5236-4368-9bb4-faecfcbd8667 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:50.220132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55606b-5236-4368-9bb4-faecfcbd8667 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:50.221011 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55606b-5236-4368-9bb4-faecfcbd8667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:50.223034 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55606b-5236-4368-9bb4-faecfcbd8667 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:50.240913 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 80/161] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:50.248866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55606b-5236-4368-9bb4-faecfcbd8667 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:50.304125 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 82/162] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:50.381822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55606b-5236-4368-9bb4-faecfcbd8667 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:50.425769 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae815b7e-2a7d-40d2-8c50-06a776b07865 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:50.427052 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a3003-0e83-44cd-b465-b68299b690df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:50.428307 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a3003-0e83-44cd-b465-b68299b690df None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:50.428598 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a3003-0e83-44cd-b465-b68299b690df None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:50.428881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a3003-0e83-44cd-b465-b68299b690df None admin] PATH_INFO: `/v3/users/1c6d5baab170407ca73cb1da472cac82` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:50.430143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a3003-0e83-44cd-b465-b68299b690df None admin] RBAC: Authorizing `identity:get_user(user_id=1c6d5baab170407ca73cb1da472cac82)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:50.431634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a3003-0e83-44cd-b465-b68299b690df None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:50.434363 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 81/163] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:50 2022] GET /identity/v3/users/1c6d5baab170407ca73cb1da472cac82 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:50.440315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a3003-0e83-44cd-b465-b68299b690df None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:50.503433 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:50.626553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:50.639587 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae815b7e-2a7d-40d2-8c50-06a776b07865 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:50.675764 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a3003-0e83-44cd-b465-b68299b690df None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:50.704361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cdb06-75eb-4dd8-8c9b-8d9c7efcd490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:50.705333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cdb06-75eb-4dd8-8c9b-8d9c7efcd490 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:50.705623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cdb06-75eb-4dd8-8c9b-8d9c7efcd490 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:50.705908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cdb06-75eb-4dd8-8c9b-8d9c7efcd490 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:50.724770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cdb06-75eb-4dd8-8c9b-8d9c7efcd490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:50.741197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-076cdb06-75eb-4dd8-8c9b-8d9c7efcd490 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:44:50.741197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:50.741197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:50.741197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:50.741197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:50.741197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:50.741197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:50.741197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:50.741197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:50.741197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:50.741197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:50.741197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:50.741197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:50.741197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:50.741197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:50.741197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:50.742311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:50.742311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:50.742311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:50.742311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:50.742311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:50.742311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:50.742311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:50.742311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:50.742311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:50.742311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:50.742311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:50.742311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:50.742311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:50.742311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:50.742311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:50.742311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:50.743091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:50.743091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:50.743091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:50.743091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:50.743091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:50.743091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:50.743091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:50.743091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:50.743091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:50.743091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:50.743091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:44:50.743091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:44:50.743091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 83/164] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:44:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:44:50.750909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cdb06-75eb-4dd8-8c9b-8d9c7efcd490 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:50.768856 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b17c02-5b5d-4e19-9f66-1bd3c6660412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:50.769870 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b17c02-5b5d-4e19-9f66-1bd3c6660412 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:50.770364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b17c02-5b5d-4e19-9f66-1bd3c6660412 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:50.770846 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b17c02-5b5d-4e19-9f66-1bd3c6660412 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:50.901367 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b17c02-5b5d-4e19-9f66-1bd3c6660412 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:50.902885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b17c02-5b5d-4e19-9f66-1bd3c6660412 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:50.940565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:51.015810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cdb06-75eb-4dd8-8c9b-8d9c7efcd490 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:51.029773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 82/165] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:44:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 15:44:51.031073 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd78433-cc10-464b-8dde-fff60a9233c4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:51.031368 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd78433-cc10-464b-8dde-fff60a9233c4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:51.031654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd78433-cc10-464b-8dde-fff60a9233c4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:51.037501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 83/166] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:51.039316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd78433-cc10-464b-8dde-fff60a9233c4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:51.073105 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a9cc4-b5aa-4431-8c48-c9f0a2a1f14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:51.073810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a9cc4-b5aa-4431-8c48-c9f0a2a1f14c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:51.074098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a9cc4-b5aa-4431-8c48-c9f0a2a1f14c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:51.074380 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a9cc4-b5aa-4431-8c48-c9f0a2a1f14c None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:51.075134 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a9cc4-b5aa-4431-8c48-c9f0a2a1f14c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:51.075444 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a9cc4-b5aa-4431-8c48-c9f0a2a1f14c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:51.076873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a9cc4-b5aa-4431-8c48-c9f0a2a1f14c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:51.091782 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 84/167] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:44:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:51.097155 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f31b00-c67c-44a5-b3a7-3c69636be952 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:51.097446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f31b00-c67c-44a5-b3a7-3c69636be952 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:51.097725 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f31b00-c67c-44a5-b3a7-3c69636be952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:51.115724 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-02f31b00-c67c-44a5-b3a7-3c69636be952 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:51.117143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-02f31b00-c67c-44a5-b3a7-3c69636be952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:51.140390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:51.227696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 85/168] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:51.227696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f31b00-c67c-44a5-b3a7-3c69636be952 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:51.280695 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd78433-cc10-464b-8dde-fff60a9233c4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:51.335205 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:51.385783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3395ec-e65e-4629-93f9-9758d0f62c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:51.386662 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3395ec-e65e-4629-93f9-9758d0f62c44 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:51.386950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3395ec-e65e-4629-93f9-9758d0f62c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:51.387231 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3395ec-e65e-4629-93f9-9758d0f62c44 None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:51.388454 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3395ec-e65e-4629-93f9-9758d0f62c44 None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:51.389977 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3395ec-e65e-4629-93f9-9758d0f62c44 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:51.391979 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 84/169] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:51 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:51.400776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3395ec-e65e-4629-93f9-9758d0f62c44 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:51.406304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f31b00-c67c-44a5-b3a7-3c69636be952 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:51.490263 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2af344-5365-48b4-bb31-b55b5c915f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:51.491410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2af344-5365-48b4-bb31-b55b5c915f4c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:51.491701 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2af344-5365-48b4-bb31-b55b5c915f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:51.492076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2af344-5365-48b4-bb31-b55b5c915f4c None admin] PATH_INFO: `/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:51.496722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2af344-5365-48b4-bb31-b55b5c915f4c None admin] RBAC: Authorizing `identity:get_user(user_id=85d51d7f1b3d4b0886d5e89e243c87c9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:51.498294 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2af344-5365-48b4-bb31-b55b5c915f4c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:51.500186 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 86/170] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:51 2022] GET /identity/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9 => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:51.500744 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2af344-5365-48b4-bb31-b55b5c915f4c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:51.533323 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:51.579656 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3395ec-e65e-4629-93f9-9758d0f62c44 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:51.645333 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f9261-c4e5-4b03-a5d7-01fda6f181dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:51.646182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f9261-c4e5-4b03-a5d7-01fda6f181dc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:51.646521 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f9261-c4e5-4b03-a5d7-01fda6f181dc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:51.646805 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f9261-c4e5-4b03-a5d7-01fda6f181dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:51.671212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f9261-c4e5-4b03-a5d7-01fda6f181dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:51.675093 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2af344-5365-48b4-bb31-b55b5c915f4c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:51.679051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-db4f9261-c4e5-4b03-a5d7-01fda6f181dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:44:51.679051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:51.679051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:51.679051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:51.679051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:51.679051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:51.679051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:51.679051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:51.679051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:51.679051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:51.679051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:51.679051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:51.679051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:51.679051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:51.679051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:51.679051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:51.680493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:51.680493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:51.680493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:51.680493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:51.680493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:51.680493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:51.680493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:51.680493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:51.680493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:51.680493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:51.680493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:51.680493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:51.680493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:51.680493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:51.680493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:51.680493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:51.681289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:51.681289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:51.681289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:51.681289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:51.681289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:51.681289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:51.681289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:51.681289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:51.681289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:51.681289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:51.681289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:44:51.681289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:44:51.689084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 85/171] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:51.689945 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f9261-c4e5-4b03-a5d7-01fda6f181dc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:51.730864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6d58e-d8d0-4697-88b5-1b6fd5576a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:51.731535 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6d58e-d8d0-4697-88b5-1b6fd5576a45 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:51.731827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6d58e-d8d0-4697-88b5-1b6fd5576a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:51.732141 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6d58e-d8d0-4697-88b5-1b6fd5576a45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:51.732989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6d58e-d8d0-4697-88b5-1b6fd5576a45 None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=eb120c9c3572435a8113ca1e458046c4, user.id=1c6d5baab170407ca73cb1da472cac82) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:51.733311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6d58e-d8d0-4697-88b5-1b6fd5576a45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:51.734926 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6d58e-d8d0-4697-88b5-1b6fd5576a45 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:51.748978 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 87/172] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:44:51 2022] GET /identity/v3/role_assignments?user.id=1c6d5baab170407ca73cb1da472cac82&scope.project.id=eb120c9c3572435a8113ca1e458046c4&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:51.749626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6d58e-d8d0-4697-88b5-1b6fd5576a45 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:51.832692 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:51.900622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:51.958775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6d58e-d8d0-4697-88b5-1b6fd5576a45 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:51.976134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f9261-c4e5-4b03-a5d7-01fda6f181dc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:52.040266 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adc201-613b-4b63-97f8-aaccf9b8c2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:52.040971 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adc201-613b-4b63-97f8-aaccf9b8c2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:52.041418 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adc201-613b-4b63-97f8-aaccf9b8c2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:52.041916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adc201-613b-4b63-97f8-aaccf9b8c2c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:52.043021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adc201-613b-4b63-97f8-aaccf9b8c2c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:52.043516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adc201-613b-4b63-97f8-aaccf9b8c2c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:52.044293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb5c0b-2783-474c-84c8-0de664ee4157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:52.045076 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb5c0b-2783-474c-84c8-0de664ee4157 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:52.045443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb5c0b-2783-474c-84c8-0de664ee4157 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:52.045798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb5c0b-2783-474c-84c8-0de664ee4157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:52.052020 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22adc201-613b-4b63-97f8-aaccf9b8c2c6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:52.078353 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 88/173] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:44:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:52.080049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82639bd-4b10-49fe-9e62-0bdeb6b9d872 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:52.080542 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82639bd-4b10-49fe-9e62-0bdeb6b9d872 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:52.080986 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82639bd-4b10-49fe-9e62-0bdeb6b9d872 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:52.082514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 89/174] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:52.091080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82639bd-4b10-49fe-9e62-0bdeb6b9d872 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:52.150786 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb5c0b-2783-474c-84c8-0de664ee4157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:52.152732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb5c0b-2783-474c-84c8-0de664ee4157 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:52.212194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:52.291591 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 86/175] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:44:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:44:52.293388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e93254-42e9-4401-8c73-33dbbec85060 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:52.293837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e93254-42e9-4401-8c73-33dbbec85060 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:52.294265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e93254-42e9-4401-8c73-33dbbec85060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:52.309935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82639bd-4b10-49fe-9e62-0bdeb6b9d872 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:52.326845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-93e93254-42e9-4401-8c73-33dbbec85060 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:52.329667 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-93e93254-42e9-4401-8c73-33dbbec85060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:52.373865 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba476c7-7b82-4c0a-afa6-8b4afd85b066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:52.374819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba476c7-7b82-4c0a-afa6-8b4afd85b066 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:52.375108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba476c7-7b82-4c0a-afa6-8b4afd85b066 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:52.375439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba476c7-7b82-4c0a-afa6-8b4afd85b066 None admin] PATH_INFO: `/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:52.376876 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba476c7-7b82-4c0a-afa6-8b4afd85b066 None admin] RBAC: Authorizing `identity:get_user(user_id=85d51d7f1b3d4b0886d5e89e243c87c9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:52.378338 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba476c7-7b82-4c0a-afa6-8b4afd85b066 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:52.384534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 90/176] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:52 2022] GET /identity/v3/users/85d51d7f1b3d4b0886d5e89e243c87c9 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:52.385364 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba476c7-7b82-4c0a-afa6-8b4afd85b066 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:52.403089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:52.435958 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 87/177] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:52.437082 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e93254-42e9-4401-8c73-33dbbec85060 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:52.505116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba476c7-7b82-4c0a-afa6-8b4afd85b066 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:52.547440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed508a99-7e4b-440c-a08e-9477a1008ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:52.548613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed508a99-7e4b-440c-a08e-9477a1008ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:52.548906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed508a99-7e4b-440c-a08e-9477a1008ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:52.549188 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed508a99-7e4b-440c-a08e-9477a1008ea1 None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:52.550643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed508a99-7e4b-440c-a08e-9477a1008ea1 None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:52.552888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed508a99-7e4b-440c-a08e-9477a1008ea1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:52.559829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 91/178] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:52 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:52.559829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d5c3-7c1d-4346-8ec4-7f5e5302ddbe None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:52.559829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d5c3-7c1d-4346-8ec4-7f5e5302ddbe None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:52.559829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d5c3-7c1d-4346-8ec4-7f5e5302ddbe None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:52.559829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 92/179] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:52.559829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d5c3-7c1d-4346-8ec4-7f5e5302ddbe None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:52.578311 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:52.605445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e93254-42e9-4401-8c73-33dbbec85060 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:52.649518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e3b1b-0a1b-4ac3-a348-e403e871aba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:52.650092 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e3b1b-0a1b-4ac3-a348-e403e871aba6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:52.650378 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e3b1b-0a1b-4ac3-a348-e403e871aba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:52.650990 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e3b1b-0a1b-4ac3-a348-e403e871aba6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:52.653365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:52.678795 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d5c3-7c1d-4346-8ec4-7f5e5302ddbe None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:52.715336 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e9afb-6bae-4c59-8546-bb891eb34ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:52.716448 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e9afb-6bae-4c59-8546-bb891eb34ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:52.716931 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e9afb-6bae-4c59-8546-bb891eb34ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:52.717221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e9afb-6bae-4c59-8546-bb891eb34ff0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:52.725855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e3b1b-0a1b-4ac3-a348-e403e871aba6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:52.727907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e3b1b-0a1b-4ac3-a348-e403e871aba6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:52.728379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e9afb-6bae-4c59-8546-bb891eb34ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:52.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-669e9afb-6bae-4c59-8546-bb891eb34ff0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:44:52.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:52.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:52.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:52.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:52.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:52.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:52.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:52.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:52.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:52.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:52.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:52.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:52.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:52.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:52.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:52.738727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:52.738727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:52.738727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:52.738727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:52.738727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:52.738727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:52.738727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:52.738727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:52.738727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:52.738727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:52.738727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:52.738727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:52.738727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:52.738727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:52.738727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:52.738727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:52.739532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:52.739532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:52.739532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:52.739532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:52.739532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:52.739532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:52.739532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:52.739532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:52.739532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:52.739532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:52.739532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:44:52.739532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:44:52.739532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 93/180] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:44:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:52.741079 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e9afb-6bae-4c59-8546-bb891eb34ff0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:52.821906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:52.840403 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 88/181] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:44:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:44:52.841891 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f850-841d-4134-a60b-27a1f446d3ff None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:52.842184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f850-841d-4134-a60b-27a1f446d3ff None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:52.842469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f850-841d-4134-a60b-27a1f446d3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:52.851038 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e9afb-6bae-4c59-8546-bb891eb34ff0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:52.863055 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c4b9f850-841d-4134-a60b-27a1f446d3ff None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:52.864473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c4b9f850-841d-4134-a60b-27a1f446d3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:52.885240 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17644178-a6f0-4ca5-8656-92c049a4183d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:52.885895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644178-a6f0-4ca5-8656-92c049a4183d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:52.886187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644178-a6f0-4ca5-8656-92c049a4183d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:52.886456 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644178-a6f0-4ca5-8656-92c049a4183d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:52.887277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17644178-a6f0-4ca5-8656-92c049a4183d None admin] RBAC: Adding query filter params (role.id=f9b113934dbd49218d427f6cacaabf8f, scope.project.id=eb120c9c3572435a8113ca1e458046c4, user.id=85d51d7f1b3d4b0886d5e89e243c87c9) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:52.887593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17644178-a6f0-4ca5-8656-92c049a4183d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:52.889056 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17644178-a6f0-4ca5-8656-92c049a4183d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:52.891853 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:52.895116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 94/182] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:44:52 2022] GET /identity/v3/role_assignments?user.id=85d51d7f1b3d4b0886d5e89e243c87c9&scope.project.id=eb120c9c3572435a8113ca1e458046c4&role.id=f9b113934dbd49218d427f6cacaabf8f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:52.896362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4d5a5-9fc9-4d25-b055-d66043ebf541 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:52.896650 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4d5a5-9fc9-4d25-b055-d66043ebf541 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:52.896931 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4d5a5-9fc9-4d25-b055-d66043ebf541 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:52.898205 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 95/183] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:52.898919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4d5a5-9fc9-4d25-b055-d66043ebf541 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:52.960119 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 89/184] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:52.960119 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9f850-841d-4134-a60b-27a1f446d3ff None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:53.076485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4d5a5-9fc9-4d25-b055-d66043ebf541 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:53.087304 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9f850-841d-4134-a60b-27a1f446d3ff None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:53.103752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:53.128040 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62831776-ec12-42dc-a071-34f5665abda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:53.128734 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62831776-ec12-42dc-a071-34f5665abda8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:53.129022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62831776-ec12-42dc-a071-34f5665abda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:53.129309 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62831776-ec12-42dc-a071-34f5665abda8 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:53.130071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf3e09-936e-4c09-b1fb-c9208ee5d199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:53.130199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62831776-ec12-42dc-a071-34f5665abda8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:53.130416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62831776-ec12-42dc-a071-34f5665abda8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:53.131507 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf3e09-936e-4c09-b1fb-c9208ee5d199 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:53.131795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf3e09-936e-4c09-b1fb-c9208ee5d199 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:53.131896 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62831776-ec12-42dc-a071-34f5665abda8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:53.133314 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf3e09-936e-4c09-b1fb-c9208ee5d199 None admin] PATH_INFO: `/v3/projects/22ff581175ca44618b73c0d9f5425097` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:53.134236 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf3e09-936e-4c09-b1fb-c9208ee5d199 None admin] RBAC: Authorizing `identity:get_project(project_id=22ff581175ca44618b73c0d9f5425097)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:53.135684 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf3e09-936e-4c09-b1fb-c9208ee5d199 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:53.137815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 90/185] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:52 2022] GET /identity/v3/projects/22ff581175ca44618b73c0d9f5425097 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:53.138840 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3457d-f0bf-4389-9453-c6145f130df9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:53.139129 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3457d-f0bf-4389-9453-c6145f130df9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:53.139415 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3457d-f0bf-4389-9453-c6145f130df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:53.140875 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 96/186] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:53.141535 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62831776-ec12-42dc-a071-34f5665abda8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:53.157525 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-27d3457d-f0bf-4389-9453-c6145f130df9 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:53.158706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-27d3457d-f0bf-4389-9453-c6145f130df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:53.213034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:53.236113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 91/187] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:53.237317 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3457d-f0bf-4389-9453-c6145f130df9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:53.264186 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62831776-ec12-42dc-a071-34f5665abda8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:53.303051 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f68112-f5d7-4b79-a6ea-9c6ecd10d482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:53.304028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f68112-f5d7-4b79-a6ea-9c6ecd10d482 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:53.304277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f68112-f5d7-4b79-a6ea-9c6ecd10d482 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:53.304484 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f68112-f5d7-4b79-a6ea-9c6ecd10d482 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:53.314613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f68112-f5d7-4b79-a6ea-9c6ecd10d482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:53.322785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-54f68112-f5d7-4b79-a6ea-9c6ecd10d482 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:44:53.322785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:53.322785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:53.322785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:53.322785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:53.322785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:53.322785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:53.322785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:53.322785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:53.322785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:53.322785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:53.322785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:53.322785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:53.322785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:53.322785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:53.322785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:53.323683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:53.323683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:53.323683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:53.323683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:53.323683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:53.323683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:53.323683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:53.323683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:53.323683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:53.323683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:53.323683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:53.323683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:53.323683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:53.323683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:53.323683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:53.323683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:53.328825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:53.328825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:53.328825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:53.328825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:53.328825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:53.328825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:53.328825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:53.328825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:53.328825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:53.328825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:53.328825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:44:53.328825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:44:53.328825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 97/188] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:44:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:53.328825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f68112-f5d7-4b79-a6ea-9c6ecd10d482 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:53.344138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3457d-f0bf-4389-9453-c6145f130df9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:53.355628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:53.379090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1bb15-50e8-4a77-9cf1-a0a99e2f7657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:53.379974 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1bb15-50e8-4a77-9cf1-a0a99e2f7657 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:53.380294 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1bb15-50e8-4a77-9cf1-a0a99e2f7657 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:53.380584 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1bb15-50e8-4a77-9cf1-a0a99e2f7657 None admin] PATH_INFO: `/v3/users/8e9a0545dd194831a8161daa1ef901ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:53.394428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1bb15-50e8-4a77-9cf1-a0a99e2f7657 None admin] RBAC: Authorizing `identity:get_user(user_id=8e9a0545dd194831a8161daa1ef901ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:53.395919 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1bb15-50e8-4a77-9cf1-a0a99e2f7657 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:53.397620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 92/189] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:53 2022] GET /identity/v3/users/8e9a0545dd194831a8161daa1ef901ad => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:53.398911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1bb15-50e8-4a77-9cf1-a0a99e2f7657 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:53.428289 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f68112-f5d7-4b79-a6ea-9c6ecd10d482 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:53.450532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:53.461717 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b844a68-e312-404f-a20e-52571b04d7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:53.462426 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b844a68-e312-404f-a20e-52571b04d7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:53.462702 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b844a68-e312-404f-a20e-52571b04d7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:53.463016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b844a68-e312-404f-a20e-52571b04d7f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:53.463869 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b844a68-e312-404f-a20e-52571b04d7f7 None admin] RBAC: Adding query filter params (role.id=6cae5979d0aa4dcca6467a7ba544d4b1, scope.project.id=22ff581175ca44618b73c0d9f5425097, user.id=85d51d7f1b3d4b0886d5e89e243c87c9) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:53.464174 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b844a68-e312-404f-a20e-52571b04d7f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:53.465708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b844a68-e312-404f-a20e-52571b04d7f7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:53.471507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 98/190] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:44:53 2022] GET /identity/v3/role_assignments?user.id=85d51d7f1b3d4b0886d5e89e243c87c9&scope.project.id=22ff581175ca44618b73c0d9f5425097&role.id=6cae5979d0aa4dcca6467a7ba544d4b1 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:53.472803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50745f9-af98-4f72-a9d4-b07da95414f1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:53.473103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50745f9-af98-4f72-a9d4-b07da95414f1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:53.473389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50745f9-af98-4f72-a9d4-b07da95414f1 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:53.479336 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 99/191] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:53.479336 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50745f9-af98-4f72-a9d4-b07da95414f1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:53.506369 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1bb15-50e8-4a77-9cf1-a0a99e2f7657 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:53.545670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b9170-772d-41fa-be68-2cc7d6189041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:53.546484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b9170-772d-41fa-be68-2cc7d6189041 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:53.546772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b9170-772d-41fa-be68-2cc7d6189041 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:53.547048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b9170-772d-41fa-be68-2cc7d6189041 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:53.548279 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b9170-772d-41fa-be68-2cc7d6189041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:53.549759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b9170-772d-41fa-be68-2cc7d6189041 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:53.551428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 93/192] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:44:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:53.552236 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b9170-772d-41fa-be68-2cc7d6189041 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:53.591581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:53.599755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50745f9-af98-4f72-a9d4-b07da95414f1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:53.640251 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32605df7-2ebc-43c4-a0fa-4cd741f041aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:53.640942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32605df7-2ebc-43c4-a0fa-4cd741f041aa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:53.641228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32605df7-2ebc-43c4-a0fa-4cd741f041aa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:53.641510 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32605df7-2ebc-43c4-a0fa-4cd741f041aa None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:53.642273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32605df7-2ebc-43c4-a0fa-4cd741f041aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:53.642585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32605df7-2ebc-43c4-a0fa-4cd741f041aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:53.644042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32605df7-2ebc-43c4-a0fa-4cd741f041aa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:53.658229 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 100/193] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:44:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:53.659649 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1e939-b7de-4e2e-9ce6-c1503aa87143 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:53.659946 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1e939-b7de-4e2e-9ce6-c1503aa87143 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:53.660257 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1e939-b7de-4e2e-9ce6-c1503aa87143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:53.663091 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b9170-772d-41fa-be68-2cc7d6189041 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:53.678506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c4b1e939-b7de-4e2e-9ce6-c1503aa87143 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:53.679775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c4b1e939-b7de-4e2e-9ce6-c1503aa87143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:53.708203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adbb6e-0dd8-464f-b7c9-64061bc057cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:53.708864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adbb6e-0dd8-464f-b7c9-64061bc057cb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:53.709153 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adbb6e-0dd8-464f-b7c9-64061bc057cb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:53.709433 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adbb6e-0dd8-464f-b7c9-64061bc057cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:53.732637 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:53.756942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 101/194] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:53.757803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1e939-b7de-4e2e-9ce6-c1503aa87143 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:53.785347 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5adbb6e-0dd8-464f-b7c9-64061bc057cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:53.786825 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5adbb6e-0dd8-464f-b7c9-64061bc057cb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:53.819949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:53.858296 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1e939-b7de-4e2e-9ce6-c1503aa87143 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:53.884025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 94/195] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:44:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:44:53.885022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adbb6e-0dd8-464f-b7c9-64061bc057cb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:53.891811 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1556cc-76b7-498c-b175-a9ef941b004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:53.892522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1556cc-76b7-498c-b175-a9ef941b004d None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:53.892815 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1556cc-76b7-498c-b175-a9ef941b004d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:53.893098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1556cc-76b7-498c-b175-a9ef941b004d None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:53.893809 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1556cc-76b7-498c-b175-a9ef941b004d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:53.895261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1556cc-76b7-498c-b175-a9ef941b004d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:53.984321 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5adbb6e-0dd8-464f-b7c9-64061bc057cb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:53.999800 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 102/196] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:44:53 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:44:54.000595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1556cc-76b7-498c-b175-a9ef941b004d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:54.030031 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e59ca-48e8-4e61-8406-3f38b1667583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:54.031017 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e59ca-48e8-4e61-8406-3f38b1667583 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:54.031230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e59ca-48e8-4e61-8406-3f38b1667583 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:54.031516 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e59ca-48e8-4e61-8406-3f38b1667583 None admin] PATH_INFO: `/v3/users/8e9a0545dd194831a8161daa1ef901ad` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:54.032856 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e59ca-48e8-4e61-8406-3f38b1667583 None admin] RBAC: Authorizing `identity:get_user(user_id=8e9a0545dd194831a8161daa1ef901ad)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:54.034368 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e59ca-48e8-4e61-8406-3f38b1667583 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:54.041666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 95/197] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:53 2022] GET /identity/v3/users/8e9a0545dd194831a8161daa1ef901ad => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:54.041666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e59ca-48e8-4e61-8406-3f38b1667583 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:54.047429 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:54.051512 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:54.125503 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1556cc-76b7-498c-b175-a9ef941b004d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:54.150416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e59ca-48e8-4e61-8406-3f38b1667583 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:54.164909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600730d-5dca-4c93-b006-c163b506103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:54.165732 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600730d-5dca-4c93-b006-c163b506103e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:54.166022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600730d-5dca-4c93-b006-c163b506103e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:54.166302 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600730d-5dca-4c93-b006-c163b506103e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:54.178010 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600730d-5dca-4c93-b006-c163b506103e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:54.186349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e600730d-5dca-4c93-b006-c163b506103e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:44:54.186349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:54.186349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:54.186349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:54.186349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:54.186349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:54.186349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:54.186349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:54.186349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:54.186349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:54.186349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:54.186349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:54.186349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:54.186349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:54.186349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:54.186349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:54.187300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:54.187300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:54.187300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:54.187300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:54.187300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:54.187300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:54.187300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:54.187300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:54.187300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:54.187300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:54.187300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:54.187300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:54.187300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:54.187300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:54.187300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:54.187300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:54.188132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:54.188132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:54.188132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:54.188132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:54.188132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:54.188132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:54.188132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:54.188132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:54.188132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:54.188132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:54.188132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:44:54.188132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:44:54.188132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 103/198] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:54.188814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600730d-5dca-4c93-b006-c163b506103e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:54.195696 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f9223-2d35-4332-9fb1-b0ab212c0ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:54.196589 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f9223-2d35-4332-9fb1-b0ab212c0ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:54.196875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f9223-2d35-4332-9fb1-b0ab212c0ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:54.197149 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f9223-2d35-4332-9fb1-b0ab212c0ee1 None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:54.198337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f9223-2d35-4332-9fb1-b0ab212c0ee1 None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:54.199785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f9223-2d35-4332-9fb1-b0ab212c0ee1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:54.201523 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 96/199] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:54 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:54.202282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f9223-2d35-4332-9fb1-b0ab212c0ee1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:54.283782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:54.300722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:54.314279 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600730d-5dca-4c93-b006-c163b506103e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:54.329687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f9223-2d35-4332-9fb1-b0ab212c0ee1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:54.357566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090ecee-9ef9-488d-9885-80c3d467a7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:54.358227 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090ecee-9ef9-488d-9885-80c3d467a7ae None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:54.358512 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090ecee-9ef9-488d-9885-80c3d467a7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:54.358792 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090ecee-9ef9-488d-9885-80c3d467a7ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:54.382903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081257e-1b4c-4359-a8e6-0748167f84a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:54.383589 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081257e-1b4c-4359-a8e6-0748167f84a6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:54.383876 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081257e-1b4c-4359-a8e6-0748167f84a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:54.384190 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081257e-1b4c-4359-a8e6-0748167f84a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:54.384949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081257e-1b4c-4359-a8e6-0748167f84a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:54.385264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081257e-1b4c-4359-a8e6-0748167f84a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:54.387137 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081257e-1b4c-4359-a8e6-0748167f84a6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:54.398710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 97/200] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:44:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:54.399604 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081257e-1b4c-4359-a8e6-0748167f84a6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:54.438189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090ecee-9ef9-488d-9885-80c3d467a7ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:54.439796 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090ecee-9ef9-488d-9885-80c3d467a7ae None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:54.512900 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081257e-1b4c-4359-a8e6-0748167f84a6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:54.548043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065f25f-d5c5-42a5-b2c4-261afa3d8e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:54.548984 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065f25f-d5c5-42a5-b2c4-261afa3d8e31 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:54.549468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065f25f-d5c5-42a5-b2c4-261afa3d8e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:54.549939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065f25f-d5c5-42a5-b2c4-261afa3d8e31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:54.550963 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065f25f-d5c5-42a5-b2c4-261afa3d8e31 None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce, user.id=8e9a0545dd194831a8161daa1ef901ad) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:54.551468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065f25f-d5c5-42a5-b2c4-261afa3d8e31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:54.553121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065f25f-d5c5-42a5-b2c4-261afa3d8e31 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:54.554340 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:54.556497 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:54.561048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 98/201] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:44:54 2022] GET /identity/v3/role_assignments?user.id=8e9a0545dd194831a8161daa1ef901ad&scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:54.562145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065f25f-d5c5-42a5-b2c4-261afa3d8e31 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:54.563486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 104/202] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:44:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:44:54.568998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090ecee-9ef9-488d-9885-80c3d467a7ae None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:54.752573 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065f25f-d5c5-42a5-b2c4-261afa3d8e31 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:54.766353 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090ecee-9ef9-488d-9885-80c3d467a7ae None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:54.797506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd9dc2-9c18-4e8d-8dd2-059172b47c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:54.798460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd9dc2-9c18-4e8d-8dd2-059172b47c5c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:54.798842 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd9dc2-9c18-4e8d-8dd2-059172b47c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:54.799130 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd9dc2-9c18-4e8d-8dd2-059172b47c5c None admin] PATH_INFO: `/v3/users/bf6b6a3f8c214396838d942b3e75f000` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:54.801696 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd9dc2-9c18-4e8d-8dd2-059172b47c5c None admin] RBAC: Authorizing `identity:get_user(user_id=bf6b6a3f8c214396838d942b3e75f000)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:54.803445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd9dc2-9c18-4e8d-8dd2-059172b47c5c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:54.806523 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 99/203] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:54 2022] GET /identity/v3/users/bf6b6a3f8c214396838d942b3e75f000 => generated 289 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:54.812451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd9dc2-9c18-4e8d-8dd2-059172b47c5c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:54.813434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81889912-b3b4-4c21-9fb9-08dd7c0e6f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:54.814375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81889912-b3b4-4c21-9fb9-08dd7c0e6f2c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:54.814731 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81889912-b3b4-4c21-9fb9-08dd7c0e6f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:54.815073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81889912-b3b4-4c21-9fb9-08dd7c0e6f2c None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:54.816576 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81889912-b3b4-4c21-9fb9-08dd7c0e6f2c None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:54.818108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81889912-b3b4-4c21-9fb9-08dd7c0e6f2c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:54.820243 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 105/204] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:54 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:54.827532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81889912-b3b4-4c21-9fb9-08dd7c0e6f2c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:54.904401 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:54.926612 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:54.940588 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81889912-b3b4-4c21-9fb9-08dd7c0e6f2c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:54.977922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3830e0-e9aa-4a5e-8ed9-862c21f9723f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:54.979073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3830e0-e9aa-4a5e-8ed9-862c21f9723f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:54.979675 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3830e0-e9aa-4a5e-8ed9-862c21f9723f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:54.980373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3830e0-e9aa-4a5e-8ed9-862c21f9723f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:54.981446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3830e0-e9aa-4a5e-8ed9-862c21f9723f None admin] RBAC: Adding query filter params (role.id=f9b113934dbd49218d427f6cacaabf8f, scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce, user.id=8e9a0545dd194831a8161daa1ef901ad) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:54.981989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3830e0-e9aa-4a5e-8ed9-862c21f9723f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:54.983760 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3830e0-e9aa-4a5e-8ed9-862c21f9723f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:54.990833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 106/205] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:44:54 2022] GET /identity/v3/role_assignments?user.id=8e9a0545dd194831a8161daa1ef901ad&scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce&role.id=f9b113934dbd49218d427f6cacaabf8f => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:55.005018 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd9dc2-9c18-4e8d-8dd2-059172b47c5c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:55.044558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72816b85-b4b1-41fd-89c2-deb545377c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:55.045636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72816b85-b4b1-41fd-89c2-deb545377c1b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:55.046151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72816b85-b4b1-41fd-89c2-deb545377c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:55.046628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72816b85-b4b1-41fd-89c2-deb545377c1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:55.135161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72816b85-b4b1-41fd-89c2-deb545377c1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:55.136704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72816b85-b4b1-41fd-89c2-deb545377c1b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:55.219463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:55.255313 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 100/206] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:44:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 15:44:55.261564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3830e0-e9aa-4a5e-8ed9-862c21f9723f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:55.402718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3830e0-e9aa-4a5e-8ed9-862c21f9723f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:55.429086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:55.439642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82474b2-f945-4649-a4b9-7a37ee505736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:55.440572 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82474b2-f945-4649-a4b9-7a37ee505736 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:55.441162 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82474b2-f945-4649-a4b9-7a37ee505736 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:55.441495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82474b2-f945-4649-a4b9-7a37ee505736 None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:55.447433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82474b2-f945-4649-a4b9-7a37ee505736 None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:55.447433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82474b2-f945-4649-a4b9-7a37ee505736 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:55.447433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 107/207] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:55 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:55.453405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72816b85-b4b1-41fd-89c2-deb545377c1b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:55.592133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72816b85-b4b1-41fd-89c2-deb545377c1b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:55.628035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe8eee-c149-4205-9c77-a73bb8d34ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:55.628700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe8eee-c149-4205-9c77-a73bb8d34ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:55.628986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe8eee-c149-4205-9c77-a73bb8d34ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:55.629265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe8eee-c149-4205-9c77-a73bb8d34ee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:55.630095 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe8eee-c149-4205-9c77-a73bb8d34ee5 None admin] RBAC: Adding query filter params (role.id=acc5ad0b34094944996d5c576ed82fc9, scope.project.id=eb120c9c3572435a8113ca1e458046c4, user.id=bf6b6a3f8c214396838d942b3e75f000) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:55.630410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe8eee-c149-4205-9c77-a73bb8d34ee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:55.631860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe8eee-c149-4205-9c77-a73bb8d34ee5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:55.638094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 101/208] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:44:55 2022] GET /identity/v3/role_assignments?user.id=bf6b6a3f8c214396838d942b3e75f000&scope.project.id=eb120c9c3572435a8113ca1e458046c4&role.id=acc5ad0b34094944996d5c576ed82fc9 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:56.654176 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb8cd3-b46b-4184-a841-46fed43610c5 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:56.654656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb8cd3-b46b-4184-a841-46fed43610c5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:56.654656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb8cd3-b46b-4184-a841-46fed43610c5 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:56.656283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 108/209] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:56.661686 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a40e2-2dcb-46eb-a1ed-26cb988b0605 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:56.662072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a40e2-2dcb-46eb-a1ed-26cb988b0605 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:56.662253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a40e2-2dcb-46eb-a1ed-26cb988b0605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:56.680185 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-905a40e2-2dcb-46eb-a1ed-26cb988b0605 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:56.681376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-905a40e2-2dcb-46eb-a1ed-26cb988b0605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:56.685850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcecb1-d69d-4ebb-a0c6-d1339285c83d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:56.686143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcecb1-d69d-4ebb-a0c6-d1339285c83d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:56.686428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcecb1-d69d-4ebb-a0c6-d1339285c83d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:56.687800 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 109/210] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:56.692794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb9c04-7d7c-4b8d-8fb6-21f080bf0f00 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:56.693088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb9c04-7d7c-4b8d-8fb6-21f080bf0f00 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:56.693378 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb9c04-7d7c-4b8d-8fb6-21f080bf0f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:56.711168 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dffb9c04-7d7c-4b8d-8fb6-21f080bf0f00 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:56.712296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:56.712411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dffb9c04-7d7c-4b8d-8fb6-21f080bf0f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:56.761074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 102/211] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:44:56.785545 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a40e2-2dcb-46eb-a1ed-26cb988b0605 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:56.786737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 110/212] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:44:56.813213 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb9c04-7d7c-4b8d-8fb6-21f080bf0f00 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:56.910573 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a40e2-2dcb-46eb-a1ed-26cb988b0605 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:56.924272 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb9c04-7d7c-4b8d-8fb6-21f080bf0f00 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:56.957307 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f81fa8-7bc1-478d-b3f9-b753e894e7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:56.958079 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:56.959836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f81fa8-7bc1-478d-b3f9-b753e894e7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:56.960438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f81fa8-7bc1-478d-b3f9-b753e894e7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:56.961402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f81fa8-7bc1-478d-b3f9-b753e894e7f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:56.970402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3cfb9-533c-49fa-9e82-21f32b772269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:56.971564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3cfb9-533c-49fa-9e82-21f32b772269 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:56.971859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3cfb9-533c-49fa-9e82-21f32b772269 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:56.972171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3cfb9-533c-49fa-9e82-21f32b772269 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:56.973341 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3cfb9-533c-49fa-9e82-21f32b772269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:56.974902 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f81fa8-7bc1-478d-b3f9-b753e894e7f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:56.975115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3cfb9-533c-49fa-9e82-21f32b772269 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:56.977984 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 111/213] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:44:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:56.983050 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3cfb9-533c-49fa-9e82-21f32b772269 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:56.985230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d2f81fa8-7bc1-478d-b3f9-b753e894e7f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:44:56.985230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:56.985230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:56.985230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:56.985230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:56.985230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:56.985230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:56.985230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:56.985230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:56.985230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:56.985230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:56.985230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:56.985230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:56.985230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:56.985230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:56.985230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:56.986088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:56.986088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:56.986088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:56.986088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:56.986088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:56.986088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:56.986088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:56.986088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:56.986088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:56.986088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:56.986088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:56.986088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:56.986088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:56.986088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:56.986088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:56.986088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:56.986881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:56.986881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:56.986881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:56.986881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:56.986881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:56.986881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:56.986881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:56.986881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:56.986881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:56.986881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:56.986881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:44:56.986881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:44:56.990058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 103/214] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:57.000102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f81fa8-7bc1-478d-b3f9-b753e894e7f4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:57.030684 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:57.109093 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3cfb9-533c-49fa-9e82-21f32b772269 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:57.143227 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f81fa8-7bc1-478d-b3f9-b753e894e7f4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:57.149973 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c448ae3-6150-4d9a-9da7-aac860e347fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:57.150835 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c448ae3-6150-4d9a-9da7-aac860e347fb None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:57.151301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c448ae3-6150-4d9a-9da7-aac860e347fb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:57.151733 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c448ae3-6150-4d9a-9da7-aac860e347fb None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:57.153118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c448ae3-6150-4d9a-9da7-aac860e347fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:57.155199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c448ae3-6150-4d9a-9da7-aac860e347fb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:57.181113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fdc86-5419-439c-8810-f0080f852f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:57.181885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fdc86-5419-439c-8810-f0080f852f80 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:57.182247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fdc86-5419-439c-8810-f0080f852f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:57.182596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fdc86-5419-439c-8810-f0080f852f80 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:57.183412 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fdc86-5419-439c-8810-f0080f852f80 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:57.183790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fdc86-5419-439c-8810-f0080f852f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:57.185269 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fdc86-5419-439c-8810-f0080f852f80 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:57.194109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 104/215] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:44:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:57.199703 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fdc86-5419-439c-8810-f0080f852f80 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:57.268077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 112/216] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:44:56 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:44:57.268077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4564-c23d-49f4-9441-0ed544b24f8c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:57.268077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4564-c23d-49f4-9441-0ed544b24f8c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:57.268077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4564-c23d-49f4-9441-0ed544b24f8c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:57.268077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 113/217] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:57.273164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6a576-0bab-4a71-9980-4fa4dbaeb2c6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:57.273462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6a576-0bab-4a71-9980-4fa4dbaeb2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:57.273808 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6a576-0bab-4a71-9980-4fa4dbaeb2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:57.292823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-21d6a576-0bab-4a71-9980-4fa4dbaeb2c6 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:57.294124 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-21d6a576-0bab-4a71-9980-4fa4dbaeb2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:57.301447 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:57.331710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fdc86-5419-439c-8810-f0080f852f80 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:57.355409 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:57.387782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f4894-fc3e-4fff-aaa8-100b4a3a0fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:57.388798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f4894-fc3e-4fff-aaa8-100b4a3a0fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:57.389210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f4894-fc3e-4fff-aaa8-100b4a3a0fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:57.389558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f4894-fc3e-4fff-aaa8-100b4a3a0fe8 None admin] PATH_INFO: `/v3/users/887bd4c75ddd497ba6331b78c357c8cf` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:57.396164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 114/218] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:44:57.410824 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f4894-fc3e-4fff-aaa8-100b4a3a0fe8 None admin] RBAC: Authorizing `identity:get_user(user_id=887bd4c75ddd497ba6331b78c357c8cf)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:57.412358 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f4894-fc3e-4fff-aaa8-100b4a3a0fe8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:57.415802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6a576-0bab-4a71-9980-4fa4dbaeb2c6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:57.421178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 105/219] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:57 2022] GET /identity/v3/users/887bd4c75ddd497ba6331b78c357c8cf => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:57.422353 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f4894-fc3e-4fff-aaa8-100b4a3a0fe8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:57.553220 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6a576-0bab-4a71-9980-4fa4dbaeb2c6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:57.562307 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f4894-fc3e-4fff-aaa8-100b4a3a0fe8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:57.597878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535fe3f-5631-4f65-a12e-96aa0703fe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:57.599180 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535fe3f-5631-4f65-a12e-96aa0703fe9d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:57.599783 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535fe3f-5631-4f65-a12e-96aa0703fe9d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:57.600299 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535fe3f-5631-4f65-a12e-96aa0703fe9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:57.607083 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa356f-f3be-47c2-b753-58993dd876eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:57.607740 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa356f-f3be-47c2-b753-58993dd876eb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:57.608052 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa356f-f3be-47c2-b753-58993dd876eb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:57.608342 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa356f-f3be-47c2-b753-58993dd876eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:57.614145 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3535fe3f-5631-4f65-a12e-96aa0703fe9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:57.623115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3535fe3f-5631-4f65-a12e-96aa0703fe9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:44:57.623115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:57.623115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:57.623115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:57.623115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:57.623115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:57.623115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:57.623115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:57.623115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:57.623115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:57.623115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:57.623115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:57.623115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:57.623115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:57.623115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:57.623115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:57.624052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:57.624052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:57.624052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:57.624052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:57.624052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:57.624052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:57.624052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:57.624052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:57.624052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:57.624052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:57.624052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:57.624052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:57.624052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:57.624052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:57.624052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:57.624052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:57.624878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:57.624878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:57.624878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:57.624878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:57.624878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:57.624878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:57.624878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:57.624878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:57.624878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:57.624878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:57.624878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:44:57.624878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:44:57.625521 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:57.625593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 115/220] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:44:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:44:57.629169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535fe3f-5631-4f65-a12e-96aa0703fe9d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:57.680689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:57.712263 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa356f-f3be-47c2-b753-58993dd876eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:57.713742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa356f-f3be-47c2-b753-58993dd876eb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:57.748079 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535fe3f-5631-4f65-a12e-96aa0703fe9d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:57.783872 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647956f-843b-4dc3-a3b7-803ab1d4cc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:57.784576 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647956f-843b-4dc3-a3b7-803ab1d4cc18 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:57.784864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647956f-843b-4dc3-a3b7-803ab1d4cc18 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:57.785145 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647956f-843b-4dc3-a3b7-803ab1d4cc18 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:57.785897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647956f-843b-4dc3-a3b7-803ab1d4cc18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:57.786209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647956f-843b-4dc3-a3b7-803ab1d4cc18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:57.787608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647956f-843b-4dc3-a3b7-803ab1d4cc18 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:57.796681 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 116/221] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:44:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:44:57.797951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d8913-7f9d-42b6-bf2f-d87133937bb3 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:57.798242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d8913-7f9d-42b6-bf2f-d87133937bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:57.798522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d8913-7f9d-42b6-bf2f-d87133937bb3 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:57.804935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 117/222] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:57.810032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d8913-7f9d-42b6-bf2f-d87133937bb3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:57.850556 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 106/223] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:44:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:44:57.856742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f6d1d-dcaa-4a61-b44e-4fac642e2fb6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:57.857049 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f6d1d-dcaa-4a61-b44e-4fac642e2fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:57.857341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f6d1d-dcaa-4a61-b44e-4fac642e2fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:57.877641 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c96f6d1d-dcaa-4a61-b44e-4fac642e2fb6 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:57.879429 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c96f6d1d-dcaa-4a61-b44e-4fac642e2fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:44:57.924410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:57.926252 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:57.931375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d8913-7f9d-42b6-bf2f-d87133937bb3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:57.966779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 107/224] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:44:57.967905 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f6d1d-dcaa-4a61-b44e-4fac642e2fb6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:57.970669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66449cfe-6698-4454-87a9-8e7bda17a154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:57.980006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66449cfe-6698-4454-87a9-8e7bda17a154 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:57.980006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66449cfe-6698-4454-87a9-8e7bda17a154 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:57.980006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66449cfe-6698-4454-87a9-8e7bda17a154 None admin] PATH_INFO: `/v3/users/8e9a0545dd194831a8161daa1ef901ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:57.980006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66449cfe-6698-4454-87a9-8e7bda17a154 None admin] RBAC: Authorizing `identity:get_user(user_id=8e9a0545dd194831a8161daa1ef901ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:57.980006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66449cfe-6698-4454-87a9-8e7bda17a154 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:57.980006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 118/225] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:57 2022] GET /identity/v3/users/8e9a0545dd194831a8161daa1ef901ad => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:57.986766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66449cfe-6698-4454-87a9-8e7bda17a154 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:58.095562 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66449cfe-6698-4454-87a9-8e7bda17a154 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:58.119329 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f6d1d-dcaa-4a61-b44e-4fac642e2fb6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:58.135542 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaa319-fa4d-454f-9000-57adeabd14b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:58.136719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaa319-fa4d-454f-9000-57adeabd14b8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:58.137203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaa319-fa4d-454f-9000-57adeabd14b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:58.137674 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaa319-fa4d-454f-9000-57adeabd14b8 None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:58.139042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfaa319-fa4d-454f-9000-57adeabd14b8 None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:58.140726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfaa319-fa4d-454f-9000-57adeabd14b8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:58.142899 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 119/226] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:57 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:58.143850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaa319-fa4d-454f-9000-57adeabd14b8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:58.167364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a97328-fa7b-4994-86ac-4fb6eafb98e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:58.168894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a97328-fa7b-4994-86ac-4fb6eafb98e2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:58.169366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a97328-fa7b-4994-86ac-4fb6eafb98e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:58.169657 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a97328-fa7b-4994-86ac-4fb6eafb98e2 None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:58.171156 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a97328-fa7b-4994-86ac-4fb6eafb98e2 None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:58.173402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a97328-fa7b-4994-86ac-4fb6eafb98e2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:58.181017 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 108/227] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:57 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:58.181952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a97328-fa7b-4994-86ac-4fb6eafb98e2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:58.182723 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:58.248359 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:58.249492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaa319-fa4d-454f-9000-57adeabd14b8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:58.284994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278352dd-180e-4ce4-965f-25004563c14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:58.285915 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278352dd-180e-4ce4-965f-25004563c14f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:58.286269 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278352dd-180e-4ce4-965f-25004563c14f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:58.286618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278352dd-180e-4ce4-965f-25004563c14f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:58.293096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a97328-fa7b-4994-86ac-4fb6eafb98e2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:58.297278 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278352dd-180e-4ce4-965f-25004563c14f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:44:58.305960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-278352dd-180e-4ce4-965f-25004563c14f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:44:58.305960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:44:58.305960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:44:58.305960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:44:58.305960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:44:58.305960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:44:58.305960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:44:58.305960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:44:58.305960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:44:58.305960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:44:58.305960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:44:58.305960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:44:58.305960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:44:58.305960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:44:58.305960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:44:58.305960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:44:58.307035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:44:58.307035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:44:58.307035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:44:58.307035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:44:58.307035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:44:58.307035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:44:58.307035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:44:58.307035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:44:58.307035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:44:58.307035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:44:58.307035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:44:58.307035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:44:58.307035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:44:58.307035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:44:58.307035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:44:58.307035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:44:58.307877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:44:58.307877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:44:58.307877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:44:58.307877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:44:58.307877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:44:58.307877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:44:58.307877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:44:58.307877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:44:58.307877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:44:58.307877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:44:58.307877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:44:58.307877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:44:58.312460 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 120/228] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:44:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:44:58.313047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278352dd-180e-4ce4-965f-25004563c14f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:58.334861 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7ec83-dfa8-47c9-b0ec-139802d99d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:58.336826 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7ec83-dfa8-47c9-b0ec-139802d99d98 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:58.337291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7ec83-dfa8-47c9-b0ec-139802d99d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:58.337745 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7ec83-dfa8-47c9-b0ec-139802d99d98 None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce/users/8e9a0545dd194831a8161daa1ef901ad/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:58.340276 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7ec83-dfa8-47c9-b0ec-139802d99d98 None admin] RBAC: Authorizing `identity:create_grant(project_id=b23b3964eb0b4e7c856d698cf2bf45ce, user_id=8e9a0545dd194831a8161daa1ef901ad, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:58.341976 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7ec83-dfa8-47c9-b0ec-139802d99d98 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:58.417982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:58.423917 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278352dd-180e-4ce4-965f-25004563c14f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:58.433122 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 109/229] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:44:58 2022] PUT /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce/users/8e9a0545dd194831a8161daa1ef901ad/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:44:58.434445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7ec83-dfa8-47c9-b0ec-139802d99d98 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:58.488134 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043e0ac-3f37-4f07-8a6c-3ed658315042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:58.488807 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043e0ac-3f37-4f07-8a6c-3ed658315042 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:58.489093 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043e0ac-3f37-4f07-8a6c-3ed658315042 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:58.489371 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043e0ac-3f37-4f07-8a6c-3ed658315042 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:58.490215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043e0ac-3f37-4f07-8a6c-3ed658315042 None admin] RBAC: Adding query filter params (role.id=6cae5979d0aa4dcca6467a7ba544d4b1, scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce, user.id=887bd4c75ddd497ba6331b78c357c8cf) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:58.490530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043e0ac-3f37-4f07-8a6c-3ed658315042 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:58.493609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043e0ac-3f37-4f07-8a6c-3ed658315042 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:58.505112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 121/230] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:44:58 2022] GET /identity/v3/role_assignments?user.id=887bd4c75ddd497ba6331b78c357c8cf&scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce&role.id=6cae5979d0aa4dcca6467a7ba544d4b1 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:58.573484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:58.578121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7ec83-dfa8-47c9-b0ec-139802d99d98 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:58.616820 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce0aa2-29a8-41fd-ace7-6ea6101b3cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:58.617509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce0aa2-29a8-41fd-ace7-6ea6101b3cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:58.617795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce0aa2-29a8-41fd-ace7-6ea6101b3cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:58.618072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce0aa2-29a8-41fd-ace7-6ea6101b3cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:58.618839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce0aa2-29a8-41fd-ace7-6ea6101b3cf7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:44:58.619148 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce0aa2-29a8-41fd-ace7-6ea6101b3cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:58.620698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce0aa2-29a8-41fd-ace7-6ea6101b3cf7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:58.636150 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 110/231] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:44:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:58.640802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043e0ac-3f37-4f07-8a6c-3ed658315042 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:58.789678 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043e0ac-3f37-4f07-8a6c-3ed658315042 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:58.844678 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf7892-f4b1-4c84-b725-a51b4c689d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:58.845563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf7892-f4b1-4c84-b725-a51b4c689d33 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:58.845887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf7892-f4b1-4c84-b725-a51b4c689d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:58.846127 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf7892-f4b1-4c84-b725-a51b4c689d33 None admin] PATH_INFO: `/v3/users/8e9a0545dd194831a8161daa1ef901ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:58.852721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf7892-f4b1-4c84-b725-a51b4c689d33 None admin] RBAC: Authorizing `identity:get_user(user_id=8e9a0545dd194831a8161daa1ef901ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:58.854211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf7892-f4b1-4c84-b725-a51b4c689d33 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:58.856202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 122/232] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:44:58 2022] GET /identity/v3/users/8e9a0545dd194831a8161daa1ef901ad => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:58.861855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce0aa2-29a8-41fd-ace7-6ea6101b3cf7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:58.964616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce0aa2-29a8-41fd-ace7-6ea6101b3cf7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:59.010710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2aa231-0d29-4af4-b9bc-693fa138e037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:59.011957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2aa231-0d29-4af4-b9bc-693fa138e037 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:59.012458 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2aa231-0d29-4af4-b9bc-693fa138e037 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:59.012929 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2aa231-0d29-4af4-b9bc-693fa138e037 None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:59.016689 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2aa231-0d29-4af4-b9bc-693fa138e037 None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:59.018361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2aa231-0d29-4af4-b9bc-693fa138e037 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:59.020652 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 111/233] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:44:58 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:44:59.026824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf7892-f4b1-4c84-b725-a51b4c689d33 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:44:59.086867 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:44:59.176183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf7892-f4b1-4c84-b725-a51b4c689d33 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:44:59.218636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a80425-7d90-4104-bd2c-9832abe6e0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:44:59.219465 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a80425-7d90-4104-bd2c-9832abe6e0a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:59.219751 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a80425-7d90-4104-bd2c-9832abe6e0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:59.220048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a80425-7d90-4104-bd2c-9832abe6e0a4 None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce/users/8e9a0545dd194831a8161daa1ef901ad/roles/f9b113934dbd49218d427f6cacaabf8f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:59.222445 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a80425-7d90-4104-bd2c-9832abe6e0a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b23b3964eb0b4e7c856d698cf2bf45ce, user_id=8e9a0545dd194831a8161daa1ef901ad, role_id=f9b113934dbd49218d427f6cacaabf8f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:44:59.223930 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a80425-7d90-4104-bd2c-9832abe6e0a4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:44:59.332861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 123/234] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:44:59 2022] PUT /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce/users/8e9a0545dd194831a8161daa1ef901ad/roles/f9b113934dbd49218d427f6cacaabf8f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:44:59.966070 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459f6f-ce4b-4884-9199-774ec74897a2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:59.966587 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459f6f-ce4b-4884-9199-774ec74897a2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:59.966663 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459f6f-ce4b-4884-9199-774ec74897a2 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:59.968338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 112/235] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:44:59.973258 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199e0e0-b6d4-4ccf-8bc8-65caa2e98024 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:44:59.973665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199e0e0-b6d4-4ccf-8bc8-65caa2e98024 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:44:59.973832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199e0e0-b6d4-4ccf-8bc8-65caa2e98024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:44:59.991272 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4199e0e0-b6d4-4ccf-8bc8-65caa2e98024 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:44:59.993007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4199e0e0-b6d4-4ccf-8bc8-65caa2e98024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:00.084708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 124/236] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:00.086542 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32da67-7150-422f-ab49-42a12be114fb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:00.086834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32da67-7150-422f-ab49-42a12be114fb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:00.087117 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32da67-7150-422f-ab49-42a12be114fb None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:00.088498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 113/237] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:00.094051 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2d476-c7e4-455c-94f1-5ea71d50e340 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:00.094344 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2d476-c7e4-455c-94f1-5ea71d50e340 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:00.094626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2d476-c7e4-455c-94f1-5ea71d50e340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:00.111557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d3c2d476-c7e4-455c-94f1-5ea71d50e340 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:00.112764 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d3c2d476-c7e4-455c-94f1-5ea71d50e340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:00.122416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32da67-7150-422f-ab49-42a12be114fb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:00.143835 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:00.164944 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:00.233475 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 125/238] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:00.264795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32da67-7150-422f-ab49-42a12be114fb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:00.284007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2d476-c7e4-455c-94f1-5ea71d50e340 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:00.304048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e426dd4-8b8f-4919-93d4-47b6e043802e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:00.304048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e426dd4-8b8f-4919-93d4-47b6e043802e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:00.304048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e426dd4-8b8f-4919-93d4-47b6e043802e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:00.304048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e426dd4-8b8f-4919-93d4-47b6e043802e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:00.306071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e426dd4-8b8f-4919-93d4-47b6e043802e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:00.307896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e426dd4-8b8f-4919-93d4-47b6e043802e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:00.313545 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 114/239] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:00.316921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e426dd4-8b8f-4919-93d4-47b6e043802e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:00.485182 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2d476-c7e4-455c-94f1-5ea71d50e340 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:00.504346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:00.518200 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e426dd4-8b8f-4919-93d4-47b6e043802e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:00.560535 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9664c9-a3a5-4cf9-84f4-f489bdd0be0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:00.561354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9664c9-a3a5-4cf9-84f4-f489bdd0be0c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:00.561644 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9664c9-a3a5-4cf9-84f4-f489bdd0be0c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:00.561926 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9664c9-a3a5-4cf9-84f4-f489bdd0be0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:00.584541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9664c9-a3a5-4cf9-84f4-f489bdd0be0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:00.592434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6a9664c9-a3a5-4cf9-84f4-f489bdd0be0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:00.592434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:00.592434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:00.592434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:00.592434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:00.592434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:00.592434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:00.592434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:00.592434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:00.592434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:00.592434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:00.592434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:00.592434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:00.592434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:00.592434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:00.592434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:00.593541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:00.593541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:00.593541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:00.593541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:00.593541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:00.593541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:00.593541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:00.593541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:00.593541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:00.593541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:00.593541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:00.593541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:00.593541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:00.593541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:00.593541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:00.593541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:00.594490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:00.594490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:00.594490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:00.594490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:00.594490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:00.594490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:00.594490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:00.594490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:00.594490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:00.594490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:00.594490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:00.594490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:00.594490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 126/240] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:00.595338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cded6-21ed-47fc-a082-38e2ce2b66d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:00.596118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cded6-21ed-47fc-a082-38e2ce2b66d1 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:00.596118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cded6-21ed-47fc-a082-38e2ce2b66d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:00.596118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cded6-21ed-47fc-a082-38e2ce2b66d1 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:00.600032 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5cded6-21ed-47fc-a082-38e2ce2b66d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:00.600032 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5cded6-21ed-47fc-a082-38e2ce2b66d1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:00.605721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9664c9-a3a5-4cf9-84f4-f489bdd0be0c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:00.625485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:00.689667 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 115/241] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:45:00 2022] POST /identity/v3/users => generated 293 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:00.744183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9664c9-a3a5-4cf9-84f4-f489bdd0be0c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:00.789595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dce2e-9014-4d85-9fca-428dde0ca8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:00.790283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dce2e-9014-4d85-9fca-428dde0ca8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:00.790578 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dce2e-9014-4d85-9fca-428dde0ca8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:00.790860 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dce2e-9014-4d85-9fca-428dde0ca8b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:00.791691 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dce2e-9014-4d85-9fca-428dde0ca8b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:00.792036 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dce2e-9014-4d85-9fca-428dde0ca8b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:00.793533 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dce2e-9014-4d85-9fca-428dde0ca8b6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:00.803170 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 127/242] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:00.813099 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cded6-21ed-47fc-a082-38e2ce2b66d1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:00.948714 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cded6-21ed-47fc-a082-38e2ce2b66d1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:01.008421 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ee126-4fc9-48fb-81f3-310fe9b47de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:01.008421 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ee126-4fc9-48fb-81f3-310fe9b47de1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:01.008421 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ee126-4fc9-48fb-81f3-310fe9b47de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:01.008421 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ee126-4fc9-48fb-81f3-310fe9b47de1 None admin] PATH_INFO: `/v3/users/07dcbc1802fb47019fd0628e0735c3cb` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:01.016993 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ee126-4fc9-48fb-81f3-310fe9b47de1 None admin] RBAC: Authorizing `identity:get_user(user_id=07dcbc1802fb47019fd0628e0735c3cb)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:01.018489 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ee126-4fc9-48fb-81f3-310fe9b47de1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:01.020952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 116/243] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:00 2022] GET /identity/v3/users/07dcbc1802fb47019fd0628e0735c3cb => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:01.026605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dce2e-9014-4d85-9fca-428dde0ca8b6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:01.153479 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:01.191823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dce2e-9014-4d85-9fca-428dde0ca8b6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:01.235183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06063172-18b7-420a-b415-13c511a4919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:01.235851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06063172-18b7-420a-b415-13c511a4919e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:01.236173 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06063172-18b7-420a-b415-13c511a4919e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:01.236459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06063172-18b7-420a-b415-13c511a4919e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:01.317153 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06063172-18b7-420a-b415-13c511a4919e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:01.318691 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06063172-18b7-420a-b415-13c511a4919e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:01.334717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98b2fa-bcc6-490d-9d47-d4b769c42bf7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:01.335001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98b2fa-bcc6-490d-9d47-d4b769c42bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:01.335283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98b2fa-bcc6-490d-9d47-d4b769c42bf7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:01.336746 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 117/244] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:45:01.338782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c51f7-e453-4a58-9730-a5637bd0c278 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:01.339070 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c51f7-e453-4a58-9730-a5637bd0c278 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:01.339343 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c51f7-e453-4a58-9730-a5637bd0c278 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:01.340667 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 118/245] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:01.347064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c053b68-44ea-46f6-86c1-2a58dc26d0ce None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:01.347352 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c053b68-44ea-46f6-86c1-2a58dc26d0ce None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:01.347640 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c053b68-44ea-46f6-86c1-2a58dc26d0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:01.372822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8c053b68-44ea-46f6-86c1-2a58dc26d0ce None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:01.374027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8c053b68-44ea-46f6-86c1-2a58dc26d0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:01.382414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:01.399794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:01.433799 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 128/246] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:01.436141 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47288ccb-e4ac-4674-9857-ee94f359ed61 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:01.436447 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47288ccb-e4ac-4674-9857-ee94f359ed61 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:01.436735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47288ccb-e4ac-4674-9857-ee94f359ed61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:01.455050 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-47288ccb-e4ac-4674-9857-ee94f359ed61 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:01.455391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 119/247] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:01.456293 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-47288ccb-e4ac-4674-9857-ee94f359ed61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:01.457312 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c053b68-44ea-46f6-86c1-2a58dc26d0ce None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:01.543811 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 129/248] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:01.544653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47288ccb-e4ac-4674-9857-ee94f359ed61 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:01.584987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c053b68-44ea-46f6-86c1-2a58dc26d0ce None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:01.634157 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217882e-5586-4422-9cb8-086bf6862ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:01.635185 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217882e-5586-4422-9cb8-086bf6862ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:01.635471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217882e-5586-4422-9cb8-086bf6862ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:01.635752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217882e-5586-4422-9cb8-086bf6862ec9 None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:01.637028 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217882e-5586-4422-9cb8-086bf6862ec9 None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:01.639164 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217882e-5586-4422-9cb8-086bf6862ec9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:01.640897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 120/249] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:01 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:01.641792 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217882e-5586-4422-9cb8-086bf6862ec9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:01.662747 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:01.668642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:01.671750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47288ccb-e4ac-4674-9857-ee94f359ed61 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:01.719683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4beaf1-da2e-4d1d-895b-74d4e159b098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:01.720521 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4beaf1-da2e-4d1d-895b-74d4e159b098 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:01.720819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4beaf1-da2e-4d1d-895b-74d4e159b098 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:01.721106 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4beaf1-da2e-4d1d-895b-74d4e159b098 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:01.748014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4beaf1-da2e-4d1d-895b-74d4e159b098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:01.752365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fa4beaf1-da2e-4d1d-895b-74d4e159b098 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:01.752365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:01.752365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:01.752365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:01.752365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:01.752365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:01.752365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:01.752365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:01.752365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:01.752365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:01.752365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:01.752365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:01.752365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:01.752365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:01.752365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:01.752365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:01.753244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:01.753244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:01.753244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:01.753244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:01.753244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:01.753244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:01.753244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:01.753244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:01.753244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:01.753244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:01.753244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:01.753244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:01.753244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:01.753244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:01.753244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:01.753244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:01.754048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:01.754048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:01.754048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:01.754048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:01.754048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:01.754048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:01.754048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:01.754048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:01.754048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:01.754048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:01.754048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:01.754048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:01.764177 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 130/250] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:01.765247 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4beaf1-da2e-4d1d-895b-74d4e159b098 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:01.775945 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217882e-5586-4422-9cb8-086bf6862ec9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:01.810774 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0cd26-be9a-4c46-b281-1de2ae5b8274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:01.811577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0cd26-be9a-4c46-b281-1de2ae5b8274 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:01.811867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0cd26-be9a-4c46-b281-1de2ae5b8274 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:01.812186 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0cd26-be9a-4c46-b281-1de2ae5b8274 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:01.824436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0cd26-be9a-4c46-b281-1de2ae5b8274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:01.832754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0ae0cd26-be9a-4c46-b281-1de2ae5b8274 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:01.832754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:01.832754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:01.832754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:01.832754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:01.832754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:01.832754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:01.832754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:01.832754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:01.832754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:01.832754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:01.832754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:01.832754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:01.832754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:01.832754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:01.832754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:01.833869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:01.833869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:01.833869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:01.833869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:01.833869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:01.833869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:01.833869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:01.833869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:01.833869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:01.833869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:01.833869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:01.833869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:01.833869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:01.833869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:01.833869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:01.833869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:01.834860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:01.834860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:01.834860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:01.834860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:01.834860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:01.834860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:01.834860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:01.834860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:01.834860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:01.834860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:01.834860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:01.834860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:01.834860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 121/251] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:01.836194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0cd26-be9a-4c46-b281-1de2ae5b8274 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:01.932762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:01.949060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0cd26-be9a-4c46-b281-1de2ae5b8274 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:01.997215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4beaf1-da2e-4d1d-895b-74d4e159b098 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:02.000151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532991f-4d28-4cbe-b746-e671e4601f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:02.001035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532991f-4d28-4cbe-b746-e671e4601f0f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:02.001321 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532991f-4d28-4cbe-b746-e671e4601f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:02.001601 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532991f-4d28-4cbe-b746-e671e4601f0f None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:02.002373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532991f-4d28-4cbe-b746-e671e4601f0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:02.002664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532991f-4d28-4cbe-b746-e671e4601f0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:02.004072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532991f-4d28-4cbe-b746-e671e4601f0f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:02.022853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 122/252] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:02.026894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532991f-4d28-4cbe-b746-e671e4601f0f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:02.065904 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cd704-5e3b-46d6-835c-c9aa924be884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:02.067288 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cd704-5e3b-46d6-835c-c9aa924be884 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:02.067819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cd704-5e3b-46d6-835c-c9aa924be884 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:02.068329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cd704-5e3b-46d6-835c-c9aa924be884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:02.069442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cd704-5e3b-46d6-835c-c9aa924be884 None admin] RBAC: Adding query filter params (role.id=acc5ad0b34094944996d5c576ed82fc9, scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce, user.id=07dcbc1802fb47019fd0628e0735c3cb) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:02.070491 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cd704-5e3b-46d6-835c-c9aa924be884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:02.072215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cd704-5e3b-46d6-835c-c9aa924be884 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:02.079031 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 131/253] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:01 2022] GET /identity/v3/role_assignments?user.id=07dcbc1802fb47019fd0628e0735c3cb&scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce&role.id=acc5ad0b34094944996d5c576ed82fc9 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:02.080191 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cd704-5e3b-46d6-835c-c9aa924be884 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:02.121076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:02.222013 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532991f-4d28-4cbe-b746-e671e4601f0f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:02.276990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cd704-5e3b-46d6-835c-c9aa924be884 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:02.280465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:02.295029 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206415ac-b7fb-473e-969b-e3515dba33a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:02.296225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206415ac-b7fb-473e-969b-e3515dba33a4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:02.296771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206415ac-b7fb-473e-969b-e3515dba33a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:02.297251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206415ac-b7fb-473e-969b-e3515dba33a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:02.298228 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206415ac-b7fb-473e-969b-e3515dba33a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:02.298740 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206415ac-b7fb-473e-969b-e3515dba33a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:02.300463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206415ac-b7fb-473e-969b-e3515dba33a4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:02.320422 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 123/254] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:02.322096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bacb4d-1352-4e96-98af-918e15afa1ad None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:02.325803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bacb4d-1352-4e96-98af-918e15afa1ad None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:02.326364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bacb4d-1352-4e96-98af-918e15afa1ad None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:02.327921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 124/255] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:02.330061 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bacb4d-1352-4e96-98af-918e15afa1ad None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:02.354478 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db867c-d72d-4580-a83e-783b1e56f20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:02.355766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db867c-d72d-4580-a83e-783b1e56f20c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:02.356296 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db867c-d72d-4580-a83e-783b1e56f20c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:02.356772 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db867c-d72d-4580-a83e-783b1e56f20c None admin] PATH_INFO: `/v3/users/8e9a0545dd194831a8161daa1ef901ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:02.367522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db867c-d72d-4580-a83e-783b1e56f20c None admin] RBAC: Authorizing `identity:get_user(user_id=8e9a0545dd194831a8161daa1ef901ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:02.369450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db867c-d72d-4580-a83e-783b1e56f20c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:02.375768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 132/256] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:02 2022] GET /identity/v3/users/8e9a0545dd194831a8161daa1ef901ad => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:02.377482 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e850a-4fde-4d42-8d28-cb891018d60b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:02.377877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e850a-4fde-4d42-8d28-cb891018d60b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:02.378259 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e850a-4fde-4d42-8d28-cb891018d60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:02.409223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fa1e850a-4fde-4d42-8d28-cb891018d60b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:02.411446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fa1e850a-4fde-4d42-8d28-cb891018d60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:02.505130 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bacb4d-1352-4e96-98af-918e15afa1ad None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:02.544173 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 133/257] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:02.545125 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e850a-4fde-4d42-8d28-cb891018d60b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:02.548598 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a5759-e280-4f48-bcb6-ff8f36bfbbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:02.550184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5759-e280-4f48-bcb6-ff8f36bfbbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:02.551240 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5759-e280-4f48-bcb6-ff8f36bfbbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:02.552276 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a5759-e280-4f48-bcb6-ff8f36bfbbf7 None admin] PATH_INFO: `/v3/users/887bd4c75ddd497ba6331b78c357c8cf` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:02.554456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a5759-e280-4f48-bcb6-ff8f36bfbbf7 None admin] RBAC: Authorizing `identity:get_user(user_id=887bd4c75ddd497ba6331b78c357c8cf)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:02.556379 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a5759-e280-4f48-bcb6-ff8f36bfbbf7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:02.562620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 125/258] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:02 2022] GET /identity/v3/users/887bd4c75ddd497ba6331b78c357c8cf => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:02.568781 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a5759-e280-4f48-bcb6-ff8f36bfbbf7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:02.599226 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:02.667018 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:02.739725 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a5759-e280-4f48-bcb6-ff8f36bfbbf7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:02.743411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e850a-4fde-4d42-8d28-cb891018d60b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:02.805996 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5c849-28c6-4523-8191-920ddc23e2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:02.806900 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5c849-28c6-4523-8191-920ddc23e2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:02.807183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5c849-28c6-4523-8191-920ddc23e2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:02.807974 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5c849-28c6-4523-8191-920ddc23e2a1 None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:02.810367 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5c849-28c6-4523-8191-920ddc23e2a1 None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:02.811825 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5c849-28c6-4523-8191-920ddc23e2a1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:02.814215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcea8af-5dde-4285-8060-5e86daa9b13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:02.814868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcea8af-5dde-4285-8060-5e86daa9b13c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:02.815151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcea8af-5dde-4285-8060-5e86daa9b13c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:02.815425 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcea8af-5dde-4285-8060-5e86daa9b13c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:02.822972 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 126/259] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:02 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:02.823829 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5c849-28c6-4523-8191-920ddc23e2a1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:02.968419 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcea8af-5dde-4285-8060-5e86daa9b13c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:02.969825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcea8af-5dde-4285-8060-5e86daa9b13c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:02.983912 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5c849-28c6-4523-8191-920ddc23e2a1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:03.017547 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:03.032325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:03.039457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e249334-9afe-4f89-8731-630599c73714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:03.040299 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e249334-9afe-4f89-8731-630599c73714 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:03.040587 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e249334-9afe-4f89-8731-630599c73714 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:03.040867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e249334-9afe-4f89-8731-630599c73714 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:03.068641 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e249334-9afe-4f89-8731-630599c73714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:03.084741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2e249334-9afe-4f89-8731-630599c73714 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:03.084741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:03.084741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:03.084741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:03.084741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:03.084741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:03.084741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:03.084741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:03.084741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:03.084741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:03.084741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:03.084741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:03.084741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:03.084741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:03.084741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:03.084741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:03.086252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:03.086252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:03.086252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:03.086252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:03.086252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:03.086252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:03.086252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:03.086252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:03.086252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:03.086252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:03.086252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:03.086252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:03.086252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:03.086252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:03.086252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:03.086252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:03.087071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:03.087071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:03.087071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:03.087071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:03.087071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:03.087071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:03.087071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:03.087071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:03.087071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:03.087071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:03.087071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:03.087071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:03.089905 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 127/260] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:45:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:03.090542 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e249334-9afe-4f89-8731-630599c73714 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:03.132111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 134/261] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:03.133735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcea8af-5dde-4285-8060-5e86daa9b13c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:03.245716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcea8af-5dde-4285-8060-5e86daa9b13c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:03.280552 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:03.287968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537e0ab-6974-463a-a1d6-977dbe017de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:03.289196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537e0ab-6974-463a-a1d6-977dbe017de7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:03.289484 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537e0ab-6974-463a-a1d6-977dbe017de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:03.292766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537e0ab-6974-463a-a1d6-977dbe017de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:03.292766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537e0ab-6974-463a-a1d6-977dbe017de7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:03.292766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537e0ab-6974-463a-a1d6-977dbe017de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:03.292766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537e0ab-6974-463a-a1d6-977dbe017de7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:03.310735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 135/262] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:03.311579 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537e0ab-6974-463a-a1d6-977dbe017de7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:03.357539 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e249334-9afe-4f89-8731-630599c73714 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:03.440300 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfb18a-2fb2-4449-9420-694dd7102e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:03.441203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfb18a-2fb2-4449-9420-694dd7102e6d None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:03.441486 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfb18a-2fb2-4449-9420-694dd7102e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:03.441765 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfb18a-2fb2-4449-9420-694dd7102e6d None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce/users/887bd4c75ddd497ba6331b78c357c8cf/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:03.443830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfb18a-2fb2-4449-9420-694dd7102e6d None admin] RBAC: Authorizing `identity:create_grant(project_id=b23b3964eb0b4e7c856d698cf2bf45ce, user_id=887bd4c75ddd497ba6331b78c357c8cf, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:03.445747 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecfb18a-2fb2-4449-9420-694dd7102e6d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:03.472659 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537e0ab-6974-463a-a1d6-977dbe017de7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:03.508989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99675bf9-e352-4ee4-b4ea-b4929bf07b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:03.510129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99675bf9-e352-4ee4-b4ea-b4929bf07b6e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:03.510556 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99675bf9-e352-4ee4-b4ea-b4929bf07b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:03.511004 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99675bf9-e352-4ee4-b4ea-b4929bf07b6e None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:03.512359 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99675bf9-e352-4ee4-b4ea-b4929bf07b6e None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:03.513957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99675bf9-e352-4ee4-b4ea-b4929bf07b6e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:03.516081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 136/263] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:03 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:03.517041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99675bf9-e352-4ee4-b4ea-b4929bf07b6e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:03.535544 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 128/264] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:45:03 2022] PUT /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce/users/887bd4c75ddd497ba6331b78c357c8cf/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:03.540796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfb18a-2fb2-4449-9420-694dd7102e6d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:03.636388 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:03.652413 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:03.763151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfb18a-2fb2-4449-9420-694dd7102e6d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:03.799067 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99675bf9-e352-4ee4-b4ea-b4929bf07b6e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:03.820173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5bb72-b429-4fd0-ab4f-829077f8a08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:03.820946 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5bb72-b429-4fd0-ab4f-829077f8a08e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:03.821220 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5bb72-b429-4fd0-ab4f-829077f8a08e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:03.821499 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5bb72-b429-4fd0-ab4f-829077f8a08e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:03.822339 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5bb72-b429-4fd0-ab4f-829077f8a08e None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce, user.id=8e9a0545dd194831a8161daa1ef901ad) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:03.822653 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5bb72-b429-4fd0-ab4f-829077f8a08e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:03.824121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5bb72-b429-4fd0-ab4f-829077f8a08e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:03.840207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 129/265] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:03 2022] GET /identity/v3/role_assignments?user.id=8e9a0545dd194831a8161daa1ef901ad&scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:03.893908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0959591-53fb-40a2-93ec-e6f8e67eb055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:03.894810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0959591-53fb-40a2-93ec-e6f8e67eb055 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:03.895095 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0959591-53fb-40a2-93ec-e6f8e67eb055 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:03.895375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0959591-53fb-40a2-93ec-e6f8e67eb055 None admin] PATH_INFO: `/v3/users/8e9a0545dd194831a8161daa1ef901ad` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:03.896646 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0959591-53fb-40a2-93ec-e6f8e67eb055 None admin] RBAC: Authorizing `identity:get_user(user_id=8e9a0545dd194831a8161daa1ef901ad)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:03.898232 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0959591-53fb-40a2-93ec-e6f8e67eb055 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:03.904137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 137/266] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:03 2022] GET /identity/v3/users/8e9a0545dd194831a8161daa1ef901ad => generated 283 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:03.905910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5bb72-b429-4fd0-ab4f-829077f8a08e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:04.070313 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5bb72-b429-4fd0-ab4f-829077f8a08e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:04.091661 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:04.117921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894032a7-f7df-47a5-b8c3-e482ad9a69bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:04.118596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894032a7-f7df-47a5-b8c3-e482ad9a69bf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.118880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894032a7-f7df-47a5-b8c3-e482ad9a69bf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.119158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894032a7-f7df-47a5-b8c3-e482ad9a69bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.131112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec432e2-ab76-4c2f-a8fb-52ef6f2d09c5 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.131400 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec432e2-ab76-4c2f-a8fb-52ef6f2d09c5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.131856 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec432e2-ab76-4c2f-a8fb-52ef6f2d09c5 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.134002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 138/267] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:04.141390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d37ec-8d99-49bf-8e32-ff4c44240db2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.141996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d37ec-8d99-49bf-8e32-ff4c44240db2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.142485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d37ec-8d99-49bf-8e32-ff4c44240db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.189271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1f6d37ec-8d99-49bf-8e32-ff4c44240db2 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:04.190863 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1f6d37ec-8d99-49bf-8e32-ff4c44240db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:04.248795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894032a7-f7df-47a5-b8c3-e482ad9a69bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:04.250973 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894032a7-f7df-47a5-b8c3-e482ad9a69bf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:04.300999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 139/268] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:04.304372 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca00ad-4492-45d8-b763-576448de3835 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.304913 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca00ad-4492-45d8-b763-576448de3835 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.305387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca00ad-4492-45d8-b763-576448de3835 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.306911 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 140/269] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:04.312787 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e6c0b-b883-41d4-8fa1-9ef8311cbc80 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.313274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e6c0b-b883-41d4-8fa1-9ef8311cbc80 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.313696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e6c0b-b883-41d4-8fa1-9ef8311cbc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.337150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-581e6c0b-b883-41d4-8fa1-9ef8311cbc80 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:04.338561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-581e6c0b-b883-41d4-8fa1-9ef8311cbc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:04.401689 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 130/270] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:04.402905 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894032a7-f7df-47a5-b8c3-e482ad9a69bf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:04.408270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:04.423603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:04.444078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 141/271] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:04.445276 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e6c0b-b883-41d4-8fa1-9ef8311cbc80 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:04.547050 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894032a7-f7df-47a5-b8c3-e482ad9a69bf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:04.587400 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e6c0b-b883-41d4-8fa1-9ef8311cbc80 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:04.589575 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c695792-a7d6-4199-99bb-38234e12b9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:04.591295 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c695792-a7d6-4199-99bb-38234e12b9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.591597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c695792-a7d6-4199-99bb-38234e12b9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.591880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c695792-a7d6-4199-99bb-38234e12b9a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.593134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c695792-a7d6-4199-99bb-38234e12b9a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:04.594615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c695792-a7d6-4199-99bb-38234e12b9a1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:04.596292 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 131/272] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:04.597306 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c695792-a7d6-4199-99bb-38234e12b9a1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:04.633636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa78b-1181-4b7c-851e-0ed18fe7c254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:04.634768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa78b-1181-4b7c-851e-0ed18fe7c254 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.635197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa78b-1181-4b7c-851e-0ed18fe7c254 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.635616 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273aa78b-1181-4b7c-851e-0ed18fe7c254 None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.637052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273aa78b-1181-4b7c-851e-0ed18fe7c254 None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:04.638688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273aa78b-1181-4b7c-851e-0ed18fe7c254 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:04.640554 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 142/273] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:04 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:04.646056 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa78b-1181-4b7c-851e-0ed18fe7c254 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:04.690242 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:04.697616 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:04.710113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c695792-a7d6-4199-99bb-38234e12b9a1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:04.749014 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a567a3b-bdc0-4042-a386-1a5063fef2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:04.750145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a567a3b-bdc0-4042-a386-1a5063fef2de None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.750765 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a567a3b-bdc0-4042-a386-1a5063fef2de None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.751337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a567a3b-bdc0-4042-a386-1a5063fef2de None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.757086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273aa78b-1181-4b7c-851e-0ed18fe7c254 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:04.764952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a567a3b-bdc0-4042-a386-1a5063fef2de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:04.774074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8a567a3b-bdc0-4042-a386-1a5063fef2de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:04.774074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:04.774074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:04.774074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:04.774074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:04.774074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:04.774074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:04.774074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:04.774074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:04.774074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:04.774074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:04.774074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:04.774074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:04.774074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:04.774074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:04.774074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:04.774954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:04.774954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:04.774954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:04.774954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:04.774954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:04.774954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:04.774954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:04.774954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:04.774954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:04.774954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:04.774954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:04.774954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:04.774954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:04.774954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:04.774954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:04.774954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:04.776322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:04.776322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:04.776322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:04.776322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:04.776322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:04.776322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:04.776322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:04.776322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:04.776322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:04.776322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:04.776322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:04.776322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:04.776322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 132/274] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:04.776322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a567a3b-bdc0-4042-a386-1a5063fef2de None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:04.797215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f1ac3-9c5f-4a94-a903-fc4c11a1a254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:04.797890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f1ac3-9c5f-4a94-a903-fc4c11a1a254 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.798178 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f1ac3-9c5f-4a94-a903-fc4c11a1a254 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.798459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f1ac3-9c5f-4a94-a903-fc4c11a1a254 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.799167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f1ac3-9c5f-4a94-a903-fc4c11a1a254 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:04.801080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f1ac3-9c5f-4a94-a903-fc4c11a1a254 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:04.879184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a567a3b-bdc0-4042-a386-1a5063fef2de None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:04.884471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 143/275] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:45:04 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:04.886727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149889b5-c724-46dd-b7d4-8379c5806b85 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.887095 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149889b5-c724-46dd-b7d4-8379c5806b85 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.887952 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149889b5-c724-46dd-b7d4-8379c5806b85 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.893148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 144/276] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:04.893148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149889b5-c724-46dd-b7d4-8379c5806b85 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:04.925683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71664cfe-a602-4bd9-9201-3a9c8e73593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:04.926617 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664cfe-a602-4bd9-9201-3a9c8e73593a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.927053 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664cfe-a602-4bd9-9201-3a9c8e73593a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.927563 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664cfe-a602-4bd9-9201-3a9c8e73593a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.928716 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71664cfe-a602-4bd9-9201-3a9c8e73593a None admin] RBAC: Adding query filter params (role.id=f9b113934dbd49218d427f6cacaabf8f, scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce, user.id=8e9a0545dd194831a8161daa1ef901ad) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:04.929847 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71664cfe-a602-4bd9-9201-3a9c8e73593a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:04.931912 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71664cfe-a602-4bd9-9201-3a9c8e73593a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:04.939335 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 133/277] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:04 2022] GET /identity/v3/role_assignments?user.id=8e9a0545dd194831a8161daa1ef901ad&scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce&role.id=f9b113934dbd49218d427f6cacaabf8f => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:04.941225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66db5ff-0ac8-4e08-98ee-5d6c32d4b31a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:04.941675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66db5ff-0ac8-4e08-98ee-5d6c32d4b31a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:04.942088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66db5ff-0ac8-4e08-98ee-5d6c32d4b31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:04.954917 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:04.962302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b66db5ff-0ac8-4e08-98ee-5d6c32d4b31a None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:04.965287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b66db5ff-0ac8-4e08-98ee-5d6c32d4b31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:05.087098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149889b5-c724-46dd-b7d4-8379c5806b85 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:05.096056 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:05.125734 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 134/278] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:05.143835 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086346ab-ec29-43f7-9ffa-f7423ad5030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:05.145141 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086346ab-ec29-43f7-9ffa-f7423ad5030f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:05.145608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086346ab-ec29-43f7-9ffa-f7423ad5030f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:05.146048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086346ab-ec29-43f7-9ffa-f7423ad5030f None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:05.146973 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086346ab-ec29-43f7-9ffa-f7423ad5030f None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:05.147439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086346ab-ec29-43f7-9ffa-f7423ad5030f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:05.152044 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66db5ff-0ac8-4e08-98ee-5d6c32d4b31a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:05.153384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086346ab-ec29-43f7-9ffa-f7423ad5030f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:05.170331 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 145/279] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:05.176246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086346ab-ec29-43f7-9ffa-f7423ad5030f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:05.285233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66db5ff-0ac8-4e08-98ee-5d6c32d4b31a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:05.310838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086346ab-ec29-43f7-9ffa-f7423ad5030f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:05.335843 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40be1a7-4837-4467-b9eb-7f4284a7699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:05.336709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40be1a7-4837-4467-b9eb-7f4284a7699c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:05.337002 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40be1a7-4837-4467-b9eb-7f4284a7699c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:05.337562 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40be1a7-4837-4467-b9eb-7f4284a7699c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:05.341737 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:05.356067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40be1a7-4837-4467-b9eb-7f4284a7699c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:05.362974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb57b8e-bcf1-47f6-8c71-31c9ad511aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:05.366742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f40be1a7-4837-4467-b9eb-7f4284a7699c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:05.366742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:05.366742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:05.366742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:05.366742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:05.366742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:05.366742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:05.366742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:05.366742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:05.366742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:05.366742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:05.366742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:05.366742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:05.366742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:05.366742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:05.366742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:05.367683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:05.367683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:05.367683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:05.367683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:05.367683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:05.367683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:05.367683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:05.367683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:05.367683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:05.367683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:05.367683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:05.367683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:05.367683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:05.367683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:05.367683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:05.367683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:05.368537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:05.368537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:05.368537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:05.368537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:05.368537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:05.368537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:05.368537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:05.368537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:05.368537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:05.368537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:05.368537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:05.368537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:05.368537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 135/280] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:05.369979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb57b8e-bcf1-47f6-8c71-31c9ad511aee None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:05.369979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb57b8e-bcf1-47f6-8c71-31c9ad511aee None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:05.369979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb57b8e-bcf1-47f6-8c71-31c9ad511aee None admin] PATH_INFO: `/v3/users/d72f6d8a43664cdc814fda1a0e4202b4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:05.377003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40be1a7-4837-4467-b9eb-7f4284a7699c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:05.393668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb57b8e-bcf1-47f6-8c71-31c9ad511aee None admin] RBAC: Authorizing `identity:get_user(user_id=d72f6d8a43664cdc814fda1a0e4202b4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:05.395258 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb57b8e-bcf1-47f6-8c71-31c9ad511aee None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:05.397478 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 146/281] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:05 2022] GET /identity/v3/users/d72f6d8a43664cdc814fda1a0e4202b4 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:05.403398 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb57b8e-bcf1-47f6-8c71-31c9ad511aee None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:05.433430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:05.525361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40be1a7-4837-4467-b9eb-7f4284a7699c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:05.526474 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb57b8e-bcf1-47f6-8c71-31c9ad511aee None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:05.561950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce5e7c-7ef9-4c65-8842-54b98c46fea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:05.562645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce5e7c-7ef9-4c65-8842-54b98c46fea5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:05.562934 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce5e7c-7ef9-4c65-8842-54b98c46fea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:05.563215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce5e7c-7ef9-4c65-8842-54b98c46fea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:05.563326 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba0f7a-f61e-4450-8d34-b1a9994bb379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:05.563886 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba0f7a-f61e-4450-8d34-b1a9994bb379 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:05.564095 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce5e7c-7ef9-4c65-8842-54b98c46fea5 None admin] RBAC: Adding query filter params (role.id=6cae5979d0aa4dcca6467a7ba544d4b1, user.id=d72f6d8a43664cdc814fda1a0e4202b4, scope.system=all) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:05.564194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba0f7a-f61e-4450-8d34-b1a9994bb379 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:05.564416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce5e7c-7ef9-4c65-8842-54b98c46fea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:05.564524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba0f7a-f61e-4450-8d34-b1a9994bb379 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:05.565860 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce5e7c-7ef9-4c65-8842-54b98c46fea5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:05.565972 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba0f7a-f61e-4450-8d34-b1a9994bb379 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:05.566358 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba0f7a-f61e-4450-8d34-b1a9994bb379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:05.567885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba0f7a-f61e-4450-8d34-b1a9994bb379 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:05.572519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 147/282] 10.222.0.50 () {56 vars in 1308 bytes} [Thu Jun 2 15:45:05 2022] GET /identity/v3/role_assignments?user.id=d72f6d8a43664cdc814fda1a0e4202b4&scope.system=all&role.id=6cae5979d0aa4dcca6467a7ba544d4b1 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:05.577567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 136/283] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:05.583169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce5e7c-7ef9-4c65-8842-54b98c46fea5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:05.690857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:05.708774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce5e7c-7ef9-4c65-8842-54b98c46fea5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:05.781226 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867a6a1-6de4-4d2b-9b93-b718c9969453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:05.782129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867a6a1-6de4-4d2b-9b93-b718c9969453 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:05.782411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867a6a1-6de4-4d2b-9b93-b718c9969453 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:05.782688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867a6a1-6de4-4d2b-9b93-b718c9969453 None admin] PATH_INFO: `/v3/users/07dcbc1802fb47019fd0628e0735c3cb` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:05.783924 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867a6a1-6de4-4d2b-9b93-b718c9969453 None admin] RBAC: Authorizing `identity:get_user(user_id=07dcbc1802fb47019fd0628e0735c3cb)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:05.785421 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867a6a1-6de4-4d2b-9b93-b718c9969453 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:05.787079 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 148/284] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:05 2022] GET /identity/v3/users/07dcbc1802fb47019fd0628e0735c3cb => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:05.792899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba0f7a-f61e-4450-8d34-b1a9994bb379 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:05.875323 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:05.932471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba0f7a-f61e-4450-8d34-b1a9994bb379 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:05.973826 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826ed2e-90a1-4715-bbe4-c6794bf9595c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:05.974616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826ed2e-90a1-4715-bbe4-c6794bf9595c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:05.974905 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826ed2e-90a1-4715-bbe4-c6794bf9595c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:05.975185 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826ed2e-90a1-4715-bbe4-c6794bf9595c None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:05.976693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826ed2e-90a1-4715-bbe4-c6794bf9595c None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:05.978145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826ed2e-90a1-4715-bbe4-c6794bf9595c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:05.979861 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 137/285] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:05 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:05.985862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867a6a1-6de4-4d2b-9b93-b718c9969453 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:06.158769 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867a6a1-6de4-4d2b-9b93-b718c9969453 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:06.203975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00faa25-5c19-4935-a67e-2f3eea857b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:06.204902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00faa25-5c19-4935-a67e-2f3eea857b93 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:06.205191 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00faa25-5c19-4935-a67e-2f3eea857b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:06.205473 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00faa25-5c19-4935-a67e-2f3eea857b93 None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce/users/07dcbc1802fb47019fd0628e0735c3cb/roles/acc5ad0b34094944996d5c576ed82fc9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:06.208802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00faa25-5c19-4935-a67e-2f3eea857b93 None admin] RBAC: Authorizing `identity:create_grant(project_id=b23b3964eb0b4e7c856d698cf2bf45ce, user_id=07dcbc1802fb47019fd0628e0735c3cb, role_id=acc5ad0b34094944996d5c576ed82fc9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:06.211046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00faa25-5c19-4935-a67e-2f3eea857b93 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:06.302351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 149/286] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:45:05 2022] PUT /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce/users/07dcbc1802fb47019fd0628e0735c3cb/roles/acc5ad0b34094944996d5c576ed82fc9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:06.445864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42823f3-97d3-466d-9558-d66a8645958d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:06.446383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42823f3-97d3-466d-9558-d66a8645958d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:06.446458 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42823f3-97d3-466d-9558-d66a8645958d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:06.448060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 138/287] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:06.453679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271f07f-e08a-465c-97a7-14d5674f4f53 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:06.454237 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271f07f-e08a-465c-97a7-14d5674f4f53 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:06.454716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271f07f-e08a-465c-97a7-14d5674f4f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:06.477839 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e271f07f-e08a-465c-97a7-14d5674f4f53 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:06.479421 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e271f07f-e08a-465c-97a7-14d5674f4f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:06.495635 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:06.568961 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 150/288] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:06.596210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42823f3-97d3-466d-9558-d66a8645958d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:06.706871 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42823f3-97d3-466d-9558-d66a8645958d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:06.730698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:06.742782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79610510-beea-4849-9e8f-66931e69e6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:06.743573 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79610510-beea-4849-9e8f-66931e69e6ec None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:06.743856 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79610510-beea-4849-9e8f-66931e69e6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:06.744164 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79610510-beea-4849-9e8f-66931e69e6ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:06.754991 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79610510-beea-4849-9e8f-66931e69e6ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:06.762706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-79610510-beea-4849-9e8f-66931e69e6ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:06.762706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:06.762706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:06.762706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:06.762706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:06.762706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:06.762706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:06.762706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:06.762706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:06.762706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:06.762706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:06.762706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:06.762706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:06.762706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:06.762706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:06.762706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:06.763942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:06.763942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:06.763942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:06.763942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:06.763942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:06.763942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:06.763942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:06.763942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:06.763942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:06.763942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:06.763942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:06.763942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:06.763942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:06.763942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:06.763942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:06.763942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:06.764821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:06.764821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:06.764821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:06.764821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:06.764821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:06.764821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:06.764821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:06.764821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:06.764821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:06.764821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:06.764821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:06.764821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:06.767344 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 139/289] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:06.773604 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271f07f-e08a-465c-97a7-14d5674f4f53 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:06.924328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271f07f-e08a-465c-97a7-14d5674f4f53 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:06.961090 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7180260-df01-4a59-80a7-b760dfcdb060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:06.962129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7180260-df01-4a59-80a7-b760dfcdb060 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:06.962618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7180260-df01-4a59-80a7-b760dfcdb060 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:06.963098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7180260-df01-4a59-80a7-b760dfcdb060 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:06.964082 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7180260-df01-4a59-80a7-b760dfcdb060 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:06.964630 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7180260-df01-4a59-80a7-b760dfcdb060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:06.966239 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7180260-df01-4a59-80a7-b760dfcdb060 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:06.976791 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 151/290] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:06.982225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79610510-beea-4849-9e8f-66931e69e6ec None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:07.115080 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79610510-beea-4849-9e8f-66931e69e6ec None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:07.155471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d21adf-90b6-4b22-b0b1-04011314b159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:07.156374 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d21adf-90b6-4b22-b0b1-04011314b159 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:07.156659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d21adf-90b6-4b22-b0b1-04011314b159 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:07.156939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d21adf-90b6-4b22-b0b1-04011314b159 None admin] PATH_INFO: `/v3/users/887bd4c75ddd497ba6331b78c357c8cf` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:07.158149 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d21adf-90b6-4b22-b0b1-04011314b159 None admin] RBAC: Authorizing `identity:get_user(user_id=887bd4c75ddd497ba6331b78c357c8cf)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:07.159594 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d21adf-90b6-4b22-b0b1-04011314b159 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:07.161587 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 140/291] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:06 2022] GET /identity/v3/users/887bd4c75ddd497ba6331b78c357c8cf => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:07.167726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7180260-df01-4a59-80a7-b760dfcdb060 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:07.190695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:07.353904 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7180260-df01-4a59-80a7-b760dfcdb060 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:07.403030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fcb46-6968-4a29-86b5-fc85b0978b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:07.403692 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fcb46-6968-4a29-86b5-fc85b0978b97 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:07.403998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fcb46-6968-4a29-86b5-fc85b0978b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:07.404287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fcb46-6968-4a29-86b5-fc85b0978b97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:07.499273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fcb46-6968-4a29-86b5-fc85b0978b97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:07.500756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fcb46-6968-4a29-86b5-fc85b0978b97 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:07.510843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:07.600521 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 152/292] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:07.613109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d21adf-90b6-4b22-b0b1-04011314b159 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:07.696777 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:07.756855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d21adf-90b6-4b22-b0b1-04011314b159 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:07.801160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ccc7e-2a73-4966-807d-8302a8d31bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:07.802028 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ccc7e-2a73-4966-807d-8302a8d31bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:07.802311 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ccc7e-2a73-4966-807d-8302a8d31bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:07.802586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ccc7e-2a73-4966-807d-8302a8d31bb4 None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:07.803789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ccc7e-2a73-4966-807d-8302a8d31bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:07.805327 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ccc7e-2a73-4966-807d-8302a8d31bb4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:07.807021 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 141/293] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:07 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:07.817192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fcb46-6968-4a29-86b5-fc85b0978b97 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:08.008189 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedde7f4-9087-4598-8e4e-53fc075f4b9c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.009048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedde7f4-9087-4598-8e4e-53fc075f4b9c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.011022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedde7f4-9087-4598-8e4e-53fc075f4b9c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.013570 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 142/294] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:08.019252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1c6eb-6e6a-4127-8f9c-a566557566f4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.019778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1c6eb-6e6a-4127-8f9c-a566557566f4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.021441 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1c6eb-6e6a-4127-8f9c-a566557566f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.029817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fcb46-6968-4a29-86b5-fc85b0978b97 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:08.049719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:08.056992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5bd1c6eb-6e6a-4127-8f9c-a566557566f4 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:08.060617 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5bd1c6eb-6e6a-4127-8f9c-a566557566f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:08.093982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f20073-f3be-4ae8-9916-292fb7b386c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:08.095717 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f20073-f3be-4ae8-9916-292fb7b386c3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.096367 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f20073-f3be-4ae8-9916-292fb7b386c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.099375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f20073-f3be-4ae8-9916-292fb7b386c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.100449 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f20073-f3be-4ae8-9916-292fb7b386c3 None admin] RBAC: Adding query filter params (role.id=6cae5979d0aa4dcca6467a7ba544d4b1, scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce, user.id=887bd4c75ddd497ba6331b78c357c8cf) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:08.101822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f20073-f3be-4ae8-9916-292fb7b386c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:08.103759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f20073-f3be-4ae8-9916-292fb7b386c3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:08.117620 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 153/295] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:07 2022] GET /identity/v3/role_assignments?user.id=887bd4c75ddd497ba6331b78c357c8cf&scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce&role.id=6cae5979d0aa4dcca6467a7ba544d4b1 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:08.165458 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 143/296] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:08.202226 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f20073-f3be-4ae8-9916-292fb7b386c3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:08.338594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f20073-f3be-4ae8-9916-292fb7b386c3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:08.362882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64b998-bde5-4b06-bac1-717dda8a2f2d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.363532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64b998-bde5-4b06-bac1-717dda8a2f2d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.364045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64b998-bde5-4b06-bac1-717dda8a2f2d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.365709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 144/297] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:45:08.372975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bbb69-1a60-408a-a4fa-3ef0cfc471d1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.373276 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bbb69-1a60-408a-a4fa-3ef0cfc471d1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.373567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bbb69-1a60-408a-a4fa-3ef0cfc471d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.391879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bafe05-ef25-4509-b3b9-69f07f68ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:08.393120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bafe05-ef25-4509-b3b9-69f07f68ab2a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.393558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bafe05-ef25-4509-b3b9-69f07f68ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.394003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bafe05-ef25-4509-b3b9-69f07f68ab2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.408018 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e18bbb69-1a60-408a-a4fa-3ef0cfc471d1 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:08.408018 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e18bbb69-1a60-408a-a4fa-3ef0cfc471d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:08.411730 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bafe05-ef25-4509-b3b9-69f07f68ab2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:08.425328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a9bafe05-ef25-4509-b3b9-69f07f68ab2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:08.425328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:08.425328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:08.425328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:08.425328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:08.425328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:08.425328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:08.425328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:08.425328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:08.425328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:08.425328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:08.425328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:08.425328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:08.425328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:08.425328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:08.425328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:08.426330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:08.426330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:08.426330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:08.426330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:08.426330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:08.426330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:08.426330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:08.426330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:08.426330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:08.426330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:08.426330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:08.426330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:08.426330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:08.426330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:08.426330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:08.426330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:08.427164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:08.427164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:08.427164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:08.427164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:08.427164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:08.427164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:08.427164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:08.427164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:08.427164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:08.427164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:08.427164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:08.427164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:08.428770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 154/298] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:08.434390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bafe05-ef25-4509-b3b9-69f07f68ab2a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:08.486867 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:08.490468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:08.525969 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 145/299] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:08.549023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bbb69-1a60-408a-a4fa-3ef0cfc471d1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:08.584221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bafe05-ef25-4509-b3b9-69f07f68ab2a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:08.631246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750b026-bf9b-4cf1-8899-9f1012f8201a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:08.631844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750b026-bf9b-4cf1-8899-9f1012f8201a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.632159 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750b026-bf9b-4cf1-8899-9f1012f8201a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.632970 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750b026-bf9b-4cf1-8899-9f1012f8201a None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.633721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750b026-bf9b-4cf1-8899-9f1012f8201a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:08.634032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750b026-bf9b-4cf1-8899-9f1012f8201a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:08.635718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750b026-bf9b-4cf1-8899-9f1012f8201a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:08.646642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 155/300] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:08.649006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4e14f-2105-4264-9753-3e730b7f1109 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.649297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4e14f-2105-4264-9753-3e730b7f1109 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.649579 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4e14f-2105-4264-9753-3e730b7f1109 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.651163 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 156/301] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:08.653015 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4e14f-2105-4264-9753-3e730b7f1109 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:08.680263 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bbb69-1a60-408a-a4fa-3ef0cfc471d1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:08.717393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b1ed8-935e-432f-8142-6f68ea2d0e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:08.718295 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b1ed8-935e-432f-8142-6f68ea2d0e83 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.718592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b1ed8-935e-432f-8142-6f68ea2d0e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.718869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b1ed8-935e-432f-8142-6f68ea2d0e83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.720058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b1ed8-935e-432f-8142-6f68ea2d0e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:08.721802 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b1ed8-935e-432f-8142-6f68ea2d0e83 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:08.728115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 146/302] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:08.728115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c6cad-bc39-4178-ba96-7c956f8c00a1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.728115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c6cad-bc39-4178-ba96-7c956f8c00a1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.728115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c6cad-bc39-4178-ba96-7c956f8c00a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.742510 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ce8c6cad-bc39-4178-ba96-7c956f8c00a1 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:08.743699 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ce8c6cad-bc39-4178-ba96-7c956f8c00a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:08.756352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:08.764393 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4e14f-2105-4264-9753-3e730b7f1109 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:08.789402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:08.800425 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b3f4a-12e1-4d64-8d1d-e99355b5acec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:08.801527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b3f4a-12e1-4d64-8d1d-e99355b5acec None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.801819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b3f4a-12e1-4d64-8d1d-e99355b5acec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.802100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b3f4a-12e1-4d64-8d1d-e99355b5acec None admin] PATH_INFO: `/v3/users/f208fdb967de4f52b81fe883cac71ed0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.820013 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 147/303] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:08.820013 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c6cad-bc39-4178-ba96-7c956f8c00a1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:08.825240 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b3f4a-12e1-4d64-8d1d-e99355b5acec None admin] RBAC: Authorizing `identity:get_user(user_id=f208fdb967de4f52b81fe883cac71ed0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:08.827382 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b3f4a-12e1-4d64-8d1d-e99355b5acec None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:08.830293 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 157/304] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:08 2022] GET /identity/v3/users/f208fdb967de4f52b81fe883cac71ed0 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:08.837244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b3f4a-12e1-4d64-8d1d-e99355b5acec None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:08.918096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c6cad-bc39-4178-ba96-7c956f8c00a1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:08.945368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b3f4a-12e1-4d64-8d1d-e99355b5acec None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:08.955456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10699f8-cedf-4065-9335-d70267ab5e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:08.956188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10699f8-cedf-4065-9335-d70267ab5e72 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.956864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10699f8-cedf-4065-9335-d70267ab5e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.957153 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10699f8-cedf-4065-9335-d70267ab5e72 None admin] PATH_INFO: `/v3/groups` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.958126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10699f8-cedf-4065-9335-d70267ab5e72 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:08.960290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10699f8-cedf-4065-9335-d70267ab5e72 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:08.980760 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a78fc1-987b-49bd-83a6-f4c70967379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:08.983457 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a78fc1-987b-49bd-83a6-f4c70967379b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:08.983457 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a78fc1-987b-49bd-83a6-f4c70967379b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:08.983457 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a78fc1-987b-49bd-83a6-f4c70967379b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:08.983457 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a78fc1-987b-49bd-83a6-f4c70967379b None admin] RBAC: Adding query filter params (role.id=acc5ad0b34094944996d5c576ed82fc9, user.id=f208fdb967de4f52b81fe883cac71ed0, scope.system=all) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:08.983457 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a78fc1-987b-49bd-83a6-f4c70967379b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:08.984616 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a78fc1-987b-49bd-83a6-f4c70967379b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:08.989884 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 158/305] 10.222.0.50 () {56 vars in 1308 bytes} [Thu Jun 2 15:45:08 2022] GET /identity/v3/role_assignments?user.id=f208fdb967de4f52b81fe883cac71ed0&scope.system=all&role.id=acc5ad0b34094944996d5c576ed82fc9 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:08.990684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a78fc1-987b-49bd-83a6-f4c70967379b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:09.009810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:09.046784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 148/306] 10.222.0.50 () {60 vars in 1134 bytes} [Thu Jun 2 15:45:08 2022] POST /identity/v3/groups => generated 229 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:09.057861 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890292-7e5c-45ac-a279-159efff35397 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.058145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890292-7e5c-45ac-a279-159efff35397 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.058438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92890292-7e5c-45ac-a279-159efff35397 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.060075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 149/307] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:09 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:09.069772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20122abd-c1a1-4f80-bda2-98b83a593226 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.070055 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20122abd-c1a1-4f80-bda2-98b83a593226 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.070380 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20122abd-c1a1-4f80-bda2-98b83a593226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.094943 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-20122abd-c1a1-4f80-bda2-98b83a593226 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:09.096745 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-20122abd-c1a1-4f80-bda2-98b83a593226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:09.124319 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a78fc1-987b-49bd-83a6-f4c70967379b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:09.148437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:09.171035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d203f72-f744-4461-98af-b2fedd6eb334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:09.172260 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d203f72-f744-4461-98af-b2fedd6eb334 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.172742 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d203f72-f744-4461-98af-b2fedd6eb334 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.173252 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d203f72-f744-4461-98af-b2fedd6eb334 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.189473 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d203f72-f744-4461-98af-b2fedd6eb334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:09.199396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7d203f72-f744-4461-98af-b2fedd6eb334 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:09.199396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:09.199396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:09.199396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:09.199396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:09.199396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:09.199396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:09.199396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:09.199396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:09.199396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:09.199396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:09.199396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:09.199396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:09.199396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:09.199396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:09.199396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:09.200394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:09.200394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:09.200394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:09.200394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:09.200394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:09.200394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:09.200394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:09.200394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:09.200394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:09.200394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:09.200394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:09.200394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:09.200394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:09.200394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:09.200394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:09.200394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:09.201203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:09.201203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:09.201203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:09.201203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:09.201203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:09.201203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:09.201203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:09.201203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:09.201203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:09.201203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:09.201203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:09.201203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:09.204095 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 159/308] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:09.208153 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 150/309] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:09.209436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d203f72-f744-4461-98af-b2fedd6eb334 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:09.227950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20122abd-c1a1-4f80-bda2-98b83a593226 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:09.313285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:09.342674 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d203f72-f744-4461-98af-b2fedd6eb334 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:09.363872 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20122abd-c1a1-4f80-bda2-98b83a593226 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:09.384042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241955d5-1c5b-4078-9b62-e04372ea2c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:09.384962 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241955d5-1c5b-4078-9b62-e04372ea2c24 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.385348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241955d5-1c5b-4078-9b62-e04372ea2c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.385733 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241955d5-1c5b-4078-9b62-e04372ea2c24 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.386590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241955d5-1c5b-4078-9b62-e04372ea2c24 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:09.387093 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241955d5-1c5b-4078-9b62-e04372ea2c24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:09.388737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241955d5-1c5b-4078-9b62-e04372ea2c24 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:09.398105 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 160/310] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:09.403628 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241955d5-1c5b-4078-9b62-e04372ea2c24 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:09.406774 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43602fe-b31e-43ce-bdf2-c9d5f5a3b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:09.408431 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43602fe-b31e-43ce-bdf2-c9d5f5a3b679 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.408724 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43602fe-b31e-43ce-bdf2-c9d5f5a3b679 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.409004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43602fe-b31e-43ce-bdf2-c9d5f5a3b679 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.426452 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43602fe-b31e-43ce-bdf2-c9d5f5a3b679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:09.437290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d43602fe-b31e-43ce-bdf2-c9d5f5a3b679 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:09.437290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:09.437290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:09.437290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:09.437290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:09.437290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:09.437290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:09.437290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:09.437290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:09.437290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:09.437290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:09.437290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:09.437290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:09.437290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:09.437290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:09.437290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:09.438197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:09.438197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:09.438197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:09.438197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:09.438197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:09.438197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:09.438197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:09.438197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:09.438197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:09.438197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:09.438197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:09.438197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:09.438197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:09.438197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:09.438197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:09.438197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:09.438989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:09.438989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:09.438989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:09.438989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:09.438989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:09.438989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:09.438989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:09.438989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:09.438989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:09.438989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:09.438989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:09.438989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:09.440153 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 151/311] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:09.448840 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43602fe-b31e-43ce-bdf2-c9d5f5a3b679 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:09.488822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:09.528971 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241955d5-1c5b-4078-9b62-e04372ea2c24 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:09.573979 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43602fe-b31e-43ce-bdf2-c9d5f5a3b679 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:09.577543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389dc90-dc86-4043-8868-353360777b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:09.578649 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389dc90-dc86-4043-8868-353360777b59 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.579111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389dc90-dc86-4043-8868-353360777b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.579564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389dc90-dc86-4043-8868-353360777b59 None admin] PATH_INFO: `/v3/users/d72f6d8a43664cdc814fda1a0e4202b4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.580948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389dc90-dc86-4043-8868-353360777b59 None admin] RBAC: Authorizing `identity:get_user(user_id=d72f6d8a43664cdc814fda1a0e4202b4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:09.583118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389dc90-dc86-4043-8868-353360777b59 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:09.586351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 161/312] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:09 2022] GET /identity/v3/users/d72f6d8a43664cdc814fda1a0e4202b4 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:09.591537 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389dc90-dc86-4043-8868-353360777b59 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:09.604089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:09.615765 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0b792-8c28-4096-8b6d-865bc1307a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:09.616869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0b792-8c28-4096-8b6d-865bc1307a5d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.618266 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0b792-8c28-4096-8b6d-865bc1307a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.618266 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0b792-8c28-4096-8b6d-865bc1307a5d None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.618447 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0b792-8c28-4096-8b6d-865bc1307a5d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:09.619020 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0b792-8c28-4096-8b6d-865bc1307a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:09.620585 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0b792-8c28-4096-8b6d-865bc1307a5d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:09.630055 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 152/313] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:09.635559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0b792-8c28-4096-8b6d-865bc1307a5d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:09.715001 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389dc90-dc86-4043-8868-353360777b59 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:09.737492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:09.748337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0b792-8c28-4096-8b6d-865bc1307a5d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:09.762217 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e11af7-7a37-42da-a6da-8e8c364129fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:09.763250 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e11af7-7a37-42da-a6da-8e8c364129fb None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.763547 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e11af7-7a37-42da-a6da-8e8c364129fb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.763832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e11af7-7a37-42da-a6da-8e8c364129fb None admin] PATH_INFO: `/v3/system/users/d72f6d8a43664cdc814fda1a0e4202b4/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.765979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e11af7-7a37-42da-a6da-8e8c364129fb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d72f6d8a43664cdc814fda1a0e4202b4, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:09.767806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e11af7-7a37-42da-a6da-8e8c364129fb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:09.785323 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f62636-54a4-4e9d-a09a-c1cb7b8bcd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:09.786257 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f62636-54a4-4e9d-a09a-c1cb7b8bcd2a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.789853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f62636-54a4-4e9d-a09a-c1cb7b8bcd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.789853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f62636-54a4-4e9d-a09a-c1cb7b8bcd2a None admin] PATH_INFO: `/v3/users/07dcbc1802fb47019fd0628e0735c3cb` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.789853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f62636-54a4-4e9d-a09a-c1cb7b8bcd2a None admin] RBAC: Authorizing `identity:get_user(user_id=07dcbc1802fb47019fd0628e0735c3cb)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:09.789853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f62636-54a4-4e9d-a09a-c1cb7b8bcd2a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:09.791164 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 153/314] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:09 2022] GET /identity/v3/users/07dcbc1802fb47019fd0628e0735c3cb => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:09.796552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f62636-54a4-4e9d-a09a-c1cb7b8bcd2a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:09.896513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 162/315] 10.222.0.50 () {58 vars in 1334 bytes} [Thu Jun 2 15:45:09 2022] PUT /identity/v3/system/users/d72f6d8a43664cdc814fda1a0e4202b4/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 15:45:09.905199 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f62636-54a4-4e9d-a09a-c1cb7b8bcd2a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:09.948495 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0829430-bb34-4ee5-b799-7ee91ebeff2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:09.949211 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0829430-bb34-4ee5-b799-7ee91ebeff2b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:09.949554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0829430-bb34-4ee5-b799-7ee91ebeff2b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:09.949838 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0829430-bb34-4ee5-b799-7ee91ebeff2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:09.983332 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:10.031048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0829430-bb34-4ee5-b799-7ee91ebeff2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:10.032670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0829430-bb34-4ee5-b799-7ee91ebeff2b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:10.158175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 154/316] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 15:45:10.164020 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e11af7-7a37-42da-a6da-8e8c364129fb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:10.237680 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:10.269466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e11af7-7a37-42da-a6da-8e8c364129fb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:10.304617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46285d13-c903-4a77-b008-2fbfd23cd58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:10.305833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46285d13-c903-4a77-b008-2fbfd23cd58d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:10.306408 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46285d13-c903-4a77-b008-2fbfd23cd58d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:10.306702 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46285d13-c903-4a77-b008-2fbfd23cd58d None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:10.308314 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46285d13-c903-4a77-b008-2fbfd23cd58d None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:10.309777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46285d13-c903-4a77-b008-2fbfd23cd58d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:10.311873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 163/317] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:10 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:10.317496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0829430-bb34-4ee5-b799-7ee91ebeff2b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:10.377984 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:10.425091 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0829430-bb34-4ee5-b799-7ee91ebeff2b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:10.463139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77359a-53cc-405b-a2dc-0669e5f35e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:10.463804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77359a-53cc-405b-a2dc-0669e5f35e65 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:10.464119 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77359a-53cc-405b-a2dc-0669e5f35e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:10.464406 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77359a-53cc-405b-a2dc-0669e5f35e65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:10.465238 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77359a-53cc-405b-a2dc-0669e5f35e65 None admin] RBAC: Adding query filter params (role.id=acc5ad0b34094944996d5c576ed82fc9, scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce, user.id=07dcbc1802fb47019fd0628e0735c3cb) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:10.465558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77359a-53cc-405b-a2dc-0669e5f35e65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:10.466995 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77359a-53cc-405b-a2dc-0669e5f35e65 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:10.473458 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 155/318] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:10 2022] GET /identity/v3/role_assignments?user.id=07dcbc1802fb47019fd0628e0735c3cb&scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce&role.id=acc5ad0b34094944996d5c576ed82fc9 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:11.318917 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247f14-4335-47da-96cf-6954cc4e8574 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:11.319436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247f14-4335-47da-96cf-6954cc4e8574 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:11.319513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247f14-4335-47da-96cf-6954cc4e8574 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:11.321030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 164/319] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:11.326193 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e65ea2-3e74-40f0-adbc-3fcf6c6d2e6a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:11.326596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e65ea2-3e74-40f0-adbc-3fcf6c6d2e6a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:11.326754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e65ea2-3e74-40f0-adbc-3fcf6c6d2e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:11.343886 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-61e65ea2-3e74-40f0-adbc-3fcf6c6d2e6a None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:11.345080 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-61e65ea2-3e74-40f0-adbc-3fcf6c6d2e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:11.424047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 156/320] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:11.443670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247f14-4335-47da-96cf-6954cc4e8574 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:11.483383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbb623-2914-4956-8d2b-80de2c6fb073 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:11.483948 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbb623-2914-4956-8d2b-80de2c6fb073 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:11.484427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbb623-2914-4956-8d2b-80de2c6fb073 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:11.485966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 157/321] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:45:11.491747 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf144ee-4a40-4355-b3c5-8ee2051a71d3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:11.492064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf144ee-4a40-4355-b3c5-8ee2051a71d3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:11.492347 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf144ee-4a40-4355-b3c5-8ee2051a71d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:11.508977 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8bf144ee-4a40-4355-b3c5-8ee2051a71d3 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:11.510165 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8bf144ee-4a40-4355-b3c5-8ee2051a71d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:11.555718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:11.560313 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247f14-4335-47da-96cf-6954cc4e8574 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:11.578402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 158/322] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:11.597052 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf144ee-4a40-4355-b3c5-8ee2051a71d3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:11.598448 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a7f2e-3b6e-421f-9026-47b6f7c6c714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:11.599473 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a7f2e-3b6e-421f-9026-47b6f7c6c714 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:11.600607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a7f2e-3b6e-421f-9026-47b6f7c6c714 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:11.600928 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a7f2e-3b6e-421f-9026-47b6f7c6c714 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:11.609121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:11.613446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a7f2e-3b6e-421f-9026-47b6f7c6c714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:11.623916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-202a7f2e-3b6e-421f-9026-47b6f7c6c714 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:11.623916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:11.623916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:11.623916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:11.623916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:11.623916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:11.623916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:11.623916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:11.623916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:11.623916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:11.623916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:11.623916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:11.623916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:11.623916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:11.623916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:11.623916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:11.625080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:11.625080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:11.625080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:11.625080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:11.625080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:11.625080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:11.625080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:11.625080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:11.625080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:11.625080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:11.625080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:11.625080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:11.625080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:11.625080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:11.625080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:11.625080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:11.625888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:11.625888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:11.625888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:11.625888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:11.625888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:11.625888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:11.625888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:11.625888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:11.625888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:11.625888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:11.625888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:11.625888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:11.628134 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 165/323] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:11.631402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a7f2e-3b6e-421f-9026-47b6f7c6c714 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:11.706239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf144ee-4a40-4355-b3c5-8ee2051a71d3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:11.740996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a7f2e-3b6e-421f-9026-47b6f7c6c714 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:11.745197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31059a40-6021-4997-a2e9-1677f9acc8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:11.745997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31059a40-6021-4997-a2e9-1677f9acc8fa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:11.746278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31059a40-6021-4997-a2e9-1677f9acc8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:11.746611 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31059a40-6021-4997-a2e9-1677f9acc8fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:11.747767 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31059a40-6021-4997-a2e9-1677f9acc8fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:11.749234 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31059a40-6021-4997-a2e9-1677f9acc8fa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:11.751010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 159/324] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:11.756393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31059a40-6021-4997-a2e9-1677f9acc8fa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:11.776797 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378babc-7e82-4add-9da0-7f5aa605622f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:11.777721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378babc-7e82-4add-9da0-7f5aa605622f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:11.778157 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378babc-7e82-4add-9da0-7f5aa605622f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:11.778597 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378babc-7e82-4add-9da0-7f5aa605622f None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:11.779347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378babc-7e82-4add-9da0-7f5aa605622f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:11.779661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378babc-7e82-4add-9da0-7f5aa605622f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:11.781093 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378babc-7e82-4add-9da0-7f5aa605622f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:11.789546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 166/325] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:11.795013 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378babc-7e82-4add-9da0-7f5aa605622f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:11.812066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:11.857330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:11.869501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31059a40-6021-4997-a2e9-1677f9acc8fa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:11.905809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0414bb-53d0-4ca4-b772-f61065969fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:11.906062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378babc-7e82-4add-9da0-7f5aa605622f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:11.906477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0414bb-53d0-4ca4-b772-f61065969fc6 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:11.906761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0414bb-53d0-4ca4-b772-f61065969fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:11.907039 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0414bb-53d0-4ca4-b772-f61065969fc6 None admin] PATH_INFO: `/v3/groups` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:11.907729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0414bb-53d0-4ca4-b772-f61065969fc6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:11.909190 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0414bb-53d0-4ca4-b772-f61065969fc6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:11.939858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f0a58-807f-4750-bbb1-1cf3cfff059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:11.940752 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f0a58-807f-4750-bbb1-1cf3cfff059c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:11.941038 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f0a58-807f-4750-bbb1-1cf3cfff059c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:11.941316 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f0a58-807f-4750-bbb1-1cf3cfff059c None admin] PATH_INFO: `/v3/users/f208fdb967de4f52b81fe883cac71ed0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:11.942482 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f0a58-807f-4750-bbb1-1cf3cfff059c None admin] RBAC: Authorizing `identity:get_user(user_id=f208fdb967de4f52b81fe883cac71ed0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:11.944017 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f0a58-807f-4750-bbb1-1cf3cfff059c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:11.946215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 167/326] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:11 2022] GET /identity/v3/users/f208fdb967de4f52b81fe883cac71ed0 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:11.951713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f0a58-807f-4750-bbb1-1cf3cfff059c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:11.989349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 160/327] 10.222.0.50 () {60 vars in 1134 bytes} [Thu Jun 2 15:45:11 2022] POST /identity/v3/groups => generated 226 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:45:12.063818 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f0a58-807f-4750-bbb1-1cf3cfff059c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:12.092608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:12.101817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38060738-083c-400a-b646-aca483d0ba4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:12.102765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38060738-083c-400a-b646-aca483d0ba4a None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:12.103049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38060738-083c-400a-b646-aca483d0ba4a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:12.103325 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38060738-083c-400a-b646-aca483d0ba4a None admin] PATH_INFO: `/v3/system/users/f208fdb967de4f52b81fe883cac71ed0/roles/acc5ad0b34094944996d5c576ed82fc9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:12.104944 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38060738-083c-400a-b646-aca483d0ba4a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f208fdb967de4f52b81fe883cac71ed0, role_id=acc5ad0b34094944996d5c576ed82fc9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:12.106324 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38060738-083c-400a-b646-aca483d0ba4a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:12.160907 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 168/328] 10.222.0.50 () {58 vars in 1334 bytes} [Thu Jun 2 15:45:11 2022] PUT /identity/v3/system/users/f208fdb967de4f52b81fe883cac71ed0/roles/acc5ad0b34094944996d5c576ed82fc9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 15:45:12.213162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e74b14-a9d6-4761-b948-fd8ef7c2bdf7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:12.213453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e74b14-a9d6-4761-b948-fd8ef7c2bdf7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:12.213734 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e74b14-a9d6-4761-b948-fd8ef7c2bdf7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:12.215125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 161/329] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:12.221277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b9337-b2e8-4499-b0aa-f3e24ffa5e45 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:12.221571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b9337-b2e8-4499-b0aa-f3e24ffa5e45 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:12.221853 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b9337-b2e8-4499-b0aa-f3e24ffa5e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:12.240613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-be1b9337-b2e8-4499-b0aa-f3e24ffa5e45 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:12.242649 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-be1b9337-b2e8-4499-b0aa-f3e24ffa5e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:12.316916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 169/330] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:12.341360 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e74b14-a9d6-4761-b948-fd8ef7c2bdf7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:12.458518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e74b14-a9d6-4761-b948-fd8ef7c2bdf7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:12.470503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:12.499758 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65b3c9-bdee-4bf5-bf29-8770f3e64786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:12.500963 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65b3c9-bdee-4bf5-bf29-8770f3e64786 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:12.501416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65b3c9-bdee-4bf5-bf29-8770f3e64786 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:12.503298 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65b3c9-bdee-4bf5-bf29-8770f3e64786 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:12.515106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65b3c9-bdee-4bf5-bf29-8770f3e64786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:12.524161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-af65b3c9-bdee-4bf5-bf29-8770f3e64786 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:12.524161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:12.524161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:12.524161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:12.524161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:12.524161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:12.524161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:12.524161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:12.524161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:12.524161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:12.524161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:12.524161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:12.524161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:12.524161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:12.524161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:12.524161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:12.525549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:12.525549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:12.525549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:12.525549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:12.525549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:12.525549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:12.525549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:12.525549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:12.525549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:12.525549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:12.525549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:12.525549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:12.525549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:12.525549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:12.525549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:12.525549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:12.526568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:12.526568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:12.526568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:12.526568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:12.526568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:12.526568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:12.526568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:12.526568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:12.526568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:12.526568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:12.526568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:12.526568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:12.529733 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 162/331] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:12.535884 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b9337-b2e8-4499-b0aa-f3e24ffa5e45 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:12.655237 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b9337-b2e8-4499-b0aa-f3e24ffa5e45 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:12.679782 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:12.697564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65993be5-8f57-4e94-b23e-b0533ffb0b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:12.698339 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65993be5-8f57-4e94-b23e-b0533ffb0b25 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:12.698665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65993be5-8f57-4e94-b23e-b0533ffb0b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:12.698959 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65993be5-8f57-4e94-b23e-b0533ffb0b25 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:12.699721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65993be5-8f57-4e94-b23e-b0533ffb0b25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:12.700055 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65993be5-8f57-4e94-b23e-b0533ffb0b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:12.701561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65993be5-8f57-4e94-b23e-b0533ffb0b25 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:12.715792 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 170/332] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:12.719268 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65b3c9-bdee-4bf5-bf29-8770f3e64786 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:12.848659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65b3c9-bdee-4bf5-bf29-8770f3e64786 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:12.890300 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb2516-c087-435f-a68f-4f06088a342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:12.891191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb2516-c087-435f-a68f-4f06088a342f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:12.891475 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb2516-c087-435f-a68f-4f06088a342f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:12.891752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb2516-c087-435f-a68f-4f06088a342f None admin] PATH_INFO: `/v3/users/d72f6d8a43664cdc814fda1a0e4202b4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:12.893007 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb2516-c087-435f-a68f-4f06088a342f None admin] RBAC: Authorizing `identity:get_user(user_id=d72f6d8a43664cdc814fda1a0e4202b4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:12.894535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb2516-c087-435f-a68f-4f06088a342f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:12.896523 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 163/333] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:12 2022] GET /identity/v3/users/d72f6d8a43664cdc814fda1a0e4202b4 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:12.902347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65993be5-8f57-4e94-b23e-b0533ffb0b25 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:13.011481 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65993be5-8f57-4e94-b23e-b0533ffb0b25 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:13.046364 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dde8f-3792-4739-b696-ffa261fca906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:13.047025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dde8f-3792-4739-b696-ffa261fca906 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:13.047351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dde8f-3792-4739-b696-ffa261fca906 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:13.047634 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dde8f-3792-4739-b696-ffa261fca906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:13.048492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dde8f-3792-4739-b696-ffa261fca906 None admin] RBAC: Adding query filter params (role.id=6cae5979d0aa4dcca6467a7ba544d4b1, user.id=d72f6d8a43664cdc814fda1a0e4202b4, scope.system=all) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:13.048809 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dde8f-3792-4739-b696-ffa261fca906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:13.050258 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dde8f-3792-4739-b696-ffa261fca906 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:13.065153 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 171/334] 10.222.0.50 () {56 vars in 1308 bytes} [Thu Jun 2 15:45:12 2022] GET /identity/v3/role_assignments?user.id=d72f6d8a43664cdc814fda1a0e4202b4&scope.system=all&role.id=6cae5979d0aa4dcca6467a7ba544d4b1 => generated 510 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:14.718700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161cb24-c409-4913-b3e1-1fa1f952a6d1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:14.719219 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161cb24-c409-4913-b3e1-1fa1f952a6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:14.719219 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161cb24-c409-4913-b3e1-1fa1f952a6d1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:14.720848 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 164/335] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:14.726756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91608562-49aa-4012-af78-503a6f48ae23 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:14.727616 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91608562-49aa-4012-af78-503a6f48ae23 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:14.728180 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91608562-49aa-4012-af78-503a6f48ae23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:14.748882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-91608562-49aa-4012-af78-503a6f48ae23 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:14.750431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-91608562-49aa-4012-af78-503a6f48ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:14.797143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:14.834490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 172/336] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:14.877552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161cb24-c409-4913-b3e1-1fa1f952a6d1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:14.927791 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:14.997786 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161cb24-c409-4913-b3e1-1fa1f952a6d1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:15.042399 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627943b7-4e0a-421c-8dd2-6cc2a9557978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:15.043195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627943b7-4e0a-421c-8dd2-6cc2a9557978 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:15.043480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627943b7-4e0a-421c-8dd2-6cc2a9557978 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:15.043757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627943b7-4e0a-421c-8dd2-6cc2a9557978 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:15.058694 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627943b7-4e0a-421c-8dd2-6cc2a9557978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:15.066451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-627943b7-4e0a-421c-8dd2-6cc2a9557978 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:15.066451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:15.066451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:15.066451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:15.066451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:15.066451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:15.066451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:15.066451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:15.066451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:15.066451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:15.066451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:15.066451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:15.066451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:15.066451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:15.066451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:15.066451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:15.067383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:15.067383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:15.067383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:15.067383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:15.067383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:15.067383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:15.067383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:15.067383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:15.067383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:15.067383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:15.067383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:15.067383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:15.067383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:15.067383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:15.067383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:15.067383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:15.068248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:15.068248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:15.068248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:15.068248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:15.068248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:15.068248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:15.068248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:15.068248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:15.068248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:15.068248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:15.068248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 15:45:15.068248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:15.072093 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 165/337] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:15.073766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91608562-49aa-4012-af78-503a6f48ae23 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:15.194574 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91608562-49aa-4012-af78-503a6f48ae23 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:15.242159 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe422f-6583-45cf-8376-d1ed6aeb459e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:15.243199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe422f-6583-45cf-8376-d1ed6aeb459e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:15.243704 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe422f-6583-45cf-8376-d1ed6aeb459e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:15.244214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe422f-6583-45cf-8376-d1ed6aeb459e None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:15.245179 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe422f-6583-45cf-8376-d1ed6aeb459e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:15.245718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe422f-6583-45cf-8376-d1ed6aeb459e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:15.247304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe422f-6583-45cf-8376-d1ed6aeb459e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:15.260424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 173/338] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:15.265625 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627943b7-4e0a-421c-8dd2-6cc2a9557978 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:15.300451 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256333ff-de5b-4bf6-88cb-cc08ea5d5858 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:15.301238 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256333ff-de5b-4bf6-88cb-cc08ea5d5858 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:15.301739 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256333ff-de5b-4bf6-88cb-cc08ea5d5858 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:15.303891 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 174/339] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:45:15.308642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a7d47-a54a-4694-a0b6-e61425d5e0a6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:15.309166 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a7d47-a54a-4694-a0b6-e61425d5e0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:15.309646 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a7d47-a54a-4694-a0b6-e61425d5e0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:15.332581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-244a7d47-a54a-4694-a0b6-e61425d5e0a6 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:15.334126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-244a7d47-a54a-4694-a0b6-e61425d5e0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:15.388383 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:15.428586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 175/340] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:15.468348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a7d47-a54a-4694-a0b6-e61425d5e0a6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:15.473185 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:15.479174 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627943b7-4e0a-421c-8dd2-6cc2a9557978 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:15.528898 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd155f0-62d9-44ca-b57f-03e58d728739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:15.529730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd155f0-62d9-44ca-b57f-03e58d728739 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:15.530023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd155f0-62d9-44ca-b57f-03e58d728739 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:15.530308 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd155f0-62d9-44ca-b57f-03e58d728739 None admin] PATH_INFO: `/v3/users/f208fdb967de4f52b81fe883cac71ed0` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:15.531645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd155f0-62d9-44ca-b57f-03e58d728739 None admin] RBAC: Authorizing `identity:get_user(user_id=f208fdb967de4f52b81fe883cac71ed0)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:15.533110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd155f0-62d9-44ca-b57f-03e58d728739 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:15.535107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 166/341] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:45:15 2022] GET /identity/v3/users/f208fdb967de4f52b81fe883cac71ed0 => generated 293 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:15.540978 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd155f0-62d9-44ca-b57f-03e58d728739 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:15.667162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd155f0-62d9-44ca-b57f-03e58d728739 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:15.685951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a7d47-a54a-4694-a0b6-e61425d5e0a6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:15.738511 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43810a98-8d75-42de-8370-91d994c2c9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:15.739177 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43810a98-8d75-42de-8370-91d994c2c9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:15.739450 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43810a98-8d75-42de-8370-91d994c2c9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:15.739729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43810a98-8d75-42de-8370-91d994c2c9d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:15.740589 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43810a98-8d75-42de-8370-91d994c2c9d1 None admin] RBAC: Adding query filter params (role.id=acc5ad0b34094944996d5c576ed82fc9, user.id=f208fdb967de4f52b81fe883cac71ed0, scope.system=all) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:15.740907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43810a98-8d75-42de-8370-91d994c2c9d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:15.742648 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43810a98-8d75-42de-8370-91d994c2c9d1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:15.751434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c949750-24a2-4ebf-a066-12df4b714c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:15.752288 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c949750-24a2-4ebf-a066-12df4b714c0e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:15.752575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c949750-24a2-4ebf-a066-12df4b714c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:15.752851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c949750-24a2-4ebf-a066-12df4b714c0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:15.769117 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 167/342] 10.222.0.50 () {56 vars in 1308 bytes} [Thu Jun 2 15:45:15 2022] GET /identity/v3/role_assignments?user.id=f208fdb967de4f52b81fe883cac71ed0&scope.system=all&role.id=acc5ad0b34094944996d5c576ed82fc9 => generated 510 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:15.773283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb5d7e-6fe0-4141-8221-89a3347c1408 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:15.773585 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb5d7e-6fe0-4141-8221-89a3347c1408 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:15.773869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb5d7e-6fe0-4141-8221-89a3347c1408 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:15.775446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 168/343] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:15.777532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c949750-24a2-4ebf-a066-12df4b714c0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:15.786109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0c949750-24a2-4ebf-a066-12df4b714c0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:15.786109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:15.786109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:15.786109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:15.786109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:15.786109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:15.786109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:15.786109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:15.786109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:15.786109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:15.786109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:15.786109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:15.786109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:15.786109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:15.786109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:15.786109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:15.787046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:15.787046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:15.787046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:15.787046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:15.787046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:15.787046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:15.787046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:15.787046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:15.787046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:15.787046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:15.787046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:15.787046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:15.787046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:15.787046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:15.787046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:15.787046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:15.789502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:15.789502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:15.789502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:15.789502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:15.789502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:15.789502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:15.789502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:15.789502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:15.789502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:15.789502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:15.789502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:15.789502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:15.789502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 176/344] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:45:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:15.790167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2bed7-fa3c-4572-aff4-a3598b002d80 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:15.790167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2bed7-fa3c-4572-aff4-a3598b002d80 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:15.790167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2bed7-fa3c-4572-aff4-a3598b002d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:15.797907 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c949750-24a2-4ebf-a066-12df4b714c0e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:15.820500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-82b2bed7-fa3c-4572-aff4-a3598b002d80 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:15.821691 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-82b2bed7-fa3c-4572-aff4-a3598b002d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:15.827180 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:15.846585 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:15.904047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 169/345] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:15.918663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c949750-24a2-4ebf-a066-12df4b714c0e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:15.947707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2bed7-fa3c-4572-aff4-a3598b002d80 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:15.959580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d1390-4b76-4769-942f-f11cbb7d3968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:15.960850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d1390-4b76-4769-942f-f11cbb7d3968 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:15.961144 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d1390-4b76-4769-942f-f11cbb7d3968 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:15.961420 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d1390-4b76-4769-942f-f11cbb7d3968 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:15.962177 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d1390-4b76-4769-942f-f11cbb7d3968 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:15.962493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d1390-4b76-4769-942f-f11cbb7d3968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:15.963902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d1390-4b76-4769-942f-f11cbb7d3968 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:15.973575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 177/346] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:15.979633 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d1390-4b76-4769-942f-f11cbb7d3968 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:16.066373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2bed7-fa3c-4572-aff4-a3598b002d80 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:16.077619 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:16.095336 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d1390-4b76-4769-942f-f11cbb7d3968 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:16.108997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de51a79-65e7-414b-8719-26a32f48e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:16.109808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51a79-65e7-414b-8719-26a32f48e551 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:16.110092 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51a79-65e7-414b-8719-26a32f48e551 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:16.110372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51a79-65e7-414b-8719-26a32f48e551 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:16.124567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de51a79-65e7-414b-8719-26a32f48e551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:16.133727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9de51a79-65e7-414b-8719-26a32f48e551 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:16.133727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:16.133727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:16.133727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:16.133727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:16.133727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:16.133727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:16.133727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:16.133727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:16.133727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:16.133727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:16.133727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:16.133727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:16.133727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:16.133727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:16.133727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:16.135779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:16.135779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:16.135779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:16.135779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:16.135779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:16.135779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:16.135779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:16.135779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:16.135779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:16.135779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:16.135779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:16.135779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:16.135779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:16.135779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:16.135779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:16.135779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:16.137719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:16.137719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:16.137719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:16.137719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:16.137719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:16.137719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:16.137719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:16.137719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:16.137719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:16.137719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:16.137719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:16.137719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:16.137719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 170/347] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:16.139516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429421-7e1a-44f0-a53e-38b9e6a03e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:16.139516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429421-7e1a-44f0-a53e-38b9e6a03e4d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:16.139516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429421-7e1a-44f0-a53e-38b9e6a03e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:16.139945 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa705b-2756-407c-ae17-aa378c84632f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:16.144229 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429421-7e1a-44f0-a53e-38b9e6a03e4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:16.144396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa705b-2756-407c-ae17-aa378c84632f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:16.144396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa705b-2756-407c-ae17-aa378c84632f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:16.144396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 171/348] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:16.152253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9b2fc-b7ae-41e1-b7aa-fb3c364bdf6d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:16.152546 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9b2fc-b7ae-41e1-b7aa-fb3c364bdf6d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:16.152832 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9b2fc-b7ae-41e1-b7aa-fb3c364bdf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:16.192910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0cc9b2fc-b7ae-41e1-b7aa-fb3c364bdf6d None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:16.195365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0cc9b2fc-b7ae-41e1-b7aa-fb3c364bdf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:16.212065 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:16.212285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0429421-7e1a-44f0-a53e-38b9e6a03e4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:16.213601 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0429421-7e1a-44f0-a53e-38b9e6a03e4d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:16.297235 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 172/349] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:16.298122 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9b2fc-b7ae-41e1-b7aa-fb3c364bdf6d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:16.341770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:16.363434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 178/350] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 15:45:16.364653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429421-7e1a-44f0-a53e-38b9e6a03e4d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:16.439401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9b2fc-b7ae-41e1-b7aa-fb3c364bdf6d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:16.493934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c6a0-9521-4e93-8421-1425c695b1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:16.495028 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c6a0-9521-4e93-8421-1425c695b1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:16.495458 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c6a0-9521-4e93-8421-1425c695b1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:16.495830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0c6a0-9521-4e93-8421-1425c695b1b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:16.496294 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429421-7e1a-44f0-a53e-38b9e6a03e4d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:16.496791 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0c6a0-9521-4e93-8421-1425c695b1b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:16.497199 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0c6a0-9521-4e93-8421-1425c695b1b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:16.499899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0c6a0-9521-4e93-8421-1425c695b1b7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:16.510807 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 173/351] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:16.511918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c6a0-9521-4e93-8421-1425c695b1b7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:16.527245 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:16.555589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab650b6-f354-4870-8f3a-37a2404511aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:16.556820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab650b6-f354-4870-8f3a-37a2404511aa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:16.557219 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab650b6-f354-4870-8f3a-37a2404511aa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:16.557660 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab650b6-f354-4870-8f3a-37a2404511aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:16.571675 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab650b6-f354-4870-8f3a-37a2404511aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:16.582121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fab650b6-f354-4870-8f3a-37a2404511aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:16.582121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:16.582121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:16.582121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:16.582121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:16.582121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:16.582121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:16.582121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:16.582121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:16.582121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:16.582121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:16.582121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:16.582121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:16.582121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:16.582121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:16.582121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:16.583253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:16.583253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:16.583253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:16.583253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:16.583253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:16.583253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:16.583253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:16.583253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:16.583253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:16.583253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:16.583253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:16.583253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:16.583253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:16.583253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:16.583253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:16.583253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:16.584264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:16.584264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:16.584264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:16.584264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:16.584264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:16.584264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:16.584264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:16.584264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:16.584264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:16.584264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:16.584264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:16.584264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:16.586716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 179/352] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:16.587668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab650b6-f354-4870-8f3a-37a2404511aa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:16.629375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0c6a0-9521-4e93-8421-1425c695b1b7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:16.643827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:16.670320 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ffbdc-f16e-4861-8ec6-00ca1779021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:16.671221 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ffbdc-f16e-4861-8ec6-00ca1779021d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:16.671507 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ffbdc-f16e-4861-8ec6-00ca1779021d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:16.671785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ffbdc-f16e-4861-8ec6-00ca1779021d None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:16.673180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ffbdc-f16e-4861-8ec6-00ca1779021d None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:16.674852 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ffbdc-f16e-4861-8ec6-00ca1779021d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:16.677035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 174/353] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:16 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:16.677965 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ffbdc-f16e-4861-8ec6-00ca1779021d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:16.706999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab650b6-f354-4870-8f3a-37a2404511aa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:16.748120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fc22c-3bac-421a-aa2a-42943d136c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:16.749708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fc22c-3bac-421a-aa2a-42943d136c00 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:16.750152 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fc22c-3bac-421a-aa2a-42943d136c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:16.750812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fc22c-3bac-421a-aa2a-42943d136c00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:16.771025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:16.800801 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ffbdc-f16e-4861-8ec6-00ca1779021d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:16.845570 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c796eb6-7f89-4a89-b895-067eb3b51aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:16.846354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c796eb6-7f89-4a89-b895-067eb3b51aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:16.846714 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c796eb6-7f89-4a89-b895-067eb3b51aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:16.847327 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c796eb6-7f89-4a89-b895-067eb3b51aa1 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:16.848222 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c796eb6-7f89-4a89-b895-067eb3b51aa1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:16.849269 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c796eb6-7f89-4a89-b895-067eb3b51aa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:16.851579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c796eb6-7f89-4a89-b895-067eb3b51aa1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:16.852174 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fc22c-3bac-421a-aa2a-42943d136c00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:16.855248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fc22c-3bac-421a-aa2a-42943d136c00 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:16.867422 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 175/354] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:16.868425 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c796eb6-7f89-4a89-b895-067eb3b51aa1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:16.933692 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:16.995324 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 180/355] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:17.000017 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fc22c-3bac-421a-aa2a-42943d136c00 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:17.026751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c796eb6-7f89-4a89-b895-067eb3b51aa1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:17.077395 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9cb40-9664-4c57-b814-a6a90a9134dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:17.078861 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9cb40-9664-4c57-b814-a6a90a9134dc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:17.079479 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9cb40-9664-4c57-b814-a6a90a9134dc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:17.079767 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9cb40-9664-4c57-b814-a6a90a9134dc None admin] PATH_INFO: `/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:17.086059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:17.089682 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9cb40-9664-4c57-b814-a6a90a9134dc None admin] RBAC: Authorizing `identity:get_group(group_id=62edd6e447ab4817bba5ad2bcd36c1b3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:17.091135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9cb40-9664-4c57-b814-a6a90a9134dc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:17.093463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 176/356] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:16 2022] GET /identity/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:17.100622 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9cb40-9664-4c57-b814-a6a90a9134dc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:17.149836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fc22c-3bac-421a-aa2a-42943d136c00 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:17.193246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbf1d5-a544-4b01-9702-50823d3f274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:17.194243 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf1d5-a544-4b01-9702-50823d3f274d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:17.194561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf1d5-a544-4b01-9702-50823d3f274d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:17.195375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf1d5-a544-4b01-9702-50823d3f274d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:17.213221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:17.214090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9cb40-9664-4c57-b814-a6a90a9134dc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:17.258568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd1bbf-ba68-4ad0-b18b-30943968ee90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:17.259442 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd1bbf-ba68-4ad0-b18b-30943968ee90 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:17.259733 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd1bbf-ba68-4ad0-b18b-30943968ee90 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:17.260050 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd1bbf-ba68-4ad0-b18b-30943968ee90 None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:17.261277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd1bbf-ba68-4ad0-b18b-30943968ee90 None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:17.262746 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd1bbf-ba68-4ad0-b18b-30943968ee90 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:17.264528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 177/357] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:17 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:17.265858 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d66c1b-bd04-4d19-86f8-d92eab69b1cc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:17.266150 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d66c1b-bd04-4d19-86f8-d92eab69b1cc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:17.266436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d66c1b-bd04-4d19-86f8-d92eab69b1cc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:17.267797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 178/358] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:17.268492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d66c1b-bd04-4d19-86f8-d92eab69b1cc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:17.282816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbf1d5-a544-4b01-9702-50823d3f274d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:17.284333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbf1d5-a544-4b01-9702-50823d3f274d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:17.345899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:17.396649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d66c1b-bd04-4d19-86f8-d92eab69b1cc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:17.410797 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 181/359] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:17.412379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1393ac-6421-4563-8daa-a65175bf34e3 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:17.412685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1393ac-6421-4563-8daa-a65175bf34e3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:17.412971 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1393ac-6421-4563-8daa-a65175bf34e3 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:17.414440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 182/360] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:17.416793 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1393ac-6421-4563-8daa-a65175bf34e3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:17.441949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c6abc-df7c-43b0-b088-70dcecf7ac94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:17.443056 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6abc-df7c-43b0-b088-70dcecf7ac94 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:17.444075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6abc-df7c-43b0-b088-70dcecf7ac94 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:17.444075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c6abc-df7c-43b0-b088-70dcecf7ac94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:17.444582 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c6abc-df7c-43b0-b088-70dcecf7ac94 None admin] RBAC: Adding query filter params (group.id=62edd6e447ab4817bba5ad2bcd36c1b3, role.id=f9b113934dbd49218d427f6cacaabf8f, scope.project.id=eb120c9c3572435a8113ca1e458046c4) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:17.445476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c6abc-df7c-43b0-b088-70dcecf7ac94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:17.446935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c6abc-df7c-43b0-b088-70dcecf7ac94 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:17.453259 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 179/361] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Jun 2 15:45:17 2022] GET /identity/v3/role_assignments?group.id=62edd6e447ab4817bba5ad2bcd36c1b3&scope.project.id=eb120c9c3572435a8113ca1e458046c4&role.id=f9b113934dbd49218d427f6cacaabf8f => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:17.454495 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1eb78-72f4-43e3-af16-fb474554f8a6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:17.454795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1eb78-72f4-43e3-af16-fb474554f8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:17.455081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1eb78-72f4-43e3-af16-fb474554f8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:17.478783 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:17.483795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bae1eb78-72f4-43e3-af16-fb474554f8a6 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:17.485184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bae1eb78-72f4-43e3-af16-fb474554f8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:17.550510 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1393ac-6421-4563-8daa-a65175bf34e3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:17.574491 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 180/362] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:17.575375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1eb78-72f4-43e3-af16-fb474554f8a6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:17.602841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3a32e-c5bb-4ba4-aea1-527fd134590b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:17.603738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3a32e-c5bb-4ba4-aea1-527fd134590b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:17.604054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3a32e-c5bb-4ba4-aea1-527fd134590b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:17.604342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3a32e-c5bb-4ba4-aea1-527fd134590b None admin] PATH_INFO: `/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:17.605602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3a32e-c5bb-4ba4-aea1-527fd134590b None admin] RBAC: Authorizing `identity:get_group(group_id=62edd6e447ab4817bba5ad2bcd36c1b3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:17.607777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3a32e-c5bb-4ba4-aea1-527fd134590b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:17.609925 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 183/363] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:17 2022] GET /identity/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:17.613500 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc0b49-7bc5-44ad-9666-155f1560eff0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:17.613687 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc0b49-7bc5-44ad-9666-155f1560eff0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:17.613878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc0b49-7bc5-44ad-9666-155f1560eff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:17.636999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cffc0b49-7bc5-44ad-9666-155f1560eff0 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:17.640837 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cffc0b49-7bc5-44ad-9666-155f1560eff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:17.661765 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:17.714264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1eb78-72f4-43e3-af16-fb474554f8a6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:17.732507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 184/364] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:17.732507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc0b49-7bc5-44ad-9666-155f1560eff0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:17.772151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c62e8b-2dbf-40cd-a1e6-84809caf2c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:17.773938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c62e8b-2dbf-40cd-a1e6-84809caf2c41 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:17.774408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c62e8b-2dbf-40cd-a1e6-84809caf2c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:17.774866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c62e8b-2dbf-40cd-a1e6-84809caf2c41 None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:17.776804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c62e8b-2dbf-40cd-a1e6-84809caf2c41 None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:17.778600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c62e8b-2dbf-40cd-a1e6-84809caf2c41 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:17.784022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 181/365] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:17 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:17.784022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c62e8b-2dbf-40cd-a1e6-84809caf2c41 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:17.799504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:17.871108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc0b49-7bc5-44ad-9666-155f1560eff0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:17.914115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c62e8b-2dbf-40cd-a1e6-84809caf2c41 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:17.919368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82b584-5041-4cb9-88a9-5fe0859f7d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:17.920250 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82b584-5041-4cb9-88a9-5fe0859f7d98 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:17.920539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82b584-5041-4cb9-88a9-5fe0859f7d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:17.920811 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82b584-5041-4cb9-88a9-5fe0859f7d98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:17.936593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82b584-5041-4cb9-88a9-5fe0859f7d98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:17.946100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-dd82b584-5041-4cb9-88a9-5fe0859f7d98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:17.946100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:17.946100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:17.946100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:17.946100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:17.946100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:17.946100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:17.946100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:17.946100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:17.946100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:17.946100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:17.946100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:17.946100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:17.946100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:17.946100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:17.946100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:17.947046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:17.947046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:17.947046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:17.947046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:17.947046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:17.947046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:17.947046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:17.947046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:17.947046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:17.947046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:17.947046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:17.947046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:17.947046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:17.947046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:17.947046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:17.947046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:17.947852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:17.947852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:17.947852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:17.947852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:17.947852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:17.947852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:17.947852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:17.947852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:17.947852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:17.947852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:17.947852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:17.947852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:17.949958 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 185/366] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:45:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:17.950140 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82b584-5041-4cb9-88a9-5fe0859f7d98 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:17.954839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:17.964460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cf5c4-c00c-45ab-a350-2ead06df1624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:17.965068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cf5c4-c00c-45ab-a350-2ead06df1624 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:17.965660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cf5c4-c00c-45ab-a350-2ead06df1624 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:17.965960 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cf5c4-c00c-45ab-a350-2ead06df1624 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:17.967110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cf5c4-c00c-45ab-a350-2ead06df1624 None admin] RBAC: Adding query filter params (group.id=62edd6e447ab4817bba5ad2bcd36c1b3, role.id=6cae5979d0aa4dcca6467a7ba544d4b1, scope.project.id=eb120c9c3572435a8113ca1e458046c4) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:17.967430 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cf5c4-c00c-45ab-a350-2ead06df1624 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:17.969455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cf5c4-c00c-45ab-a350-2ead06df1624 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:17.977110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 182/367] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Jun 2 15:45:17 2022] GET /identity/v3/role_assignments?group.id=62edd6e447ab4817bba5ad2bcd36c1b3&scope.project.id=eb120c9c3572435a8113ca1e458046c4&role.id=6cae5979d0aa4dcca6467a7ba544d4b1 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:17.978879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cf5c4-c00c-45ab-a350-2ead06df1624 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:18.093841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82b584-5041-4cb9-88a9-5fe0859f7d98 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:18.119456 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:18.126908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cf5c4-c00c-45ab-a350-2ead06df1624 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:18.132901 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498979a-e7c2-4b06-a38e-47e8f61594f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:18.138846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498979a-e7c2-4b06-a38e-47e8f61594f6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:18.138846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498979a-e7c2-4b06-a38e-47e8f61594f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:18.138846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498979a-e7c2-4b06-a38e-47e8f61594f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:18.147189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498979a-e7c2-4b06-a38e-47e8f61594f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:18.156231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9498979a-e7c2-4b06-a38e-47e8f61594f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:18.156231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:18.156231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:18.156231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:18.156231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:18.156231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:18.156231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:18.156231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:18.156231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:18.156231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:18.156231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:18.156231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:18.156231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:18.156231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:18.156231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:18.156231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:18.157198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:18.157198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:18.157198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:18.157198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:18.157198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:18.157198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:18.157198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:18.157198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:18.157198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:18.157198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:18.157198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:18.157198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:18.157198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:18.157198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:18.157198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:18.157198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:18.158008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:18.158008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:18.158008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:18.158008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:18.158008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:18.158008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:18.158008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:18.158008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:18.158008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:18.158008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:18.158008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:18.158008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:18.158008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 186/368] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:18.158684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498979a-e7c2-4b06-a38e-47e8f61594f6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:18.171461 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd3a55-6542-428b-9a1b-287c0d96fb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:18.172628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd3a55-6542-428b-9a1b-287c0d96fb04 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:18.173126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd3a55-6542-428b-9a1b-287c0d96fb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:18.173599 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd3a55-6542-428b-9a1b-287c0d96fb04 None admin] PATH_INFO: `/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:18.175225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd3a55-6542-428b-9a1b-287c0d96fb04 None admin] RBAC: Authorizing `identity:get_group(group_id=62edd6e447ab4817bba5ad2bcd36c1b3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:18.176923 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd3a55-6542-428b-9a1b-287c0d96fb04 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:18.179636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 183/369] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:17 2022] GET /identity/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:18.180816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd3a55-6542-428b-9a1b-287c0d96fb04 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:18.267847 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:18.286451 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498979a-e7c2-4b06-a38e-47e8f61594f6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:18.323903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd3a55-6542-428b-9a1b-287c0d96fb04 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:18.325682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0a372-aa6f-439b-828c-4e97917e387c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:18.326362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a372-aa6f-439b-828c-4e97917e387c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:18.326713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a372-aa6f-439b-828c-4e97917e387c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:18.326995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0a372-aa6f-439b-828c-4e97917e387c None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:18.328374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0a372-aa6f-439b-828c-4e97917e387c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:18.328698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0a372-aa6f-439b-828c-4e97917e387c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:18.330115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0a372-aa6f-439b-828c-4e97917e387c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:18.341001 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 187/370] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:18.341844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0a372-aa6f-439b-828c-4e97917e387c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:18.374718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4fab6-798a-436e-a45c-b78aa4b03ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:18.375508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:18.376316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4fab6-798a-436e-a45c-b78aa4b03ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:18.376682 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4fab6-798a-436e-a45c-b78aa4b03ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:18.376972 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4fab6-798a-436e-a45c-b78aa4b03ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:18.378068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4fab6-798a-436e-a45c-b78aa4b03ee8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:18.378656 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4fab6-798a-436e-a45c-b78aa4b03ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:18.380223 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4fab6-798a-436e-a45c-b78aa4b03ee8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:18.392146 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 184/371] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:18.393398 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4fab6-798a-436e-a45c-b78aa4b03ee8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:18.456707 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0a372-aa6f-439b-828c-4e97917e387c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:18.500123 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eaf9d-641b-4bf1-915e-f9b07d6de0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:18.501154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eaf9d-641b-4bf1-915e-f9b07d6de0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:18.501692 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eaf9d-641b-4bf1-915e-f9b07d6de0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:18.502181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eaf9d-641b-4bf1-915e-f9b07d6de0a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:18.503215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eaf9d-641b-4bf1-915e-f9b07d6de0a5 None admin] RBAC: Adding query filter params (group.id=62edd6e447ab4817bba5ad2bcd36c1b3, role.id=6cae5979d0aa4dcca6467a7ba544d4b1, scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:18.503761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eaf9d-641b-4bf1-915e-f9b07d6de0a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:18.505444 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eaf9d-641b-4bf1-915e-f9b07d6de0a5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:18.512054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 188/372] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Jun 2 15:45:18 2022] GET /identity/v3/role_assignments?group.id=62edd6e447ab4817bba5ad2bcd36c1b3&scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce&role.id=6cae5979d0aa4dcca6467a7ba544d4b1 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:18.513107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eaf9d-641b-4bf1-915e-f9b07d6de0a5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:18.524447 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4fab6-798a-436e-a45c-b78aa4b03ee8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:18.554341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:18.567691 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749bb76-ecea-4244-ab04-5a9f26a9a270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:18.568445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749bb76-ecea-4244-ab04-5a9f26a9a270 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:18.568733 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749bb76-ecea-4244-ab04-5a9f26a9a270 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:18.569016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749bb76-ecea-4244-ab04-5a9f26a9a270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:18.655458 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749bb76-ecea-4244-ab04-5a9f26a9a270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:18.657117 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749bb76-ecea-4244-ab04-5a9f26a9a270 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:18.750049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:18.772014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eaf9d-641b-4bf1-915e-f9b07d6de0a5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:18.783862 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 185/373] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:18.790432 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749bb76-ecea-4244-ab04-5a9f26a9a270 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:18.820134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:18.846347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f732356-744a-4f18-a12d-30bde5ce6cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:18.847392 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f732356-744a-4f18-a12d-30bde5ce6cae None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:18.847897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f732356-744a-4f18-a12d-30bde5ce6cae None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:18.848425 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f732356-744a-4f18-a12d-30bde5ce6cae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:18.913097 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749bb76-ecea-4244-ab04-5a9f26a9a270 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:18.952540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bac95c-8d0b-4a25-8dad-59c51b0614d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:18.953545 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac95c-8d0b-4a25-8dad-59c51b0614d3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:18.955199 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac95c-8d0b-4a25-8dad-59c51b0614d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:18.955516 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac95c-8d0b-4a25-8dad-59c51b0614d3 None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:18.957067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bac95c-8d0b-4a25-8dad-59c51b0614d3 None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:18.959504 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bac95c-8d0b-4a25-8dad-59c51b0614d3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:18.962926 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 186/374] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:18 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:18.969605 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bac95c-8d0b-4a25-8dad-59c51b0614d3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:19.028493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f732356-744a-4f18-a12d-30bde5ce6cae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:19.030648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f732356-744a-4f18-a12d-30bde5ce6cae None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:19.072389 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:19.082873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bac95c-8d0b-4a25-8dad-59c51b0614d3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:19.121262 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb110de-2875-45a2-a187-a88280eaa757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:19.122383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb110de-2875-45a2-a187-a88280eaa757 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.122970 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb110de-2875-45a2-a187-a88280eaa757 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.123405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb110de-2875-45a2-a187-a88280eaa757 None admin] PATH_INFO: `/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.126450 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb110de-2875-45a2-a187-a88280eaa757 None admin] RBAC: Authorizing `identity:get_group(group_id=62edd6e447ab4817bba5ad2bcd36c1b3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:19.128103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb110de-2875-45a2-a187-a88280eaa757 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:19.130620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 187/375] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:18 2022] GET /identity/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:19.137581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb110de-2875-45a2-a187-a88280eaa757 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:19.255459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb110de-2875-45a2-a187-a88280eaa757 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:19.259472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:19.282485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 189/376] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:19.288992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f732356-744a-4f18-a12d-30bde5ce6cae None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:19.302039 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c902bc-5150-45bb-880e-62720dc1e1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:19.302963 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c902bc-5150-45bb-880e-62720dc1e1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.303390 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c902bc-5150-45bb-880e-62720dc1e1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.303809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c902bc-5150-45bb-880e-62720dc1e1d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.305380 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c902bc-5150-45bb-880e-62720dc1e1d9 None admin] RBAC: Adding query filter params (group.id=62edd6e447ab4817bba5ad2bcd36c1b3, role.id=f9b113934dbd49218d427f6cacaabf8f, scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:19.305844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c902bc-5150-45bb-880e-62720dc1e1d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:19.307445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c902bc-5150-45bb-880e-62720dc1e1d9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:19.317988 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 188/377] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Jun 2 15:45:19 2022] GET /identity/v3/role_assignments?group.id=62edd6e447ab4817bba5ad2bcd36c1b3&scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce&role.id=f9b113934dbd49218d427f6cacaabf8f => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:19.416037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f732356-744a-4f18-a12d-30bde5ce6cae None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:19.456298 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806dc72-5c49-47b0-8ce3-eae2dd530b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:19.457174 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806dc72-5c49-47b0-8ce3-eae2dd530b0b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.457462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806dc72-5c49-47b0-8ce3-eae2dd530b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.457744 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806dc72-5c49-47b0-8ce3-eae2dd530b0b None admin] PATH_INFO: `/v3/projects/6cbd1e15210e404da74f1144aa119ef8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.458964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806dc72-5c49-47b0-8ce3-eae2dd530b0b None admin] RBAC: Authorizing `identity:get_project(project_id=6cbd1e15210e404da74f1144aa119ef8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:19.461006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806dc72-5c49-47b0-8ce3-eae2dd530b0b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:19.462735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 190/378] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:19 2022] GET /identity/v3/projects/6cbd1e15210e404da74f1144aa119ef8 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:19.469090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c902bc-5150-45bb-880e-62720dc1e1d9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:19.513722 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:19.608460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c902bc-5150-45bb-880e-62720dc1e1d9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:19.645415 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9026e-5d4f-4a9b-b2e2-1add09b6a251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:19.646631 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9026e-5d4f-4a9b-b2e2-1add09b6a251 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.647113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9026e-5d4f-4a9b-b2e2-1add09b6a251 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.647584 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9026e-5d4f-4a9b-b2e2-1add09b6a251 None admin] PATH_INFO: `/v3/groups/28948219b4f94d639cb64bdc8125d4f5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.653246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9026e-5d4f-4a9b-b2e2-1add09b6a251 None admin] RBAC: Authorizing `identity:get_group(group_id=28948219b4f94d639cb64bdc8125d4f5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:19.655075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9026e-5d4f-4a9b-b2e2-1add09b6a251 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:19.657461 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 189/379] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:19 2022] GET /identity/v3/groups/28948219b4f94d639cb64bdc8125d4f5 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:19.663462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806dc72-5c49-47b0-8ce3-eae2dd530b0b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:19.755223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:19.811205 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806dc72-5c49-47b0-8ce3-eae2dd530b0b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:19.849408 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e4cec-cbd4-4b94-91f2-415c68ae42c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:19.850073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e4cec-cbd4-4b94-91f2-415c68ae42c4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:19.850363 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e4cec-cbd4-4b94-91f2-415c68ae42c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:19.850645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e4cec-cbd4-4b94-91f2-415c68ae42c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:19.852036 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e4cec-cbd4-4b94-91f2-415c68ae42c4 None admin] RBAC: Adding query filter params (group.id=28948219b4f94d639cb64bdc8125d4f5, role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=6cbd1e15210e404da74f1144aa119ef8) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:19.852360 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e4cec-cbd4-4b94-91f2-415c68ae42c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:19.853795 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e4cec-cbd4-4b94-91f2-415c68ae42c4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:19.859409 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 191/380] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Jun 2 15:45:19 2022] GET /identity/v3/role_assignments?group.id=28948219b4f94d639cb64bdc8125d4f5&scope.project.id=6cbd1e15210e404da74f1144aa119ef8&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:20.077930 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988aece-dd6b-413a-a155-856e09f93662 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.078424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988aece-dd6b-413a-a155-856e09f93662 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.078498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988aece-dd6b-413a-a155-856e09f93662 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.080023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 190/381] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:20.085861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566c84b-205c-4fbf-aaed-8159ab5d64ad None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.086339 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566c84b-205c-4fbf-aaed-8159ab5d64ad None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.086413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566c84b-205c-4fbf-aaed-8159ab5d64ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.105795 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e566c84b-205c-4fbf-aaed-8159ab5d64ad None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:20.107015 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e566c84b-205c-4fbf-aaed-8159ab5d64ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:20.192546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 192/382] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:20.234298 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988aece-dd6b-413a-a155-856e09f93662 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:20.385968 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:20.397731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988aece-dd6b-413a-a155-856e09f93662 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:20.451433 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06970121-3c99-4a9b-8045-fee6427afad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:20.452299 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06970121-3c99-4a9b-8045-fee6427afad9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.452584 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06970121-3c99-4a9b-8045-fee6427afad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.452861 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06970121-3c99-4a9b-8045-fee6427afad9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.469425 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06970121-3c99-4a9b-8045-fee6427afad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:20.478217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-06970121-3c99-4a9b-8045-fee6427afad9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:20.478217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:20.478217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:20.478217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:20.478217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:20.478217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:20.478217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:20.478217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:20.478217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:20.478217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:20.478217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:20.478217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:20.478217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:20.478217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:20.478217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:20.478217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:20.479118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:20.479118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:20.479118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:20.479118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:20.479118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:20.479118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:20.479118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:20.479118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:20.479118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:20.479118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:20.479118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:20.479118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:20.479118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:20.479118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:20.479118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:20.479118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:20.479959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:20.479959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:20.479959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:20.479959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:20.479959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:20.479959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:20.479959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:20.479959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:20.479959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:20.479959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:20.479959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:20.479959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:20.479959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 191/383] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:45:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:20.487076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566c84b-205c-4fbf-aaed-8159ab5d64ad None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:20.562980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:20.620411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566c84b-205c-4fbf-aaed-8159ab5d64ad None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:20.666295 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcc1b4-cb46-4a94-913e-f062dad5c75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:20.666961 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc1b4-cb46-4a94-913e-f062dad5c75d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.667248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc1b4-cb46-4a94-913e-f062dad5c75d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.667536 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc1b4-cb46-4a94-913e-f062dad5c75d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.668309 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcc1b4-cb46-4a94-913e-f062dad5c75d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:20.668621 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcc1b4-cb46-4a94-913e-f062dad5c75d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:20.669995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcc1b4-cb46-4a94-913e-f062dad5c75d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:20.683897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 193/384] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:20.689451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06970121-3c99-4a9b-8045-fee6427afad9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:20.822710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06970121-3c99-4a9b-8045-fee6427afad9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:20.864488 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d58b0-c5c7-4482-ba1e-f82b8c64cbca None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.865107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d58b0-c5c7-4482-ba1e-f82b8c64cbca None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.865613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d58b0-c5c7-4482-ba1e-f82b8c64cbca None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.868595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 194/385] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:20.873710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803e36b-63ff-4b25-9a4b-3355c5de0398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:20.874523 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803e36b-63ff-4b25-9a4b-3355c5de0398 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.874764 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e7753-1076-43ee-88fb-952baf926b8e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:20.874866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803e36b-63ff-4b25-9a4b-3355c5de0398 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.875073 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803e36b-63ff-4b25-9a4b-3355c5de0398 None admin] PATH_INFO: `/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.875534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e7753-1076-43ee-88fb-952baf926b8e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:20.876091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e7753-1076-43ee-88fb-952baf926b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:20.878496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803e36b-63ff-4b25-9a4b-3355c5de0398 None admin] RBAC: Authorizing `identity:get_group(group_id=62edd6e447ab4817bba5ad2bcd36c1b3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:20.881106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803e36b-63ff-4b25-9a4b-3355c5de0398 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:20.886727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 192/386] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:20 2022] GET /identity/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:20.896975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803e36b-63ff-4b25-9a4b-3355c5de0398 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:20.911146 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fb5e7753-1076-43ee-88fb-952baf926b8e None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:20.914917 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fb5e7753-1076-43ee-88fb-952baf926b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:20.926488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:21.003619 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 195/387] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:21.035559 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e7753-1076-43ee-88fb-952baf926b8e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:21.069597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803e36b-63ff-4b25-9a4b-3355c5de0398 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:21.132491 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:21.141441 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51802de9-6cf8-4e11-87b8-7a98bf302810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:21.145875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802de9-6cf8-4e11-87b8-7a98bf302810 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:21.145875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802de9-6cf8-4e11-87b8-7a98bf302810 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:21.145875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51802de9-6cf8-4e11-87b8-7a98bf302810 None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:21.145875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51802de9-6cf8-4e11-87b8-7a98bf302810 None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:21.147300 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51802de9-6cf8-4e11-87b8-7a98bf302810 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:21.158030 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 193/388] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:20 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:21.160537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51802de9-6cf8-4e11-87b8-7a98bf302810 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:21.226866 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e7753-1076-43ee-88fb-952baf926b8e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:21.297060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e557a65-e52c-4ed1-8958-127e71372670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:21.297883 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e557a65-e52c-4ed1-8958-127e71372670 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:21.298171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e557a65-e52c-4ed1-8958-127e71372670 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:21.298453 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e557a65-e52c-4ed1-8958-127e71372670 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:21.321713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e557a65-e52c-4ed1-8958-127e71372670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:21.334057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2e557a65-e52c-4ed1-8958-127e71372670 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:21.334057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:21.334057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:21.334057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:21.334057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:21.334057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:21.334057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:21.334057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:21.334057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:21.334057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:21.334057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:21.334057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:21.334057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:21.334057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:21.334057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:21.334057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:21.335053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:21.335053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:21.335053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:21.335053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:21.335053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:21.335053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:21.335053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:21.335053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:21.335053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:21.335053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:21.335053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:21.335053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:21.335053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:21.335053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:21.335053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:21.335053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:21.335887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:21.335887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:21.335887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:21.335887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:21.335887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:21.335887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:21.335887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:21.335887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:21.335887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:21.335887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:21.335887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:21.335887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:21.335887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 196/389] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:21.346037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e557a65-e52c-4ed1-8958-127e71372670 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:21.352332 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:21.378911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51802de9-6cf8-4e11-87b8-7a98bf302810 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:21.451524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac807b9-257f-49af-9a48-cb16aeb9cfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:21.452359 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac807b9-257f-49af-9a48-cb16aeb9cfa7 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:21.452654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac807b9-257f-49af-9a48-cb16aeb9cfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:21.452941 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac807b9-257f-49af-9a48-cb16aeb9cfa7 None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4/groups/62edd6e447ab4817bba5ad2bcd36c1b3/roles/f9b113934dbd49218d427f6cacaabf8f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:21.457598 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac807b9-257f-49af-9a48-cb16aeb9cfa7 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb120c9c3572435a8113ca1e458046c4, group_id=62edd6e447ab4817bba5ad2bcd36c1b3, role_id=f9b113934dbd49218d427f6cacaabf8f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:21.459180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac807b9-257f-49af-9a48-cb16aeb9cfa7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:21.510684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e557a65-e52c-4ed1-8958-127e71372670 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:21.524433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:21.532434 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 194/390] 10.222.0.50 () {58 vars in 1442 bytes} [Thu Jun 2 15:45:21 2022] PUT /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4/groups/62edd6e447ab4817bba5ad2bcd36c1b3/roles/f9b113934dbd49218d427f6cacaabf8f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 15:45:21.572453 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9c4fd-4bf5-4faf-b777-90ba42080546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:21.573153 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9c4fd-4bf5-4faf-b777-90ba42080546 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:21.573443 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9c4fd-4bf5-4faf-b777-90ba42080546 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:21.573728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9c4fd-4bf5-4faf-b777-90ba42080546 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:21.574502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9c4fd-4bf5-4faf-b777-90ba42080546 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:21.574822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9c4fd-4bf5-4faf-b777-90ba42080546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:21.576312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9c4fd-4bf5-4faf-b777-90ba42080546 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:21.586553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 197/391] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:21.591073 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cbabe-b4db-41fe-97be-344c7be9acc2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:21.591698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cbabe-b4db-41fe-97be-344c7be9acc2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:21.592249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cbabe-b4db-41fe-97be-344c7be9acc2 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:21.594346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 195/392] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:21.597366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9c4fd-4bf5-4faf-b777-90ba42080546 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:21.600470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2bff2-d96e-4a16-a8c7-9872f4b6dd00 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:21.601634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2bff2-d96e-4a16-a8c7-9872f4b6dd00 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:21.602166 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2bff2-d96e-4a16-a8c7-9872f4b6dd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:21.645819 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-84a2bff2-d96e-4a16-a8c7-9872f4b6dd00 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:21.648256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-84a2bff2-d96e-4a16-a8c7-9872f4b6dd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:21.721796 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9c4fd-4bf5-4faf-b777-90ba42080546 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:21.760602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a89c97-858a-4d1e-bd0f-c615fa60f503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:21.761555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a89c97-858a-4d1e-bd0f-c615fa60f503 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:21.761844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a89c97-858a-4d1e-bd0f-c615fa60f503 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:21.762177 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a89c97-858a-4d1e-bd0f-c615fa60f503 None admin] PATH_INFO: `/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:21.763435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a89c97-858a-4d1e-bd0f-c615fa60f503 None admin] RBAC: Authorizing `identity:get_group(group_id=62edd6e447ab4817bba5ad2bcd36c1b3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:21.765066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a89c97-858a-4d1e-bd0f-c615fa60f503 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:21.770098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 198/393] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:21 2022] GET /identity/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:21.772374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a89c97-858a-4d1e-bd0f-c615fa60f503 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:21.805818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 196/394] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:21.850519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2bff2-d96e-4a16-a8c7-9872f4b6dd00 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:21.856455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:21.928392 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a89c97-858a-4d1e-bd0f-c615fa60f503 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:21.968853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:21.977993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e2fab-7615-4fba-997f-162aefcd2dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:21.979352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e2fab-7615-4fba-997f-162aefcd2dae None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:21.979596 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e2fab-7615-4fba-997f-162aefcd2dae None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:21.979882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e2fab-7615-4fba-997f-162aefcd2dae None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:21.981186 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e2fab-7615-4fba-997f-162aefcd2dae None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:21.987235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e2fab-7615-4fba-997f-162aefcd2dae None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:21.987235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 199/395] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:21 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:21.993229 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e2fab-7615-4fba-997f-162aefcd2dae None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:22.053770 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2bff2-d96e-4a16-a8c7-9872f4b6dd00 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:22.109510 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e2fab-7615-4fba-997f-162aefcd2dae None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:22.112353 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:22.147469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136a94e-e7c9-47f1-be0d-17712a939283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:22.148433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136a94e-e7c9-47f1-be0d-17712a939283 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:22.148720 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136a94e-e7c9-47f1-be0d-17712a939283 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:22.149361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136a94e-e7c9-47f1-be0d-17712a939283 None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4/groups/62edd6e447ab4817bba5ad2bcd36c1b3/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:22.151539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136a94e-e7c9-47f1-be0d-17712a939283 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb120c9c3572435a8113ca1e458046c4, group_id=62edd6e447ab4817bba5ad2bcd36c1b3, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:22.153350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136a94e-e7c9-47f1-be0d-17712a939283 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:22.165141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf46724-5f16-4161-9866-36bf232bb226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:22.165959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46724-5f16-4161-9866-36bf232bb226 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:22.166362 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46724-5f16-4161-9866-36bf232bb226 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:22.166554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46724-5f16-4161-9866-36bf232bb226 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:22.179517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf46724-5f16-4161-9866-36bf232bb226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:22.187731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ccf46724-5f16-4161-9866-36bf232bb226 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:22.187731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:22.187731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:22.187731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:22.187731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:22.187731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:22.187731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:22.187731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:22.187731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:22.187731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:22.187731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:22.187731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:22.187731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:22.187731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:22.187731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:22.187731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:22.188674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:22.188674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:22.188674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:22.188674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:22.188674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:22.188674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:22.188674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:22.188674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:22.188674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:22.188674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:22.188674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:22.188674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:22.188674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:22.188674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:22.188674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:22.188674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:22.189484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:22.189484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:22.189484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:22.189484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:22.189484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:22.189484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:22.189484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:22.189484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:22.189484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:22.189484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:22.189484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:22.189484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:22.189484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 197/396] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:22.196993 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf46724-5f16-4161-9866-36bf232bb226 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:22.244493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 200/397] 10.222.0.50 () {58 vars in 1442 bytes} [Thu Jun 2 15:45:21 2022] PUT /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4/groups/62edd6e447ab4817bba5ad2bcd36c1b3/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:22.284897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ab0ea-a007-4a96-8691-7e6693e03ba4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:22.289158 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ab0ea-a007-4a96-8691-7e6693e03ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:22.289158 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ab0ea-a007-4a96-8691-7e6693e03ba4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:22.289158 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 201/398] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:22.294528 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd7cca-504a-41b0-9edd-f85521035e3a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:22.294949 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd7cca-504a-41b0-9edd-f85521035e3a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:22.295144 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd7cca-504a-41b0-9edd-f85521035e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:22.318480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4fdd7cca-504a-41b0-9edd-f85521035e3a None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:22.319002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4fdd7cca-504a-41b0-9edd-f85521035e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:22.361561 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf46724-5f16-4161-9866-36bf232bb226 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:22.403607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 202/399] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:22.406842 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8b124-e2f4-43e5-8cfa-671a5d95dcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:22.407789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8b124-e2f4-43e5-8cfa-671a5d95dcc7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:22.408312 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8b124-e2f4-43e5-8cfa-671a5d95dcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:22.408834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8b124-e2f4-43e5-8cfa-671a5d95dcc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:22.409777 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8b124-e2f4-43e5-8cfa-671a5d95dcc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:22.410445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8b124-e2f4-43e5-8cfa-671a5d95dcc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:22.412155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8b124-e2f4-43e5-8cfa-671a5d95dcc7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:22.420037 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:22.422863 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 198/400] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:22.426673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd7cca-504a-41b0-9edd-f85521035e3a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:22.429914 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8b124-e2f4-43e5-8cfa-671a5d95dcc7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:22.571562 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8b124-e2f4-43e5-8cfa-671a5d95dcc7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:22.596352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:22.600602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd7cca-504a-41b0-9edd-f85521035e3a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:22.622604 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e4640-75af-43ad-811b-84c39d7e9264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:22.623896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e4640-75af-43ad-811b-84c39d7e9264 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:22.624211 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e4640-75af-43ad-811b-84c39d7e9264 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:22.624496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e4640-75af-43ad-811b-84c39d7e9264 None admin] PATH_INFO: `/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:22.628552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e4640-75af-43ad-811b-84c39d7e9264 None admin] RBAC: Authorizing `identity:get_group(group_id=62edd6e447ab4817bba5ad2bcd36c1b3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:22.630054 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e4640-75af-43ad-811b-84c39d7e9264 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:22.635773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 199/401] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:22 2022] GET /identity/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:22.641659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e4640-75af-43ad-811b-84c39d7e9264 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:22.670505 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db0076-0625-41af-bd8c-83ebed8e43bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:22.671322 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db0076-0625-41af-bd8c-83ebed8e43bb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:22.671607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db0076-0625-41af-bd8c-83ebed8e43bb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:22.671879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db0076-0625-41af-bd8c-83ebed8e43bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:22.691656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db0076-0625-41af-bd8c-83ebed8e43bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:22.708399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d9db0076-0625-41af-bd8c-83ebed8e43bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:22.708399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:22.708399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:22.708399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:22.708399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:22.708399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:22.708399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:22.708399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:22.708399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:22.708399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:22.708399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:22.708399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:22.708399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:22.708399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:22.708399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:22.708399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:22.709343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:22.709343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:22.709343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:22.709343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:22.709343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:22.709343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:22.709343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:22.709343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:22.709343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:22.709343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:22.709343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:22.709343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:22.709343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:22.709343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:22.709343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:22.709343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:22.710778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:22.710778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:22.710778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:22.710778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:22.710778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:22.710778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:22.710778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:22.710778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:22.710778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:22.710778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:22.710778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:22.710778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:22.720033 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 203/402] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:45:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:22.721821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db0076-0625-41af-bd8c-83ebed8e43bb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:22.771262 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:22.850283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e4640-75af-43ad-811b-84c39d7e9264 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:22.891638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db0076-0625-41af-bd8c-83ebed8e43bb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:22.917469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f781ec-dcd1-4807-883f-37ae5df36c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:22.918338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f781ec-dcd1-4807-883f-37ae5df36c70 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:22.918626 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f781ec-dcd1-4807-883f-37ae5df36c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:22.918907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f781ec-dcd1-4807-883f-37ae5df36c70 None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:22.920994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f781ec-dcd1-4807-883f-37ae5df36c70 None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:22.923872 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f781ec-dcd1-4807-883f-37ae5df36c70 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:22.930504 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 200/403] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:22 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:22.931716 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f781ec-dcd1-4807-883f-37ae5df36c70 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:22.956728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea4c47-4256-4b2c-a1a3-a7151e737e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:22.957431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea4c47-4256-4b2c-a1a3-a7151e737e5a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:22.957721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea4c47-4256-4b2c-a1a3-a7151e737e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:22.958003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea4c47-4256-4b2c-a1a3-a7151e737e5a None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:22.958763 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea4c47-4256-4b2c-a1a3-a7151e737e5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:22.959075 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea4c47-4256-4b2c-a1a3-a7151e737e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:22.968023 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea4c47-4256-4b2c-a1a3-a7151e737e5a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:22.969891 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 204/404] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:22.971251 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530e804-07ac-45d2-b01c-80f430603d61 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:22.971543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530e804-07ac-45d2-b01c-80f430603d61 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:22.971825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530e804-07ac-45d2-b01c-80f430603d61 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:22.973110 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 205/405] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:22.981028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530e804-07ac-45d2-b01c-80f430603d61 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:22.997980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:23.072500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f781ec-dcd1-4807-883f-37ae5df36c70 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:23.094919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530e804-07ac-45d2-b01c-80f430603d61 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:23.115602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:23.123604 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d431f4d-a3c6-41bb-954e-0e0b83bfaa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:23.128114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d431f4d-a3c6-41bb-954e-0e0b83bfaa3e None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:23.128114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d431f4d-a3c6-41bb-954e-0e0b83bfaa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:23.128114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d431f4d-a3c6-41bb-954e-0e0b83bfaa3e None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce/groups/62edd6e447ab4817bba5ad2bcd36c1b3/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:23.129169 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d431f4d-a3c6-41bb-954e-0e0b83bfaa3e None admin] RBAC: Authorizing `identity:create_grant(project_id=b23b3964eb0b4e7c856d698cf2bf45ce, group_id=62edd6e447ab4817bba5ad2bcd36c1b3, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:23.131328 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d431f4d-a3c6-41bb-954e-0e0b83bfaa3e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:23.133869 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0c02b-4110-491c-a0eb-1ea884eb3698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:23.134921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0c02b-4110-491c-a0eb-1ea884eb3698 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:23.135345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0c02b-4110-491c-a0eb-1ea884eb3698 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:23.135840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0c02b-4110-491c-a0eb-1ea884eb3698 None admin] PATH_INFO: `/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:23.137198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0c02b-4110-491c-a0eb-1ea884eb3698 None admin] RBAC: Authorizing `identity:get_group(group_id=62edd6e447ab4817bba5ad2bcd36c1b3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:23.138911 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0c02b-4110-491c-a0eb-1ea884eb3698 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:23.143880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 206/406] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:22 2022] GET /identity/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:23.145202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14169d34-1231-4a1c-994e-bf8c9880a867 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:23.145561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14169d34-1231-4a1c-994e-bf8c9880a867 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:23.145935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14169d34-1231-4a1c-994e-bf8c9880a867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:23.164592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-14169d34-1231-4a1c-994e-bf8c9880a867 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:23.165705 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-14169d34-1231-4a1c-994e-bf8c9880a867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:23.233195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 207/407] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:23.233899 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14169d34-1231-4a1c-994e-bf8c9880a867 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:23.250841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:23.267076 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 201/408] 10.222.0.50 () {58 vars in 1442 bytes} [Thu Jun 2 15:45:22 2022] PUT /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce/groups/62edd6e447ab4817bba5ad2bcd36c1b3/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:23.268634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d431f4d-a3c6-41bb-954e-0e0b83bfaa3e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:23.405034 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d431f4d-a3c6-41bb-954e-0e0b83bfaa3e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:23.453534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f46ae3-8839-4801-854d-21c7a184a739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:23.454744 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46ae3-8839-4801-854d-21c7a184a739 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:23.455306 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46ae3-8839-4801-854d-21c7a184a739 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:23.455735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46ae3-8839-4801-854d-21c7a184a739 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:23.457663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14169d34-1231-4a1c-994e-bf8c9880a867 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:23.477488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f46ae3-8839-4801-854d-21c7a184a739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:23.495778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b6f46ae3-8839-4801-854d-21c7a184a739 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:23.495778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:23.495778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:23.495778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:23.495778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:23.495778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:23.495778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:23.495778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:23.495778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:23.495778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:23.495778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:23.495778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:23.495778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:23.495778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:23.495778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:23.495778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:23.497043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:23.497043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:23.497043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:23.497043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:23.497043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:23.497043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:23.497043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:23.497043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:23.497043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:23.497043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:23.497043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:23.497043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:23.497043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:23.497043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:23.497043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:23.497043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:23.498106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:23.498106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:23.498106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:23.498106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:23.498106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:23.498106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:23.498106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:23.498106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:23.498106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:23.498106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:23.498106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:23.498106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:23.502467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 202/409] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:23.509940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f46ae3-8839-4801-854d-21c7a184a739 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:23.558492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bdace-d247-4da0-8b62-624cb0311bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:23.559757 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bdace-d247-4da0-8b62-624cb0311bcc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:23.560408 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bdace-d247-4da0-8b62-624cb0311bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:23.560846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bdace-d247-4da0-8b62-624cb0311bcc None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:23.563070 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bdace-d247-4da0-8b62-624cb0311bcc None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:23.565545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bdace-d247-4da0-8b62-624cb0311bcc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:23.568946 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 208/410] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:23 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:23.576596 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bdace-d247-4da0-8b62-624cb0311bcc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:23.617143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:23.665627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f46ae3-8839-4801-854d-21c7a184a739 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:23.685640 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:23.708047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bdace-d247-4da0-8b62-624cb0311bcc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:23.749828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9427e-0fd7-4dfa-806e-c5224bb731b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:23.751099 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9427e-0fd7-4dfa-806e-c5224bb731b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:23.751613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9427e-0fd7-4dfa-806e-c5224bb731b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:23.752128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9427e-0fd7-4dfa-806e-c5224bb731b2 None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce/groups/62edd6e447ab4817bba5ad2bcd36c1b3/roles/f9b113934dbd49218d427f6cacaabf8f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:23.755382 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9427e-0fd7-4dfa-806e-c5224bb731b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b23b3964eb0b4e7c856d698cf2bf45ce, group_id=62edd6e447ab4817bba5ad2bcd36c1b3, role_id=f9b113934dbd49218d427f6cacaabf8f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:23.757671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9427e-0fd7-4dfa-806e-c5224bb731b2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:23.768110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474148ed-e3b1-440b-8f03-ef4e22cbeab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:23.769077 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474148ed-e3b1-440b-8f03-ef4e22cbeab0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:23.769639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474148ed-e3b1-440b-8f03-ef4e22cbeab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:23.770131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474148ed-e3b1-440b-8f03-ef4e22cbeab0 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:23.771050 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474148ed-e3b1-440b-8f03-ef4e22cbeab0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:23.771577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474148ed-e3b1-440b-8f03-ef4e22cbeab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:23.773206 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474148ed-e3b1-440b-8f03-ef4e22cbeab0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:23.783506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 203/411] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:23.789453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474148ed-e3b1-440b-8f03-ef4e22cbeab0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:23.826573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 209/412] 10.222.0.50 () {58 vars in 1442 bytes} [Thu Jun 2 15:45:23 2022] PUT /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce/groups/62edd6e447ab4817bba5ad2bcd36c1b3/roles/f9b113934dbd49218d427f6cacaabf8f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:23.922064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474148ed-e3b1-440b-8f03-ef4e22cbeab0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:23.939569 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:23.962064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395e139-c019-4648-b012-0dd02ac62d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:23.963286 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395e139-c019-4648-b012-0dd02ac62d5d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:23.963790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395e139-c019-4648-b012-0dd02ac62d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:23.964377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395e139-c019-4648-b012-0dd02ac62d5d None admin] PATH_INFO: `/v3/groups/28948219b4f94d639cb64bdc8125d4f5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:23.965752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395e139-c019-4648-b012-0dd02ac62d5d None admin] RBAC: Authorizing `identity:get_group(group_id=28948219b4f94d639cb64bdc8125d4f5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:23.967423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395e139-c019-4648-b012-0dd02ac62d5d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:23.969596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 204/413] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:23 2022] GET /identity/v3/groups/28948219b4f94d639cb64bdc8125d4f5 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:23.977121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9427e-0fd7-4dfa-806e-c5224bb731b2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:24.263013 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9427e-0fd7-4dfa-806e-c5224bb731b2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:24.302830 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea4dd2-8c6f-4f0a-849f-13c5039faaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:24.303707 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea4dd2-8c6f-4f0a-849f-13c5039faaad None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:24.304097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea4dd2-8c6f-4f0a-849f-13c5039faaad None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:24.304795 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea4dd2-8c6f-4f0a-849f-13c5039faaad None admin] PATH_INFO: `/v3/projects/6cbd1e15210e404da74f1144aa119ef8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:24.306450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea4dd2-8c6f-4f0a-849f-13c5039faaad None admin] RBAC: Authorizing `identity:get_project(project_id=6cbd1e15210e404da74f1144aa119ef8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:24.308005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea4dd2-8c6f-4f0a-849f-13c5039faaad None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:24.310032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 210/414] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:23 2022] GET /identity/v3/projects/6cbd1e15210e404da74f1144aa119ef8 => generated 344 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:24.315885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395e139-c019-4648-b012-0dd02ac62d5d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:24.449070 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3256-4f4b-4228-b431-e55a63ffa853 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:24.449380 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3256-4f4b-4228-b431-e55a63ffa853 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:24.449647 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3256-4f4b-4228-b431-e55a63ffa853 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:24.451267 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 211/415] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:24.456351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239c227-236d-4c2e-b3a3-f23e8b95ea01 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:24.456648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239c227-236d-4c2e-b3a3-f23e8b95ea01 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:24.456935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239c227-236d-4c2e-b3a3-f23e8b95ea01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:24.477897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395e139-c019-4648-b012-0dd02ac62d5d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:24.485456 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5239c227-236d-4c2e-b3a3-f23e8b95ea01 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:24.486662 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5239c227-236d-4c2e-b3a3-f23e8b95ea01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:24.488724 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:24.538923 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797318e5-10ae-4dc6-8543-3f907063cb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:24.542118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797318e5-10ae-4dc6-8543-3f907063cb59 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:24.542629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797318e5-10ae-4dc6-8543-3f907063cb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:24.543158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797318e5-10ae-4dc6-8543-3f907063cb59 None admin] PATH_INFO: `/v3/projects/6cbd1e15210e404da74f1144aa119ef8/groups/28948219b4f94d639cb64bdc8125d4f5/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:24.548036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797318e5-10ae-4dc6-8543-3f907063cb59 None admin] RBAC: Authorizing `identity:create_grant(project_id=6cbd1e15210e404da74f1144aa119ef8, group_id=28948219b4f94d639cb64bdc8125d4f5, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:24.550484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797318e5-10ae-4dc6-8543-3f907063cb59 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:24.584383 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 212/416] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:24.606250 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239c227-236d-4c2e-b3a3-f23e8b95ea01 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:24.635238 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 205/417] 10.222.0.50 () {58 vars in 1442 bytes} [Thu Jun 2 15:45:24 2022] PUT /identity/v3/projects/6cbd1e15210e404da74f1144aa119ef8/groups/28948219b4f94d639cb64bdc8125d4f5/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:24.744368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239c227-236d-4c2e-b3a3-f23e8b95ea01 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:24.784884 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef617d7f-345c-4f73-b0fc-648b0fdd786b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:24.786151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef617d7f-345c-4f73-b0fc-648b0fdd786b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:24.786651 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef617d7f-345c-4f73-b0fc-648b0fdd786b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:24.787160 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef617d7f-345c-4f73-b0fc-648b0fdd786b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:24.795903 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:24.801534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef617d7f-345c-4f73-b0fc-648b0fdd786b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:24.811003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ef617d7f-345c-4f73-b0fc-648b0fdd786b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:24.811003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:24.811003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:24.811003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:24.811003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:24.811003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:24.811003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:24.811003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:24.811003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:24.811003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:24.811003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:24.811003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:24.811003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:24.811003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:24.811003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:24.811003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:24.811975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:24.811975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:24.811975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:24.811975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:24.811975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:24.811975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:24.811975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:24.811975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:24.811975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:24.811975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:24.811975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:24.811975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:24.811975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:24.811975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:24.811975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:24.811975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:24.812859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:24.812859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:24.812859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:24.812859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:24.812859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:24.812859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:24.812859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:24.812859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:24.812859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:24.812859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:24.812859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:24.812859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:24.815708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 213/418] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:45:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:24.821626 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797318e5-10ae-4dc6-8543-3f907063cb59 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:24.882447 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:24.950251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797318e5-10ae-4dc6-8543-3f907063cb59 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:24.987016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c977a6-b60a-4f3c-b073-8e18d00f87e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:24.987691 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c977a6-b60a-4f3c-b073-8e18d00f87e1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:24.988011 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c977a6-b60a-4f3c-b073-8e18d00f87e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:24.988308 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c977a6-b60a-4f3c-b073-8e18d00f87e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:24.989064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c977a6-b60a-4f3c-b073-8e18d00f87e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:24.989381 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c977a6-b60a-4f3c-b073-8e18d00f87e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:24.990763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c977a6-b60a-4f3c-b073-8e18d00f87e1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:25.000141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 206/419] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:25.005821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef617d7f-345c-4f73-b0fc-648b0fdd786b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:25.013022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166cf21-e4a2-480f-84db-536908d5f519 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.013317 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166cf21-e4a2-480f-84db-536908d5f519 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.013605 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166cf21-e4a2-480f-84db-536908d5f519 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.015245 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 207/420] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:25.020252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b88cfe-c157-4b87-a653-09a5732aa9b1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.020545 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b88cfe-c157-4b87-a653-09a5732aa9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.020828 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b88cfe-c157-4b87-a653-09a5732aa9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.046048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-71b88cfe-c157-4b87-a653-09a5732aa9b1 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:25.047181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-71b88cfe-c157-4b87-a653-09a5732aa9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:25.187200 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 208/421] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:25.195808 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef617d7f-345c-4f73-b0fc-648b0fdd786b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:25.220915 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b88cfe-c157-4b87-a653-09a5732aa9b1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:25.252834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e2fa2-5145-444b-b0fd-3be3247f4448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:25.253830 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e2fa2-5145-444b-b0fd-3be3247f4448 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.254312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e2fa2-5145-444b-b0fd-3be3247f4448 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.254775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e2fa2-5145-444b-b0fd-3be3247f4448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.278154 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:25.344987 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:25.350390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e2fa2-5145-444b-b0fd-3be3247f4448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:25.352756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e2fa2-5145-444b-b0fd-3be3247f4448 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:25.463855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 214/422] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 15:45:25.472085 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e2fa2-5145-444b-b0fd-3be3247f4448 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:25.485896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b88cfe-c157-4b87-a653-09a5732aa9b1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:25.573804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:25.578408 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e2fa2-5145-444b-b0fd-3be3247f4448 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:25.578770 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6689316-f41e-49db-97d5-333607796c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:25.579585 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689316-f41e-49db-97d5-333607796c75 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.579869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689316-f41e-49db-97d5-333607796c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.580176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6689316-f41e-49db-97d5-333607796c75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.608884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6689316-f41e-49db-97d5-333607796c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:25.624634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a6689316-f41e-49db-97d5-333607796c75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:25.624634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:25.624634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:25.624634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:25.624634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:25.624634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:25.624634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:25.624634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:25.624634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:25.624634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:25.624634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:25.624634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:25.624634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:25.624634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:25.624634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:25.624634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:25.625596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:25.625596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:25.625596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:25.625596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:25.625596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:25.625596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:25.625596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:25.625596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:25.625596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:25.625596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:25.625596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:25.625596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:25.625596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:25.625596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:25.625596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:25.625596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:25.626488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:25.626488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:25.626488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:25.626488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:25.626488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:25.626488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:25.626488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:25.626488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:25.626488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:25.626488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:25.626488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:25.626488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:25.627630 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 209/423] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:25.632277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbd265-06fb-4558-b786-0ef47c20a4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:25.633231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbd265-06fb-4558-b786-0ef47c20a4ae None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.633524 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbd265-06fb-4558-b786-0ef47c20a4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.633810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbd265-06fb-4558-b786-0ef47c20a4ae None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.635158 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbd265-06fb-4558-b786-0ef47c20a4ae None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:25.636679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbd265-06fb-4558-b786-0ef47c20a4ae None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:25.637029 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6689316-f41e-49db-97d5-333607796c75 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:25.638979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 215/424] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:25.645455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbd265-06fb-4558-b786-0ef47c20a4ae None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:25.747763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:25.754844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6689316-f41e-49db-97d5-333607796c75 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:25.801633 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22760596-d6c4-4c69-935a-ff8b0f44c02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:25.802298 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22760596-d6c4-4c69-935a-ff8b0f44c02e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.802584 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22760596-d6c4-4c69-935a-ff8b0f44c02e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.802860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22760596-d6c4-4c69-935a-ff8b0f44c02e None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.803609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22760596-d6c4-4c69-935a-ff8b0f44c02e None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:25.804489 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22760596-d6c4-4c69-935a-ff8b0f44c02e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:25.805886 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22760596-d6c4-4c69-935a-ff8b0f44c02e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:25.826207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 210/425] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:25.831736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22760596-d6c4-4c69-935a-ff8b0f44c02e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:25.879893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbd265-06fb-4558-b786-0ef47c20a4ae None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:25.942844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db72bc-85a7-471a-a2fa-9e6e00c6b8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:25.945141 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db72bc-85a7-471a-a2fa-9e6e00c6b8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:25.945837 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db72bc-85a7-471a-a2fa-9e6e00c6b8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:25.946983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db72bc-85a7-471a-a2fa-9e6e00c6b8f5 None admin] PATH_INFO: `/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:25.949530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db72bc-85a7-471a-a2fa-9e6e00c6b8f5 None admin] RBAC: Authorizing `identity:get_group(group_id=62edd6e447ab4817bba5ad2bcd36c1b3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:25.951473 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db72bc-85a7-471a-a2fa-9e6e00c6b8f5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:25.955081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 216/426] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3 => generated 226 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:25.959646 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db72bc-85a7-471a-a2fa-9e6e00c6b8f5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.018678 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:26.023111 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22760596-d6c4-4c69-935a-ff8b0f44c02e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.067764 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac34d6-3167-4427-bfee-8e74b20e6dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.068544 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac34d6-3167-4427-bfee-8e74b20e6dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.068838 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac34d6-3167-4427-bfee-8e74b20e6dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.069124 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac34d6-3167-4427-bfee-8e74b20e6dd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.098421 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db72bc-85a7-471a-a2fa-9e6e00c6b8f5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.099021 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:26.137351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a32efe-7b41-4338-a22b-9d39fb7c55f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.137942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a32efe-7b41-4338-a22b-9d39fb7c55f3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.138233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a32efe-7b41-4338-a22b-9d39fb7c55f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.138518 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a32efe-7b41-4338-a22b-9d39fb7c55f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.139354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a32efe-7b41-4338-a22b-9d39fb7c55f3 None admin] RBAC: Adding query filter params (group.id=62edd6e447ab4817bba5ad2bcd36c1b3, role.id=f9b113934dbd49218d427f6cacaabf8f, scope.project.id=eb120c9c3572435a8113ca1e458046c4) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:26.139677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a32efe-7b41-4338-a22b-9d39fb7c55f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:26.141158 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a32efe-7b41-4338-a22b-9d39fb7c55f3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:26.148322 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 217/427] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/role_assignments?group.id=62edd6e447ab4817bba5ad2bcd36c1b3&scope.project.id=eb120c9c3572435a8113ca1e458046c4&role.id=f9b113934dbd49218d427f6cacaabf8f => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:26.149727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c6f90-a299-4377-9383-1af396dbc7ec None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.150046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c6f90-a299-4377-9383-1af396dbc7ec None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.150309 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c6f90-a299-4377-9383-1af396dbc7ec None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.154029 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac34d6-3167-4427-bfee-8e74b20e6dd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:26.155944 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 218/428] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:26.156255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac34d6-3167-4427-bfee-8e74b20e6dd0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:26.157528 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f20fec-a9c3-4391-b3b0-aa87edf27838 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.157827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f20fec-a9c3-4391-b3b0-aa87edf27838 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.158118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f20fec-a9c3-4391-b3b0-aa87edf27838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.183366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-30f20fec-a9c3-4391-b3b0-aa87edf27838 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:26.186402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-30f20fec-a9c3-4391-b3b0-aa87edf27838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:26.311619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 211/429] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:26.317290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac34d6-3167-4427-bfee-8e74b20e6dd0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.385716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 219/430] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:26.404436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:26.422678 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f20fec-a9c3-4391-b3b0-aa87edf27838 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.444768 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac34d6-3167-4427-bfee-8e74b20e6dd0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.458203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:26.483573 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e419bc5-5769-4ded-8e41-43783b3782cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.484571 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e419bc5-5769-4ded-8e41-43783b3782cb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.484890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e419bc5-5769-4ded-8e41-43783b3782cb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.485171 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e419bc5-5769-4ded-8e41-43783b3782cb None admin] PATH_INFO: `/v3/projects/eb120c9c3572435a8113ca1e458046c4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.486701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e419bc5-5769-4ded-8e41-43783b3782cb None admin] RBAC: Authorizing `identity:get_project(project_id=eb120c9c3572435a8113ca1e458046c4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:26.488169 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e419bc5-5769-4ded-8e41-43783b3782cb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:26.495743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 212/431] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:26 2022] GET /identity/v3/projects/eb120c9c3572435a8113ca1e458046c4 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:26.495743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e419bc5-5769-4ded-8e41-43783b3782cb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.556815 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f20fec-a9c3-4391-b3b0-aa87edf27838 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.597593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c048d4a-27e3-4b4d-8ba5-4eded9f1bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.598382 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c048d4a-27e3-4b4d-8ba5-4eded9f1bf2a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.598994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c048d4a-27e3-4b4d-8ba5-4eded9f1bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.599099 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c048d4a-27e3-4b4d-8ba5-4eded9f1bf2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.609484 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c048d4a-27e3-4b4d-8ba5-4eded9f1bf2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:26.617774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9c048d4a-27e3-4b4d-8ba5-4eded9f1bf2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:26.617774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:26.617774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:26.617774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:26.617774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:26.617774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:26.617774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:26.617774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:26.617774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:26.617774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:26.617774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:26.617774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:26.617774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:26.617774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:26.617774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:26.617774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:26.618688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:26.618688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:26.618688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:26.618688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:26.618688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:26.618688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:26.618688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:26.618688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:26.618688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:26.618688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:26.618688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:26.618688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:26.618688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:26.618688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:26.618688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:26.618688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:26.619527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:26.619527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:26.619527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:26.619527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:26.619527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:26.619527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:26.619527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:26.619527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:26.619527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:26.619527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:26.619527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 15:45:26.619527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:26.619527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 220/432] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:26.620758 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe8b3d-f2f9-4a76-bf3b-a178f1628600 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.620758 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe8b3d-f2f9-4a76-bf3b-a178f1628600 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.621039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe8b3d-f2f9-4a76-bf3b-a178f1628600 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.622427 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 221/433] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:26.624787 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe8b3d-f2f9-4a76-bf3b-a178f1628600 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.633444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e419bc5-5769-4ded-8e41-43783b3782cb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.659007 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:26.671163 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc9e57-9aa4-42f9-b193-7973785c5f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.672883 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc9e57-9aa4-42f9-b193-7973785c5f1f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.673176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc9e57-9aa4-42f9-b193-7973785c5f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.673480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc9e57-9aa4-42f9-b193-7973785c5f1f None admin] PATH_INFO: `/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.675133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc9e57-9aa4-42f9-b193-7973785c5f1f None admin] RBAC: Authorizing `identity:get_group(group_id=62edd6e447ab4817bba5ad2bcd36c1b3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:26.676870 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc9e57-9aa4-42f9-b193-7973785c5f1f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:26.683609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 213/434] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:26 2022] GET /identity/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:26.683609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e918df-8e73-446d-baed-f257f9701594 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.683609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e918df-8e73-446d-baed-f257f9701594 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.683609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e918df-8e73-446d-baed-f257f9701594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.704188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-58e918df-8e73-446d-baed-f257f9701594 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:26.705722 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-58e918df-8e73-446d-baed-f257f9701594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:26.716848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:26.729697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe8b3d-f2f9-4a76-bf3b-a178f1628600 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.767431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f7de9-547a-4f3e-bb75-de329e023df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.768192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f7de9-547a-4f3e-bb75-de329e023df9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.768424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f7de9-547a-4f3e-bb75-de329e023df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.768685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f7de9-547a-4f3e-bb75-de329e023df9 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.769421 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f7de9-547a-4f3e-bb75-de329e023df9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:26.769727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f7de9-547a-4f3e-bb75-de329e023df9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:26.771089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f7de9-547a-4f3e-bb75-de329e023df9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:26.779881 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 222/435] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:45:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:26.780617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f7de9-547a-4f3e-bb75-de329e023df9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.785356 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 214/436] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:26.786099 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e918df-8e73-446d-baed-f257f9701594 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.891694 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e918df-8e73-446d-baed-f257f9701594 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.898213 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f7de9-547a-4f3e-bb75-de329e023df9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:26.916749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:26.928207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d91ca-2080-4c7b-a33e-d753699fcc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.929493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d91ca-2080-4c7b-a33e-d753699fcc0e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.929783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d91ca-2080-4c7b-a33e-d753699fcc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.930071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d91ca-2080-4c7b-a33e-d753699fcc0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.933075 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60d5b9-f507-4c35-a216-50e03b07ae51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:26.934014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60d5b9-f507-4c35-a216-50e03b07ae51 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:26.934014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60d5b9-f507-4c35-a216-50e03b07ae51 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:26.934291 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60d5b9-f507-4c35-a216-50e03b07ae51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:26.935117 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60d5b9-f507-4c35-a216-50e03b07ae51 None admin] RBAC: Adding query filter params (group.id=62edd6e447ab4817bba5ad2bcd36c1b3, role.id=6cae5979d0aa4dcca6467a7ba544d4b1, scope.project.id=eb120c9c3572435a8113ca1e458046c4) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:26.935433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60d5b9-f507-4c35-a216-50e03b07ae51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:26.936917 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60d5b9-f507-4c35-a216-50e03b07ae51 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:26.943369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 223/437] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Jun 2 15:45:26 2022] GET /identity/v3/role_assignments?group.id=62edd6e447ab4817bba5ad2bcd36c1b3&scope.project.id=eb120c9c3572435a8113ca1e458046c4&role.id=6cae5979d0aa4dcca6467a7ba544d4b1 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:26.944224 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60d5b9-f507-4c35-a216-50e03b07ae51 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:26.962654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:27.028403 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d91ca-2080-4c7b-a33e-d753699fcc0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:27.029902 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d91ca-2080-4c7b-a33e-d753699fcc0e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:27.078936 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60d5b9-f507-4c35-a216-50e03b07ae51 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:27.126890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f710f0b-9d6f-47c9-b300-891b7468c5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:27.128170 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f710f0b-9d6f-47c9-b300-891b7468c5ef None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.128673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f710f0b-9d6f-47c9-b300-891b7468c5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.129147 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f710f0b-9d6f-47c9-b300-891b7468c5ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.144510 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f710f0b-9d6f-47c9-b300-891b7468c5ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:27.149816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 215/438] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:27.150427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d91ca-2080-4c7b-a33e-d753699fcc0e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:27.155754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6f710f0b-9d6f-47c9-b300-891b7468c5ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:27.155754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:27.155754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:27.155754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:27.155754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:27.155754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:27.155754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:27.155754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:27.155754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:27.155754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:27.155754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:27.155754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:27.155754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:27.155754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:27.155754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:27.155754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:27.156699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:27.156699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:27.156699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:27.156699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:27.156699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:27.156699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:27.156699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:27.156699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:27.156699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:27.156699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:27.156699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:27.156699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:27.156699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:27.156699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:27.156699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:27.156699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:27.157523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:27.157523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:27.157523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:27.157523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:27.157523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:27.157523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:27.157523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:27.157523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:27.157523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:27.157523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:27.157523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:27.157523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:27.161860 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 224/439] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:45:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:27.162898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f710f0b-9d6f-47c9-b300-891b7468c5ef None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:27.178215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:27.274710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d91ca-2080-4c7b-a33e-d753699fcc0e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:27.275962 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:27.309436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f710f0b-9d6f-47c9-b300-891b7468c5ef None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:27.322273 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae31b8-88ad-4936-b029-3ba078bed23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:27.324171 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae31b8-88ad-4936-b029-3ba078bed23c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.324461 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae31b8-88ad-4936-b029-3ba078bed23c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.324737 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae31b8-88ad-4936-b029-3ba078bed23c None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.326025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae31b8-88ad-4936-b029-3ba078bed23c None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:27.327489 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae31b8-88ad-4936-b029-3ba078bed23c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:27.329575 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 216/440] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:27 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:27.331682 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02876b7-527e-4618-85c1-45664bd2460c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.331974 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02876b7-527e-4618-85c1-45664bd2460c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.332346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02876b7-527e-4618-85c1-45664bd2460c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.333838 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 217/441] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:27.334559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02876b7-527e-4618-85c1-45664bd2460c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:27.357999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414a52c-b725-435a-b8ff-f2807b97084e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:27.358673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414a52c-b725-435a-b8ff-f2807b97084e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.358963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414a52c-b725-435a-b8ff-f2807b97084e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.359244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414a52c-b725-435a-b8ff-f2807b97084e None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.360020 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414a52c-b725-435a-b8ff-f2807b97084e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:27.360325 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414a52c-b725-435a-b8ff-f2807b97084e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:27.361709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414a52c-b725-435a-b8ff-f2807b97084e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:27.370587 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 225/442] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:27.374750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4734e-1786-4837-b591-62c657fec4d7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.375046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4734e-1786-4837-b591-62c657fec4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.376318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4734e-1786-4837-b591-62c657fec4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.393706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-01e4734e-1786-4837-b591-62c657fec4d7 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:27.394906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-01e4734e-1786-4837-b591-62c657fec4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:27.449361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:27.465014 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02876b7-527e-4618-85c1-45664bd2460c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:27.476881 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 226/443] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:27.484009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4734e-1786-4837-b591-62c657fec4d7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:27.517038 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6559d7d-a66f-4db4-add7-d6c3a47bd276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:27.519438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6559d7d-a66f-4db4-add7-d6c3a47bd276 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.519893 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6559d7d-a66f-4db4-add7-d6c3a47bd276 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.520385 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6559d7d-a66f-4db4-add7-d6c3a47bd276 None admin] PATH_INFO: `/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.521929 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6559d7d-a66f-4db4-add7-d6c3a47bd276 None admin] RBAC: Authorizing `identity:get_group(group_id=62edd6e447ab4817bba5ad2bcd36c1b3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:27.523599 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6559d7d-a66f-4db4-add7-d6c3a47bd276 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:27.526225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 218/444] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:27 2022] GET /identity/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:27.527045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6559d7d-a66f-4db4-add7-d6c3a47bd276 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:27.565112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:27.601410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4734e-1786-4837-b591-62c657fec4d7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:27.634385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba7010-627e-47c4-9c98-17a8a9fd0901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:27.635035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba7010-627e-47c4-9c98-17a8a9fd0901 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.635321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba7010-627e-47c4-9c98-17a8a9fd0901 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.635599 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba7010-627e-47c4-9c98-17a8a9fd0901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.641430 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6559d7d-a66f-4db4-add7-d6c3a47bd276 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:27.674761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7db3ea-6824-424a-aba3-908f97477cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:27.675543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7db3ea-6824-424a-aba3-908f97477cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.675835 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7db3ea-6824-424a-aba3-908f97477cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.676146 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7db3ea-6824-424a-aba3-908f97477cd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.686041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7db3ea-6824-424a-aba3-908f97477cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:27.693704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6b7db3ea-6824-424a-aba3-908f97477cd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:27.693704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:27.693704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:27.693704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:27.693704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:27.693704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:27.693704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:27.693704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:27.693704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:27.693704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:27.693704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:27.693704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:27.693704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:27.693704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:27.693704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:27.693704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:27.694677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:27.694677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:27.694677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:27.694677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:27.694677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:27.694677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:27.694677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:27.694677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:27.694677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:27.694677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:27.694677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:27.694677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:27.694677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:27.694677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:27.694677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:27.694677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:27.695731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:27.695731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:27.695731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:27.695731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:27.695731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:27.695731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:27.695731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:27.695731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:27.695731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:27.695731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:27.695731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:27.695731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:27.695731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 219/445] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:27.695731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7db3ea-6824-424a-aba3-908f97477cd4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:27.703328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba7010-627e-47c4-9c98-17a8a9fd0901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:27.704790 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba7010-627e-47c4-9c98-17a8a9fd0901 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:27.718269 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:27.767949 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:27.797469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7db3ea-6824-424a-aba3-908f97477cd4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:27.802337 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 227/446] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:27.803149 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba7010-627e-47c4-9c98-17a8a9fd0901 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:27.832494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a786c-1f8b-4987-8f2a-a14ae72a2387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:27.833150 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a786c-1f8b-4987-8f2a-a14ae72a2387 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.833444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a786c-1f8b-4987-8f2a-a14ae72a2387 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.833724 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a786c-1f8b-4987-8f2a-a14ae72a2387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.834553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a786c-1f8b-4987-8f2a-a14ae72a2387 None admin] RBAC: Adding query filter params (group.id=62edd6e447ab4817bba5ad2bcd36c1b3, role.id=6cae5979d0aa4dcca6467a7ba544d4b1, scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:27.834873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a786c-1f8b-4987-8f2a-a14ae72a2387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:27.836879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a786c-1f8b-4987-8f2a-a14ae72a2387 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:27.842540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 220/447] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Jun 2 15:45:27 2022] GET /identity/v3/role_assignments?group.id=62edd6e447ab4817bba5ad2bcd36c1b3&scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce&role.id=6cae5979d0aa4dcca6467a7ba544d4b1 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:27.843315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a786c-1f8b-4987-8f2a-a14ae72a2387 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:27.912187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba7010-627e-47c4-9c98-17a8a9fd0901 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:27.948579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:27.950194 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fa7b4-7d48-48f7-9a8e-732a7bbf20f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:27.950885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fa7b4-7d48-48f7-9a8e-732a7bbf20f2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:27.951171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fa7b4-7d48-48f7-9a8e-732a7bbf20f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:27.951446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fa7b4-7d48-48f7-9a8e-732a7bbf20f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:27.952241 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fa7b4-7d48-48f7-9a8e-732a7bbf20f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:27.952550 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fa7b4-7d48-48f7-9a8e-732a7bbf20f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:27.954024 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fa7b4-7d48-48f7-9a8e-732a7bbf20f2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:27.969466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 228/448] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:27.971919 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a786c-1f8b-4987-8f2a-a14ae72a2387 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:27.972055 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fa7b4-7d48-48f7-9a8e-732a7bbf20f2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:28.001455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:28.006708 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d05344-92fc-4abd-aba7-1af79f943679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:28.008153 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05344-92fc-4abd-aba7-1af79f943679 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:28.008446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05344-92fc-4abd-aba7-1af79f943679 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:28.008888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05344-92fc-4abd-aba7-1af79f943679 None admin] PATH_INFO: `/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:28.010139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d05344-92fc-4abd-aba7-1af79f943679 None admin] RBAC: Authorizing `identity:get_project(project_id=b23b3964eb0b4e7c856d698cf2bf45ce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:28.011635 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d05344-92fc-4abd-aba7-1af79f943679 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:28.013451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 221/449] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:27 2022] GET /identity/v3/projects/b23b3964eb0b4e7c856d698cf2bf45ce => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:28.019420 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d05344-92fc-4abd-aba7-1af79f943679 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:28.089642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fa7b4-7d48-48f7-9a8e-732a7bbf20f2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:28.134726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a722d3-1ef1-4315-aff8-2893243dc9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:28.135374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a722d3-1ef1-4315-aff8-2893243dc9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:28.135658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a722d3-1ef1-4315-aff8-2893243dc9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:28.135932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a722d3-1ef1-4315-aff8-2893243dc9e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:28.143180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d05344-92fc-4abd-aba7-1af79f943679 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:28.185105 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae3a15-ebcf-4fff-8f3b-4dc86d7c37ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:28.185983 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae3a15-ebcf-4fff-8f3b-4dc86d7c37ea None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:28.186628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae3a15-ebcf-4fff-8f3b-4dc86d7c37ea None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:28.186918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae3a15-ebcf-4fff-8f3b-4dc86d7c37ea None admin] PATH_INFO: `/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:28.188481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae3a15-ebcf-4fff-8f3b-4dc86d7c37ea None admin] RBAC: Authorizing `identity:get_group(group_id=62edd6e447ab4817bba5ad2bcd36c1b3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:28.190246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae3a15-ebcf-4fff-8f3b-4dc86d7c37ea None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:28.192485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 222/450] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:28 2022] GET /identity/v3/groups/62edd6e447ab4817bba5ad2bcd36c1b3 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:28.198277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae3a15-ebcf-4fff-8f3b-4dc86d7c37ea None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:28.218200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a722d3-1ef1-4315-aff8-2893243dc9e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:28.219576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:28.219698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a722d3-1ef1-4315-aff8-2893243dc9e7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:28.250603 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:28.307134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae3a15-ebcf-4fff-8f3b-4dc86d7c37ea None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:28.321713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 229/451] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 15:45:28.327188 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a722d3-1ef1-4315-aff8-2893243dc9e7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:28.340273 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3f174-ffdb-44f4-a222-4a4a75eed522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:28.341083 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3f174-ffdb-44f4-a222-4a4a75eed522 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:28.341391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3f174-ffdb-44f4-a222-4a4a75eed522 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:28.341673 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3f174-ffdb-44f4-a222-4a4a75eed522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:28.343086 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3f174-ffdb-44f4-a222-4a4a75eed522 None admin] RBAC: Adding query filter params (group.id=62edd6e447ab4817bba5ad2bcd36c1b3, role.id=f9b113934dbd49218d427f6cacaabf8f, scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:28.343086 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3f174-ffdb-44f4-a222-4a4a75eed522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:28.344398 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3f174-ffdb-44f4-a222-4a4a75eed522 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:28.352565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 223/452] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Jun 2 15:45:28 2022] GET /identity/v3/role_assignments?group.id=62edd6e447ab4817bba5ad2bcd36c1b3&scope.project.id=b23b3964eb0b4e7c856d698cf2bf45ce&role.id=f9b113934dbd49218d427f6cacaabf8f => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:28.437004 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a722d3-1ef1-4315-aff8-2893243dc9e7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:28.464459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:28.477247 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0306d4-bc8c-4f2c-8542-3a22e2b0f459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:28.477247 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0306d4-bc8c-4f2c-8542-3a22e2b0f459 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:28.477247 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0306d4-bc8c-4f2c-8542-3a22e2b0f459 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:28.477247 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0306d4-bc8c-4f2c-8542-3a22e2b0f459 None admin] PATH_INFO: `/v3/projects/6cbd1e15210e404da74f1144aa119ef8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:28.477668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0306d4-bc8c-4f2c-8542-3a22e2b0f459 None admin] RBAC: Authorizing `identity:get_project(project_id=6cbd1e15210e404da74f1144aa119ef8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:28.477668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0306d4-bc8c-4f2c-8542-3a22e2b0f459 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:28.478098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 230/453] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:45:28 2022] GET /identity/v3/projects/6cbd1e15210e404da74f1144aa119ef8 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:28.483735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3f174-ffdb-44f4-a222-4a4a75eed522 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:28.569151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:28.587730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3f174-ffdb-44f4-a222-4a4a75eed522 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:28.622439 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad25c9f-aa88-40f4-902a-7a491542764c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:28.623289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad25c9f-aa88-40f4-902a-7a491542764c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:28.623573 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad25c9f-aa88-40f4-902a-7a491542764c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:28.623851 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad25c9f-aa88-40f4-902a-7a491542764c None admin] PATH_INFO: `/v3/groups/28948219b4f94d639cb64bdc8125d4f5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:28.625040 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad25c9f-aa88-40f4-902a-7a491542764c None admin] RBAC: Authorizing `identity:get_group(group_id=28948219b4f94d639cb64bdc8125d4f5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:28.626469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad25c9f-aa88-40f4-902a-7a491542764c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:28.628176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 224/454] 10.222.0.50 () {56 vars in 1180 bytes} [Thu Jun 2 15:45:28 2022] GET /identity/v3/groups/28948219b4f94d639cb64bdc8125d4f5 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:28.634064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0306d4-bc8c-4f2c-8542-3a22e2b0f459 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:28.737040 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0306d4-bc8c-4f2c-8542-3a22e2b0f459 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:28.769242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae292b-4a86-4fd9-a025-dfb57f2a90a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:28.769910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae292b-4a86-4fd9-a025-dfb57f2a90a3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:28.770192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae292b-4a86-4fd9-a025-dfb57f2a90a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:28.770468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae292b-4a86-4fd9-a025-dfb57f2a90a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:28.771287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae292b-4a86-4fd9-a025-dfb57f2a90a3 None admin] RBAC: Adding query filter params (group.id=28948219b4f94d639cb64bdc8125d4f5, role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=6cbd1e15210e404da74f1144aa119ef8) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:28.771599 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae292b-4a86-4fd9-a025-dfb57f2a90a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:28.773656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae292b-4a86-4fd9-a025-dfb57f2a90a3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:28.779188 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 231/455] 10.222.0.50 () {56 vars in 1376 bytes} [Thu Jun 2 15:45:28 2022] GET /identity/v3/role_assignments?group.id=28948219b4f94d639cb64bdc8125d4f5&scope.project.id=6cbd1e15210e404da74f1144aa119ef8&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:31.725216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c28838-7a9a-47a5-a49a-03c20045f93e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:31.727228 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c28838-7a9a-47a5-a49a-03c20045f93e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:31.727228 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c28838-7a9a-47a5-a49a-03c20045f93e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:31.728439 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 225/456] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:31.733373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f2bea-e9f2-459e-b134-756323f149e7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:31.734682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f2bea-e9f2-459e-b134-756323f149e7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:31.734682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f2bea-e9f2-459e-b134-756323f149e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:31.760983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dd2f2bea-e9f2-459e-b134-756323f149e7 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:31.762182 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dd2f2bea-e9f2-459e-b134-756323f149e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:31.786413 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca526-9419-4dcb-8578-3763f8ac41a4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:31.787061 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca526-9419-4dcb-8578-3763f8ac41a4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:31.787550 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cca526-9419-4dcb-8578-3763f8ac41a4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:31.789418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 226/457] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:31.794446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dadc6b-5493-4b46-9a24-b7157c23d10a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:31.794974 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dadc6b-5493-4b46-9a24-b7157c23d10a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:31.795452 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dadc6b-5493-4b46-9a24-b7157c23d10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:31.811916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e0dadc6b-5493-4b46-9a24-b7157c23d10a None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:31.813455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e0dadc6b-5493-4b46-9a24-b7157c23d10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:31.855731 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:31.884569 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 232/458] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:31.924821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 227/459] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:31.954054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f2bea-e9f2-459e-b134-756323f149e7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:31.959294 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dadc6b-5493-4b46-9a24-b7157c23d10a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:32.079571 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:32.084371 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f2bea-e9f2-459e-b134-756323f149e7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:32.101082 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dadc6b-5493-4b46-9a24-b7157c23d10a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:32.121958 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f77260-dc3e-4b0b-b41b-88f5e480e77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:32.122754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f77260-dc3e-4b0b-b41b-88f5e480e77f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.123038 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f77260-dc3e-4b0b-b41b-88f5e480e77f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.123315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f77260-dc3e-4b0b-b41b-88f5e480e77f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.133816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f77260-dc3e-4b0b-b41b-88f5e480e77f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:32.135261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f77260-dc3e-4b0b-b41b-88f5e480e77f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:32.140311 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b547f-1e2d-47a2-816d-6037835d5daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:32.141309 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b547f-1e2d-47a2-816d-6037835d5daf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.141765 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b547f-1e2d-47a2-816d-6037835d5daf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.142194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b547f-1e2d-47a2-816d-6037835d5daf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.153423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b547f-1e2d-47a2-816d-6037835d5daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:32.154780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f8f77260-dc3e-4b0b-b41b-88f5e480e77f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:32.154780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:32.154780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:32.154780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:32.154780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:32.154780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:32.154780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:32.154780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:32.154780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:32.154780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:32.154780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:32.154780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:32.154780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:32.154780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:32.154780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:32.155669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:32.156594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:32.156594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:32.156594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:32.156594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:32.156594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 233/460] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:32.157604 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b547f-1e2d-47a2-816d-6037835d5daf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:32.158352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4befd4-3b58-4015-b2fa-bb2b15d5cd9a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.158758 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4befd4-3b58-4015-b2fa-bb2b15d5cd9a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.159106 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4befd4-3b58-4015-b2fa-bb2b15d5cd9a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.160771 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 234/461] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:32.161685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4befd4-3b58-4015-b2fa-bb2b15d5cd9a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:32.181776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-855b547f-1e2d-47a2-816d-6037835d5daf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:32.181776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:32.181776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:32.181776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:32.181776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:32.181776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:32.181776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:32.181776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:32.181776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:32.181776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:32.181776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:32.181776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:32.181776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:32.181776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:32.181776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:32.182701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:32.183959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:32.183959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:32.183959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:32.183959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:32.187827 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 228/462] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:32.189176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03560dbe-493d-47e0-8c3e-e98f668bd617 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.189469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03560dbe-493d-47e0-8c3e-e98f668bd617 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.189751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03560dbe-493d-47e0-8c3e-e98f668bd617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.206856 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-03560dbe-493d-47e0-8c3e-e98f668bd617 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:32.208334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-03560dbe-493d-47e0-8c3e-e98f668bd617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:32.213751 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:32.274616 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4befd4-3b58-4015-b2fa-bb2b15d5cd9a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:32.280203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 229/463] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:32.281208 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03560dbe-493d-47e0-8c3e-e98f668bd617 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:32.321441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1745cba-d02d-42d3-8649-9b60b4dbadec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:32.322104 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1745cba-d02d-42d3-8649-9b60b4dbadec None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.322386 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1745cba-d02d-42d3-8649-9b60b4dbadec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.322660 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1745cba-d02d-42d3-8649-9b60b4dbadec None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.323377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1745cba-d02d-42d3-8649-9b60b4dbadec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:32.323682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1745cba-d02d-42d3-8649-9b60b4dbadec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:32.325095 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1745cba-d02d-42d3-8649-9b60b4dbadec None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:32.338376 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 235/464] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:32.340136 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a2a5a-8028-4584-a73f-218b4117f768 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.340645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a2a5a-8028-4584-a73f-218b4117f768 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.341128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a2a5a-8028-4584-a73f-218b4117f768 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.343007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 236/465] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:32.344081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a2a5a-8028-4584-a73f-218b4117f768 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:32.361419 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:32.407381 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03560dbe-493d-47e0-8c3e-e98f668bd617 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:32.443568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd105ed-9b0f-4e73-83e4-2dd7b48cd524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:32.444254 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd105ed-9b0f-4e73-83e4-2dd7b48cd524 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.445110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd105ed-9b0f-4e73-83e4-2dd7b48cd524 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.445389 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd105ed-9b0f-4e73-83e4-2dd7b48cd524 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.446102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd105ed-9b0f-4e73-83e4-2dd7b48cd524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:32.446412 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd105ed-9b0f-4e73-83e4-2dd7b48cd524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:32.447849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd105ed-9b0f-4e73-83e4-2dd7b48cd524 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:32.460461 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a2a5a-8028-4584-a73f-218b4117f768 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:32.462544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:32.469531 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 230/466] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:32.469531 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd105ed-9b0f-4e73-83e4-2dd7b48cd524 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:32.499704 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e3aae-b574-4ca5-a192-c96a11c2ed9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:32.500523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e3aae-b574-4ca5-a192-c96a11c2ed9c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.500811 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e3aae-b574-4ca5-a192-c96a11c2ed9c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.501259 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e3aae-b574-4ca5-a192-c96a11c2ed9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.513711 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e3aae-b574-4ca5-a192-c96a11c2ed9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:32.515679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873e3aae-b574-4ca5-a192-c96a11c2ed9c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:32.539922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-873e3aae-b574-4ca5-a192-c96a11c2ed9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:32.539922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:32.539922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:32.539922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:32.539922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:32.539922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:32.539922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:32.539922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:32.539922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:32.539922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:32.539922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:32.539922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:32.539922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:32.539922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:32.539922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:32.540974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:32.541882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:32.541882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:32.541882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:32.541882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:32.542093 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 237/467] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:32.547595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7ea5-0f5e-4fc2-939c-45bbe913b5cd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.547595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7ea5-0f5e-4fc2-939c-45bbe913b5cd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.547595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7ea5-0f5e-4fc2-939c-45bbe913b5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.564960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-604a7ea5-0f5e-4fc2-939c-45bbe913b5cd None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:32.566139 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-604a7ea5-0f5e-4fc2-939c-45bbe913b5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:32.577767 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd105ed-9b0f-4e73-83e4-2dd7b48cd524 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:32.600524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:32.612083 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f7b95-4412-4934-9234-a2e062ffb264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:32.617225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f7b95-4412-4934-9234-a2e062ffb264 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.617225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f7b95-4412-4934-9234-a2e062ffb264 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.617225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f7b95-4412-4934-9234-a2e062ffb264 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.617225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f7b95-4412-4934-9234-a2e062ffb264 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:32.617225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f7b95-4412-4934-9234-a2e062ffb264 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:32.635938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 238/468] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:32.636827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7ea5-0f5e-4fc2-939c-45bbe913b5cd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:32.718774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:32.720374 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 231/469] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:45:32 2022] POST /identity/v3/users => generated 246 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:32.721207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f7b95-4412-4934-9234-a2e062ffb264 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:32.735722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7ea5-0f5e-4fc2-939c-45bbe913b5cd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:32.774858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea51531-b0a1-4301-bec0-e8145f4923d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:32.775543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea51531-b0a1-4301-bec0-e8145f4923d0 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.775829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea51531-b0a1-4301-bec0-e8145f4923d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.776139 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea51531-b0a1-4301-bec0-e8145f4923d0 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.776873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea51531-b0a1-4301-bec0-e8145f4923d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:32.778351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea51531-b0a1-4301-bec0-e8145f4923d0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:32.833237 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f7b95-4412-4934-9234-a2e062ffb264 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:32.863864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 239/470] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:45:32 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:32.864733 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea51531-b0a1-4301-bec0-e8145f4923d0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:32.875860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a80dc3-ebf4-4350-8358-8fa04ff3cf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:32.878077 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a80dc3-ebf4-4350-8358-8fa04ff3cf90 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.878579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a80dc3-ebf4-4350-8358-8fa04ff3cf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.879002 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a80dc3-ebf4-4350-8358-8fa04ff3cf90 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.879923 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a80dc3-ebf4-4350-8358-8fa04ff3cf90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:32.880461 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a80dc3-ebf4-4350-8358-8fa04ff3cf90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:32.882209 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a80dc3-ebf4-4350-8358-8fa04ff3cf90 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:32.907514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 232/471] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:32.907514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989685c-6638-4c23-8f9a-3cfb43e608fe None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:32.907514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989685c-6638-4c23-8f9a-3cfb43e608fe None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:32.907514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989685c-6638-4c23-8f9a-3cfb43e608fe None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:32.912166 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 233/472] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:32.914570 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989685c-6638-4c23-8f9a-3cfb43e608fe None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:32.981553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:33.019037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea51531-b0a1-4301-bec0-e8145f4923d0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:33.062784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98151f37-fae5-4b83-bddf-3f5aca33607e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:33.063684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98151f37-fae5-4b83-bddf-3f5aca33607e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:33.063973 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98151f37-fae5-4b83-bddf-3f5aca33607e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:33.064373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98151f37-fae5-4b83-bddf-3f5aca33607e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:33.068770 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989685c-6638-4c23-8f9a-3cfb43e608fe None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:33.075361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:33.078699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98151f37-fae5-4b83-bddf-3f5aca33607e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:33.080361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98151f37-fae5-4b83-bddf-3f5aca33607e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:33.102530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-98151f37-fae5-4b83-bddf-3f5aca33607e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:33.102530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:33.102530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:33.102530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:33.102530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:33.102530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:33.102530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:33.102530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:33.102530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:33.102530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:33.102530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:33.102530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:33.102530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:33.102530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:33.102530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:33.103629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:33.109073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:33.109073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:33.109073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:33.109073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:33.109073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 240/473] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:33.109073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed9e6c-eddd-4328-bf71-ccbde4c92f2b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:33.109073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed9e6c-eddd-4328-bf71-ccbde4c92f2b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:33.109073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed9e6c-eddd-4328-bf71-ccbde4c92f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:33.119704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164df516-f97b-4fff-8183-fb86aead748b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:33.120592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164df516-f97b-4fff-8183-fb86aead748b None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:33.120997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164df516-f97b-4fff-8183-fb86aead748b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:33.121278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164df516-f97b-4fff-8183-fb86aead748b None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:33.122228 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164df516-f97b-4fff-8183-fb86aead748b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:33.123593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164df516-f97b-4fff-8183-fb86aead748b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:33.124760 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-33ed9e6c-eddd-4328-bf71-ccbde4c92f2b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:33.126028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-33ed9e6c-eddd-4328-bf71-ccbde4c92f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:33.202725 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 241/474] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:33.203417 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed9e6c-eddd-4328-bf71-ccbde4c92f2b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:33.238908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 234/475] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:45:32 2022] POST /identity/v3/users => generated 248 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:33.239737 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164df516-f97b-4fff-8183-fb86aead748b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:33.386549 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed9e6c-eddd-4328-bf71-ccbde4c92f2b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:33.434313 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:33.447269 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d8968-f8e3-4d80-aea3-01bb1b5b9892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:33.448173 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d8968-f8e3-4d80-aea3-01bb1b5b9892 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:33.448271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d8968-f8e3-4d80-aea3-01bb1b5b9892 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:33.448513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d8968-f8e3-4d80-aea3-01bb1b5b9892 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:33.449247 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d8968-f8e3-4d80-aea3-01bb1b5b9892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:33.449558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d8968-f8e3-4d80-aea3-01bb1b5b9892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:33.450170 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:33.451077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d8968-f8e3-4d80-aea3-01bb1b5b9892 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:33.466007 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164df516-f97b-4fff-8183-fb86aead748b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:33.468091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 242/476] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:33.469554 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d8968-f8e3-4d80-aea3-01bb1b5b9892 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:33.526499 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dad5ba-9972-4862-b595-6014c8a52134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:33.527188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dad5ba-9972-4862-b595-6014c8a52134 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:33.527476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dad5ba-9972-4862-b595-6014c8a52134 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:33.528376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dad5ba-9972-4862-b595-6014c8a52134 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:33.529178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dad5ba-9972-4862-b595-6014c8a52134 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:33.531064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dad5ba-9972-4862-b595-6014c8a52134 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:33.565667 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.sql.core [None req-01dad5ba-9972-4862-b595-6014c8a52134 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 15:45:33.565667 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 15:45:33.565667 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [parameters: {'id': '7b68985ed48148098eea9b07e6632713', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 15:45:33.565667 dv-cinder-797608-27-smb devstack@keystone.service[80316]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80316) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 15:45:33.589873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-01dad5ba-9972-4862-b595-6014c8a52134 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 15:45:33.589873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:33.589873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 15:45:33.589873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 15:45:33.589873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 15:45:33.589873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 15:45:33.589873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 15:45:33.589873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 15:45:33.589873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 15:45:33.589873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) Jun 02 15:45:33.589873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 15:45:33.589873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 15:45:33.589873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 15:45:33.589873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() Jun 02 15:45:33.589873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return ref.to_dict() Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 15:45:33.590789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application yield resource Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise self.value Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application session.commit() Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 15:45:33.591723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.flush() Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application compat.raise_( Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 15:45:33.593141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 15:45:33.594045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 15:45:33.594045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 15:45:33.594045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 15:45:33.594045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 15:45:33.594045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 15:45:33.594045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 15:45:33.594045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 15:45:33.594045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 15:45:33.594045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 15:45:33.594045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 15:45:33.594045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 15:45:33.594045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 15:45:33.594045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 15:45:33.594045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 15:45:33.594045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 15:45:33.594045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception Jun 02 15:45:33.596366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 15:45:33.596366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 15:45:33.596366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 15:45:33.596366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 15:45:33.596366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 15:45:33.596366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 15:45:33.596366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 15:45:33.596366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) Jun 02 15:45:33.596366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 15:45:33.596366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 15:45:33.596366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 15:45:33.596366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() Jun 02 15:45:33.596366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 15:45:33.596366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 15:45:33.596366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 15:45:33.596366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 15:45:33.597711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 15:45:33.597711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 15:45:33.597711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 15:45:33.597711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 15:45:33.597711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 15:45:33.597711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 15:45:33.597711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [parameters: {'id': '7b68985ed48148098eea9b07e6632713', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 15:45:33.597711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 15:45:33.597711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:33.597711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:45:33.597711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:33.597711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:33.597711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:33.597711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:33.597711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:33.597711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:33.598720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:33.598720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:33.598720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:33.598720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:33.598720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:33.598720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:33.598720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 02 15:45:33.598720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 02 15:45:33.598720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:33.598720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:33.598720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 02 15:45:33.598720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 02 15:45:33.598720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 15:45:33.598720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 15:45:33.598720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 15:45:33.598720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:33.599750 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 235/477] 10.222.0.50 () {60 vars in 1131 bytes} [Thu Jun 2 15:45:33 2022] POST /identity/v3/roles => generated 144 bytes in 352 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:33.609023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dad5ba-9972-4862-b595-6014c8a52134 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:33.617506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d8968-f8e3-4d80-aea3-01bb1b5b9892 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:33.661864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d5442-8852-47b0-85d9-9275283d222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:33.662712 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d5442-8852-47b0-85d9-9275283d222f None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:33.663005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d5442-8852-47b0-85d9-9275283d222f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:33.663353 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d5442-8852-47b0-85d9-9275283d222f None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:33.664567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d5442-8852-47b0-85d9-9275283d222f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:33.666334 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d5442-8852-47b0-85d9-9275283d222f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:33.730228 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dad5ba-9972-4862-b595-6014c8a52134 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:33.772294 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 243/478] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:45:33 2022] POST /identity/v3/users => generated 249 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:33.777002 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca6c6d-800c-495b-b9e0-d7b3e136c699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:33.778113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca6c6d-800c-495b-b9e0-d7b3e136c699 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:33.778799 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca6c6d-800c-495b-b9e0-d7b3e136c699 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:33.779303 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca6c6d-800c-495b-b9e0-d7b3e136c699 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:33.800839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca6c6d-800c-495b-b9e0-d7b3e136c699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:33.814535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-83ca6c6d-800c-495b-b9e0-d7b3e136c699 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:33.814535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:33.814535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:33.814535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:33.814535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:33.814535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:33.814535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:33.814535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:33.814535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:33.814535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:33.814535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:33.814535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:33.814535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:33.814535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:33.814535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:33.814535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:33.815540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:33.815540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:33.815540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:33.815540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:33.815540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:33.815540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:33.815540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:33.815540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:33.815540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:33.815540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:33.815540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:33.815540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:33.815540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:33.815540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:33.815540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:33.815540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:33.816410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:33.816410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:33.816410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:33.816410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:33.816410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:33.816410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:33.816410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:33.816410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:33.816410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:33.816410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:33.816410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 15:45:33.816410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:33.819235 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 236/479] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:45:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:33.825285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d5442-8852-47b0-85d9-9275283d222f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:33.886902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:33.952097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d5442-8852-47b0-85d9-9275283d222f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:33.989948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd902f-450a-497d-aadd-f2965ebc5888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:33.990645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd902f-450a-497d-aadd-f2965ebc5888 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:33.990932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd902f-450a-497d-aadd-f2965ebc5888 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:33.991241 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd902f-450a-497d-aadd-f2965ebc5888 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:33.992293 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd902f-450a-497d-aadd-f2965ebc5888 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:33.992610 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd902f-450a-497d-aadd-f2965ebc5888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:33.994001 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd902f-450a-497d-aadd-f2965ebc5888 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:34.003632 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 244/480] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:35.516637 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12649a01-3870-4765-b457-1a285d2d6c1a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.517633 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4b020-fa16-4896-9b4d-2096d3aaf6e5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.518404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12649a01-3870-4765-b457-1a285d2d6c1a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.518916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4b020-fa16-4896-9b4d-2096d3aaf6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.519422 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12649a01-3870-4765-b457-1a285d2d6c1a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:35.519907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4b020-fa16-4896-9b4d-2096d3aaf6e5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:35.523313 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 245/481] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:35.523701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 237/482] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:35.526950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442701f-4c5d-4594-8ede-f8d6fdb2b1f2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.527486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442701f-4c5d-4594-8ede-f8d6fdb2b1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.528025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442701f-4c5d-4594-8ede-f8d6fdb2b1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:35.533970 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8819e92-be9e-49b3-9321-04c68c321089 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.534489 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8819e92-be9e-49b3-9321-04c68c321089 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.534970 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8819e92-be9e-49b3-9321-04c68c321089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:35.563187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0442701f-4c5d-4594-8ede-f8d6fdb2b1f2 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:35.564434 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b8819e92-be9e-49b3-9321-04c68c321089 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:35.565347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0442701f-4c5d-4594-8ede-f8d6fdb2b1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:35.566047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b8819e92-be9e-49b3-9321-04c68c321089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:35.584276 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:35.655243 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 238/483] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:35.695161 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 246/484] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:35.699490 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8819e92-be9e-49b3-9321-04c68c321089 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:35.742520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442701f-4c5d-4594-8ede-f8d6fdb2b1f2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:35.808411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:35.815217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8819e92-be9e-49b3-9321-04c68c321089 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:35.853620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295051ea-07fb-46ce-b650-f40fcb6912c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:35.854420 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295051ea-07fb-46ce-b650-f40fcb6912c4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:35.854710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295051ea-07fb-46ce-b650-f40fcb6912c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:35.854992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295051ea-07fb-46ce-b650-f40fcb6912c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:35.867784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295051ea-07fb-46ce-b650-f40fcb6912c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:35.876216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-295051ea-07fb-46ce-b650-f40fcb6912c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:35.876216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:35.876216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:35.876216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:35.876216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:35.876216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:35.876216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:35.876216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:35.876216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:35.876216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:35.876216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:35.876216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:35.876216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:35.876216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:35.876216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:35.876216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:35.877131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:35.877131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:35.877131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:35.877131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:35.877131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:35.877131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:35.877131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:35.877131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:35.877131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:35.877131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:35.877131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:35.877131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:35.877131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:35.877131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:35.877131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:35.877131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:35.877949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:35.877949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:35.877949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:35.877949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:35.877949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:35.877949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:35.877949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:35.877949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:35.877949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:35.877949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:35.877949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:35.877949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:35.878564 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 239/485] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:35.883955 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295051ea-07fb-46ce-b650-f40fcb6912c4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:35.896643 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:35.963028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442701f-4c5d-4594-8ede-f8d6fdb2b1f2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.026249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3511d9d-87ff-4ab1-8d68-3e02b0948223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.026249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3511d9d-87ff-4ab1-8d68-3e02b0948223 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.026515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3511d9d-87ff-4ab1-8d68-3e02b0948223 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.026742 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3511d9d-87ff-4ab1-8d68-3e02b0948223 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.046653 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295051ea-07fb-46ce-b650-f40fcb6912c4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.049152 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3511d9d-87ff-4ab1-8d68-3e02b0948223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:36.057840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f3511d9d-87ff-4ab1-8d68-3e02b0948223 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:36.057840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:36.057840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:36.057840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:36.057840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:36.057840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:36.057840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:36.057840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:36.057840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:36.057840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:36.057840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:36.057840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:36.057840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:36.057840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:36.057840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:36.057840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:36.058749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:36.058749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:36.058749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:36.058749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:36.058749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:36.058749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:36.058749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:36.058749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:36.058749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:36.058749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:36.058749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:36.058749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:36.058749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:36.058749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:36.058749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:36.058749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:36.059544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:36.059544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:36.059544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:36.059544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:36.059544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:36.059544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:36.059544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:36.059544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:36.059544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:36.059544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:36.059544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:36.059544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:36.068437 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 247/486] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:36.075232 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3511d9d-87ff-4ab1-8d68-3e02b0948223 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.085833 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a3b0a-1367-4c07-aa07-5d81f0bbcd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.086751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a3b0a-1367-4c07-aa07-5d81f0bbcd67 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.087209 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a3b0a-1367-4c07-aa07-5d81f0bbcd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.087757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a3b0a-1367-4c07-aa07-5d81f0bbcd67 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.088796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a3b0a-1367-4c07-aa07-5d81f0bbcd67 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:36.089281 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a3b0a-1367-4c07-aa07-5d81f0bbcd67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.090817 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a3b0a-1367-4c07-aa07-5d81f0bbcd67 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:36.100232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 240/487] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:45:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:36.107119 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a3b0a-1367-4c07-aa07-5d81f0bbcd67 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.195050 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:36.200447 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:36.205607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3511d9d-87ff-4ab1-8d68-3e02b0948223 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.239700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a3b0a-1367-4c07-aa07-5d81f0bbcd67 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.242346 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07765aa-269f-4b94-a035-cb218b509ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.242964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07765aa-269f-4b94-a035-cb218b509ceb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.243254 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07765aa-269f-4b94-a035-cb218b509ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.243535 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07765aa-269f-4b94-a035-cb218b509ceb None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.244315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07765aa-269f-4b94-a035-cb218b509ceb None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:36.244628 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07765aa-269f-4b94-a035-cb218b509ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.246019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07765aa-269f-4b94-a035-cb218b509ceb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:36.254672 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 248/488] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:36.255848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b782a1f-1ac9-4b52-941d-975f95a9f1ae None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.256171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b782a1f-1ac9-4b52-941d-975f95a9f1ae None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.256455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b782a1f-1ac9-4b52-941d-975f95a9f1ae None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.263037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 249/489] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:36.264232 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b782a1f-1ac9-4b52-941d-975f95a9f1ae None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.288879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96883264-6ba8-43ff-97ee-4f78fd624534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.290275 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96883264-6ba8-43ff-97ee-4f78fd624534 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.291022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96883264-6ba8-43ff-97ee-4f78fd624534 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.291915 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96883264-6ba8-43ff-97ee-4f78fd624534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.306560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96883264-6ba8-43ff-97ee-4f78fd624534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.309006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96883264-6ba8-43ff-97ee-4f78fd624534 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:36.342006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-96883264-6ba8-43ff-97ee-4f78fd624534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:36.342006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:36.342006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:36.342006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:36.342006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:36.342006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:36.342006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:36.342006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:36.342006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:36.342006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:36.342006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:36.342006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:36.342006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:36.342006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:36.342006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:36.342949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:36.343804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:36.343804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:36.343804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:36.343804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:36.343804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 241/490] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:36.345290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6e4dd-b4df-4ad3-9621-bc5ad3fe556a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.345597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6e4dd-b4df-4ad3-9621-bc5ad3fe556a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.345877 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6e4dd-b4df-4ad3-9621-bc5ad3fe556a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.368647 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-31a6e4dd-b4df-4ad3-9621-bc5ad3fe556a None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:36.370174 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-31a6e4dd-b4df-4ad3-9621-bc5ad3fe556a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:36.386199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b782a1f-1ac9-4b52-941d-975f95a9f1ae None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.427164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ceb0b-2987-4f2f-a890-0a231a5baf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.428034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ceb0b-2987-4f2f-a890-0a231a5baf58 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.428318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ceb0b-2987-4f2f-a890-0a231a5baf58 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.428641 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ceb0b-2987-4f2f-a890-0a231a5baf58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.440080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ceb0b-2987-4f2f-a890-0a231a5baf58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.441698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ceb0b-2987-4f2f-a890-0a231a5baf58 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:36.457381 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 242/491] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:36.458560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6e4dd-b4df-4ad3-9621-bc5ad3fe556a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.462506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6d0ceb0b-2987-4f2f-a890-0a231a5baf58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:36.462506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:36.462506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:36.462506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:36.462506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:36.462506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:36.462506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:36.462506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:36.462506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:36.462506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:36.462506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:36.462506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:36.462506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:36.462506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:36.462506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:36.463379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:36.464598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:36.464598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:36.464598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:36.464598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:36.467626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 250/492] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:36.468966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ceb0b-2987-4f2f-a890-0a231a5baf58 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.473590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:36.530451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:36.583728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ceb0b-2987-4f2f-a890-0a231a5baf58 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.594173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6e4dd-b4df-4ad3-9621-bc5ad3fe556a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.623469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377a265-1c02-4a67-8221-801058bd2488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.624486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377a265-1c02-4a67-8221-801058bd2488 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.624779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377a265-1c02-4a67-8221-801058bd2488 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.625060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a377a265-1c02-4a67-8221-801058bd2488 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.625884 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377a265-1c02-4a67-8221-801058bd2488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:36.626201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377a265-1c02-4a67-8221-801058bd2488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.627699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a377a265-1c02-4a67-8221-801058bd2488 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:36.639974 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a830f-5b13-4c16-9c0f-f2ad3356ca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.641056 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a830f-5b13-4c16-9c0f-f2ad3356ca40 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.641515 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a830f-5b13-4c16-9c0f-f2ad3356ca40 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.641939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a830f-5b13-4c16-9c0f-f2ad3356ca40 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.642830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a830f-5b13-4c16-9c0f-f2ad3356ca40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:36.643285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a830f-5b13-4c16-9c0f-f2ad3356ca40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.644877 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a830f-5b13-4c16-9c0f-f2ad3356ca40 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:36.647401 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 251/493] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:36.649210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377a265-1c02-4a67-8221-801058bd2488 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.661341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 243/494] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:36.662898 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a830f-5b13-4c16-9c0f-f2ad3356ca40 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.723413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:36.763593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a377a265-1c02-4a67-8221-801058bd2488 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.773750 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a830f-5b13-4c16-9c0f-f2ad3356ca40 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.787028 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:36.802188 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557805b-ff3d-4e23-8ff2-c5b56ef33df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.803246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557805b-ff3d-4e23-8ff2-c5b56ef33df4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.803471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557805b-ff3d-4e23-8ff2-c5b56ef33df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.803778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557805b-ff3d-4e23-8ff2-c5b56ef33df4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.815221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557805b-ff3d-4e23-8ff2-c5b56ef33df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:36.816698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732e2b7-3499-4dac-a186-9526cb842cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.817506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732e2b7-3499-4dac-a186-9526cb842cad None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.817790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732e2b7-3499-4dac-a186-9526cb842cad None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.818069 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732e2b7-3499-4dac-a186-9526cb842cad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.823356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d557805b-ff3d-4e23-8ff2-c5b56ef33df4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:36.823356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:36.823356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:36.823356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:36.823356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:36.823356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:36.823356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:36.823356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:36.823356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:36.823356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:36.823356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:36.823356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:36.823356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:36.823356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:36.823356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:36.823356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:36.824274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:36.824274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:36.824274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:36.824274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:36.824274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:36.824274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:36.824274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:36.824274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:36.824274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:36.824274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:36.824274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:36.824274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:36.824274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:36.824274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:36.824274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:36.824274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:36.830167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:36.830167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:36.830167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:36.830167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:36.830167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:36.830167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:36.830167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:36.830167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:36.830167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:36.830167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:36.830167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:36.830167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:36.830167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 252/495] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:36.830167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557805b-ff3d-4e23-8ff2-c5b56ef33df4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.832427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732e2b7-3499-4dac-a186-9526cb842cad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.833896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732e2b7-3499-4dac-a186-9526cb842cad None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:36.850355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8732e2b7-3499-4dac-a186-9526cb842cad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 15:45:36.850355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:36.850355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:36.850355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:36.850355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:36.850355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:36.850355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:36.850355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:36.850355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:36.850355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:36.850355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:36.850355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:36.850355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:45:36.850355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:45:36.850355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:45:36.850355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:36.851884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:36.852916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:36.852916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:36.852916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:45:36.852916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:45:36.852916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:45:36.852916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:45:36.852916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:45:36.852916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:45:36.852916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 15:45:36.852916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:36.852916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 244/496] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:36.853501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad434035-486d-4db3-bbb3-992ce6266249 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.854051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad434035-486d-4db3-bbb3-992ce6266249 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.854051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad434035-486d-4db3-bbb3-992ce6266249 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.855419 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 245/497] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:36.856688 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad434035-486d-4db3-bbb3-992ce6266249 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:36.937620 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557805b-ff3d-4e23-8ff2-c5b56ef33df4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.961845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:36.968759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad434035-486d-4db3-bbb3-992ce6266249 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:36.974464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc79f01-2b89-4263-8972-ff3a551bb91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:36.974464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc79f01-2b89-4263-8972-ff3a551bb91f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:36.974464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc79f01-2b89-4263-8972-ff3a551bb91f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:36.974464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc79f01-2b89-4263-8972-ff3a551bb91f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:36.982178 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc79f01-2b89-4263-8972-ff3a551bb91f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:36.983853 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc79f01-2b89-4263-8972-ff3a551bb91f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:37.000671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4fc79f01-2b89-4263-8972-ff3a551bb91f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:45:37.000671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:37.000671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:37.000671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:37.000671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:37.000671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:37.000671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:37.000671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:37.000671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:37.000671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:37.000671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:37.000671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:37.000671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:45:37.000671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:45:37.000671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:45:37.000671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:37.001609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:37.002513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:37.002513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:37.002513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:45:37.002513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:45:37.002513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:45:37.002513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:45:37.002513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:45:37.002513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:45:37.002513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:45:37.002513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:37.002513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 253/498] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:37.003091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc79f01-2b89-4263-8972-ff3a551bb91f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:37.004914 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a985f09-63a3-47aa-af40-c97c14ff4863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:37.005886 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a985f09-63a3-47aa-af40-c97c14ff4863 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:37.007609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a985f09-63a3-47aa-af40-c97c14ff4863 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:37.007891 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a985f09-63a3-47aa-af40-c97c14ff4863 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:37.008708 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a985f09-63a3-47aa-af40-c97c14ff4863 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:37.009132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a985f09-63a3-47aa-af40-c97c14ff4863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:37.010506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a985f09-63a3-47aa-af40-c97c14ff4863 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:37.018801 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 246/499] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:45:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:37.019922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98047427-4075-440c-b225-850c234728d0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:37.020229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98047427-4075-440c-b225-850c234728d0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:37.020511 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98047427-4075-440c-b225-850c234728d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:37.037013 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-98047427-4075-440c-b225-850c234728d0 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:37.038344 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-98047427-4075-440c-b225-850c234728d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:37.064656 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:37.101268 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc79f01-2b89-4263-8972-ff3a551bb91f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:37.104969 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 247/500] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:37.106074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351d0c9-704c-48b4-adb7-76e6b3b3b8be None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:37.106370 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351d0c9-704c-48b4-adb7-76e6b3b3b8be None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:37.106655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351d0c9-704c-48b4-adb7-76e6b3b3b8be None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:37.107925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 248/501] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:37.108649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351d0c9-704c-48b4-adb7-76e6b3b3b8be None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:37.140680 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7f9c0-97e1-45cd-924d-28c575518094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:37.141808 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7f9c0-97e1-45cd-924d-28c575518094 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:37.142308 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7f9c0-97e1-45cd-924d-28c575518094 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:37.142806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7f9c0-97e1-45cd-924d-28c575518094 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:37.144396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7f9c0-97e1-45cd-924d-28c575518094 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:37.144940 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7f9c0-97e1-45cd-924d-28c575518094 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:37.148194 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7f9c0-97e1-45cd-924d-28c575518094 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:37.187144 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 254/502] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Jun 2 15:45:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:37.188271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7f9c0-97e1-45cd-924d-28c575518094 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:37.209689 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351d0c9-704c-48b4-adb7-76e6b3b3b8be None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:37.231150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:37.244322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638906a-2022-43ca-b0b3-38e0560ef064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:37.244981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638906a-2022-43ca-b0b3-38e0560ef064 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:37.245262 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638906a-2022-43ca-b0b3-38e0560ef064 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:37.247110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638906a-2022-43ca-b0b3-38e0560ef064 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:37.247110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638906a-2022-43ca-b0b3-38e0560ef064 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:37.247110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638906a-2022-43ca-b0b3-38e0560ef064 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:37.248075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638906a-2022-43ca-b0b3-38e0560ef064 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:37.283327 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 249/503] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Jun 2 15:45:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:37.284565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f95ef8-70ce-4dfe-b212-e0bbd1578640 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:37.284859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f95ef8-70ce-4dfe-b212-e0bbd1578640 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:37.285149 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f95ef8-70ce-4dfe-b212-e0bbd1578640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:37.290241 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7f9c0-97e1-45cd-924d-28c575518094 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:37.301416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b6f95ef8-70ce-4dfe-b212-e0bbd1578640 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:37.302598 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b6f95ef8-70ce-4dfe-b212-e0bbd1578640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:37.318449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:37.323441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61774ca5-e80a-4a73-b7c0-d7a3971643be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:37.324261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61774ca5-e80a-4a73-b7c0-d7a3971643be None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:37.324544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61774ca5-e80a-4a73-b7c0-d7a3971643be None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:37.324821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61774ca5-e80a-4a73-b7c0-d7a3971643be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:37.334476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61774ca5-e80a-4a73-b7c0-d7a3971643be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:37.336025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61774ca5-e80a-4a73-b7c0-d7a3971643be None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:37.353561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-61774ca5-e80a-4a73-b7c0-d7a3971643be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:37.353561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:37.353561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:37.353561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:37.353561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:37.353561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:37.353561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:37.353561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:37.353561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:37.353561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:37.353561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:37.353561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:37.353561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:37.353561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:37.353561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:37.354441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:37.355297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:37.355297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:37.355297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:37.355297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:37.355297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 255/504] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:37.355569 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61774ca5-e80a-4a73-b7c0-d7a3971643be None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:37.370384 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 250/505] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:37.371240 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f95ef8-70ce-4dfe-b212-e0bbd1578640 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:37.454806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:37.461958 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61774ca5-e80a-4a73-b7c0-d7a3971643be None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:37.471741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f95ef8-70ce-4dfe-b212-e0bbd1578640 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:37.497019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090d5a4-285b-43d4-a547-46da7c6b838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:37.497817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090d5a4-285b-43d4-a547-46da7c6b838b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:37.498105 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090d5a4-285b-43d4-a547-46da7c6b838b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:37.498381 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090d5a4-285b-43d4-a547-46da7c6b838b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:37.506652 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343c857-0cc4-4db1-a8d1-083dc9323798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:37.507912 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343c857-0cc4-4db1-a8d1-083dc9323798 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:37.508235 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343c857-0cc4-4db1-a8d1-083dc9323798 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:37.508510 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343c857-0cc4-4db1-a8d1-083dc9323798 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:37.509069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090d5a4-285b-43d4-a547-46da7c6b838b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:37.516909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f090d5a4-285b-43d4-a547-46da7c6b838b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:37.516909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:37.516909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:37.516909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:37.516909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:37.516909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:37.516909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:37.516909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:37.516909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:37.516909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:37.516909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:37.516909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:37.516909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:37.516909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:37.516909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:37.516909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:37.518025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:37.518025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:37.518025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:37.518025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:37.518025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:37.518025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:37.518025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:37.518025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:37.518025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:37.518025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:37.518025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:37.518025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:37.518025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:37.518025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:37.518025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:37.518025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:37.519349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:37.519349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:37.519349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:37.519349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:37.519349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:37.519349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:37.519349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:37.519349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:37.519349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:37.519349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:37.519349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:37.519349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:37.519349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 256/506] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:37.519349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090d5a4-285b-43d4-a547-46da7c6b838b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:37.529769 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:37.575122 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343c857-0cc4-4db1-a8d1-083dc9323798 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:37.576636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343c857-0cc4-4db1-a8d1-083dc9323798 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:37.620778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090d5a4-285b-43d4-a547-46da7c6b838b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:37.654367 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb37d37-08cf-4bc2-a5a1-aa9744d4c582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:37.655013 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb37d37-08cf-4bc2-a5a1-aa9744d4c582 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:37.655303 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb37d37-08cf-4bc2-a5a1-aa9744d4c582 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:37.655586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb37d37-08cf-4bc2-a5a1-aa9744d4c582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:37.679584 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:37.683005 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 251/507] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:37.683675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343c857-0cc4-4db1-a8d1-083dc9323798 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:37.723137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb37d37-08cf-4bc2-a5a1-aa9744d4c582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:37.724696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb37d37-08cf-4bc2-a5a1-aa9744d4c582 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:37.735670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:37.781025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343c857-0cc4-4db1-a8d1-083dc9323798 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:37.813830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e7d83-77e8-4bd9-8416-3892498c3ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:37.814511 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e7d83-77e8-4bd9-8416-3892498c3ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:37.814802 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e7d83-77e8-4bd9-8416-3892498c3ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:37.815077 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e7d83-77e8-4bd9-8416-3892498c3ac6 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:37.815786 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e7d83-77e8-4bd9-8416-3892498c3ac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:37.816132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e7d83-77e8-4bd9-8416-3892498c3ac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:37.817513 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e7d83-77e8-4bd9-8416-3892498c3ac6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:37.823511 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 257/508] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:37.824377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb37d37-08cf-4bc2-a5a1-aa9744d4c582 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:37.833109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 252/509] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:37.833975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e7d83-77e8-4bd9-8416-3892498c3ac6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:37.880480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:37.924830 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb37d37-08cf-4bc2-a5a1-aa9744d4c582 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:37.960932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560629dd-8b97-479b-9f9c-8f86a3506dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:37.961747 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560629dd-8b97-479b-9f9c-8f86a3506dfe None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:37.962035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560629dd-8b97-479b-9f9c-8f86a3506dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:37.962318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560629dd-8b97-479b-9f9c-8f86a3506dfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:37.974096 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560629dd-8b97-479b-9f9c-8f86a3506dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:37.976152 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560629dd-8b97-479b-9f9c-8f86a3506dfe None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:37.995428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-560629dd-8b97-479b-9f9c-8f86a3506dfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:37.995428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:37.995428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:37.995428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:37.995428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:37.995428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:37.995428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:37.995428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:37.995428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:37.995428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:37.995428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:37.995428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:37.995428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:37.995428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:37.995428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:37.999750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:38.001204 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:38.001204 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:38.001204 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:38.001204 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:38.001204 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 258/510] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:38.001204 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560629dd-8b97-479b-9f9c-8f86a3506dfe None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:38.057300 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e7d83-77e8-4bd9-8416-3892498c3ac6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:38.130113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:38.150104 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881b3c2-9fc9-4287-9d6c-5af392242afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:38.150772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881b3c2-9fc9-4287-9d6c-5af392242afd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:38.151060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881b3c2-9fc9-4287-9d6c-5af392242afd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:38.151340 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881b3c2-9fc9-4287-9d6c-5af392242afd None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:38.152100 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881b3c2-9fc9-4287-9d6c-5af392242afd None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:38.152413 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881b3c2-9fc9-4287-9d6c-5af392242afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:38.153796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c881b3c2-9fc9-4287-9d6c-5af392242afd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:38.162059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 253/511] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:45:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:38.162656 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881b3c2-9fc9-4287-9d6c-5af392242afd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:38.184316 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560629dd-8b97-479b-9f9c-8f86a3506dfe None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:38.191770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:38.218176 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18123b4-9173-42ac-b079-16a3690e8f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:38.218957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18123b4-9173-42ac-b079-16a3690e8f51 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:38.219241 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18123b4-9173-42ac-b079-16a3690e8f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:38.219517 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18123b4-9173-42ac-b079-16a3690e8f51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:38.231370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18123b4-9173-42ac-b079-16a3690e8f51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:38.232846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18123b4-9173-42ac-b079-16a3690e8f51 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:38.250045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f18123b4-9173-42ac-b079-16a3690e8f51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:38.250045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:38.250045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:38.250045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:38.250045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:38.250045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:38.250045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:38.250045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:38.250045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:38.250045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:38.250045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:38.250045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:38.250045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:38.250045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:38.250045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:38.251101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:38.252366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:38.252366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:38.252366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:38.252366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:38.252366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 259/512] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:38.252366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18123b4-9173-42ac-b079-16a3690e8f51 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:38.266230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881b3c2-9fc9-4287-9d6c-5af392242afd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:38.299013 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e196b3f-e615-4782-8241-de5938c948eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:38.299797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e196b3f-e615-4782-8241-de5938c948eb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:38.300106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e196b3f-e615-4782-8241-de5938c948eb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:38.300382 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e196b3f-e615-4782-8241-de5938c948eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:38.310597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e196b3f-e615-4782-8241-de5938c948eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:38.312076 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e196b3f-e615-4782-8241-de5938c948eb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:38.329457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9e196b3f-e615-4782-8241-de5938c948eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:38.329457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:38.329457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:38.329457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:38.329457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:38.329457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:38.329457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:38.329457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:38.329457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:38.329457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:38.329457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:38.329457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:38.329457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:38.329457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:38.329457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:38.330318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:38.331175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:38.331175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:38.331175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:38.331175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:38.331175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 254/513] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:38.331442 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e196b3f-e615-4782-8241-de5938c948eb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:38.349906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18123b4-9173-42ac-b079-16a3690e8f51 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:38.359208 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:38.385147 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75ab49-c21f-4d67-873f-fcad70ea6ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:38.385881 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ab49-c21f-4d67-873f-fcad70ea6ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:38.386169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ab49-c21f-4d67-873f-fcad70ea6ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:38.386449 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ab49-c21f-4d67-873f-fcad70ea6ba1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:38.393419 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75ab49-c21f-4d67-873f-fcad70ea6ba1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:38.394888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75ab49-c21f-4d67-873f-fcad70ea6ba1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:38.409489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8d75ab49-c21f-4d67-873f-fcad70ea6ba1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 15:45:38.409489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:38.409489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:38.409489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:38.409489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:38.409489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:38.409489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:38.409489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:38.409489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:38.409489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:38.409489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:38.409489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:38.409489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:45:38.409489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:45:38.409489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:45:38.409489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:38.410407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:38.411290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:38.411290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:38.411290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:45:38.411290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:45:38.411290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:45:38.411290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:45:38.411290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:45:38.411290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:45:38.411290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 15:45:38.411290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:38.411290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 260/514] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:38.411881 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75ab49-c21f-4d67-873f-fcad70ea6ba1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:38.430383 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:38.436424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e196b3f-e615-4782-8241-de5938c948eb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:38.470393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d3af4-06e5-4f8c-90d1-9f5e974e2697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:38.471051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d3af4-06e5-4f8c-90d1-9f5e974e2697 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:38.471339 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d3af4-06e5-4f8c-90d1-9f5e974e2697 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:38.471619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d3af4-06e5-4f8c-90d1-9f5e974e2697 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:38.472362 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d3af4-06e5-4f8c-90d1-9f5e974e2697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:38.472672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d3af4-06e5-4f8c-90d1-9f5e974e2697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:38.474054 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d3af4-06e5-4f8c-90d1-9f5e974e2697 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:38.487002 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 255/515] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:38.488315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d3af4-06e5-4f8c-90d1-9f5e974e2697 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:38.510247 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75ab49-c21f-4d67-873f-fcad70ea6ba1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:38.543201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d90bd-58c4-40dd-9e8d-5ecf43b835f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:38.544004 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d90bd-58c4-40dd-9e8d-5ecf43b835f3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:38.544298 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d90bd-58c4-40dd-9e8d-5ecf43b835f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:38.544579 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d90bd-58c4-40dd-9e8d-5ecf43b835f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:38.554244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d90bd-58c4-40dd-9e8d-5ecf43b835f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:38.555691 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d90bd-58c4-40dd-9e8d-5ecf43b835f3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:38.573187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-486d90bd-58c4-40dd-9e8d-5ecf43b835f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:38.573187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:38.573187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:38.573187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:38.573187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:38.573187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:38.573187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:38.573187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:38.573187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:38.573187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:38.573187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:38.573187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:38.573187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:38.573187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:38.573187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:38.574062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:38.574919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:38.574919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:38.574919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:38.574919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:38.574919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 261/516] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:38.575245 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:38.576157 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d90bd-58c4-40dd-9e8d-5ecf43b835f3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:38.594308 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d3af4-06e5-4f8c-90d1-9f5e974e2697 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:38.627715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ac5ff-59ea-43d4-b116-475298f11750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:38.628410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ac5ff-59ea-43d4-b116-475298f11750 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:38.628696 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ac5ff-59ea-43d4-b116-475298f11750 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:38.628978 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ac5ff-59ea-43d4-b116-475298f11750 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:38.629683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ac5ff-59ea-43d4-b116-475298f11750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:38.629992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ac5ff-59ea-43d4-b116-475298f11750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:38.631351 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ac5ff-59ea-43d4-b116-475298f11750 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:38.642775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:38.643334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 256/517] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:38.644164 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ac5ff-59ea-43d4-b116-475298f11750 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:38.674692 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d90bd-58c4-40dd-9e8d-5ecf43b835f3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:38.707034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8c650-2d47-41d8-88bc-4f476c92cea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:38.707687 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8c650-2d47-41d8-88bc-4f476c92cea3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:38.707971 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8c650-2d47-41d8-88bc-4f476c92cea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:38.708299 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8c650-2d47-41d8-88bc-4f476c92cea3 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:38.709008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8c650-2d47-41d8-88bc-4f476c92cea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:38.709309 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8c650-2d47-41d8-88bc-4f476c92cea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:38.710742 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8c650-2d47-41d8-88bc-4f476c92cea3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:38.722462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 262/518] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:38.723214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8c650-2d47-41d8-88bc-4f476c92cea3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:38.740702 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ac5ff-59ea-43d4-b116-475298f11750 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:38.774698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00585b4e-e6d0-4f62-a798-73241dee2544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:38.775368 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00585b4e-e6d0-4f62-a798-73241dee2544 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:38.775655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00585b4e-e6d0-4f62-a798-73241dee2544 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:38.775934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00585b4e-e6d0-4f62-a798-73241dee2544 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:38.776795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00585b4e-e6d0-4f62-a798-73241dee2544 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:38.777104 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00585b4e-e6d0-4f62-a798-73241dee2544 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:38.778529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00585b4e-e6d0-4f62-a798-73241dee2544 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:38.795494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 257/519] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Jun 2 15:45:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:38.796333 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00585b4e-e6d0-4f62-a798-73241dee2544 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:38.802957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:38.822121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8c650-2d47-41d8-88bc-4f476c92cea3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:38.851126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:38.855698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ca619-7dbb-48cb-b709-375c94f5de9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:38.856399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ca619-7dbb-48cb-b709-375c94f5de9c None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:38.856682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ca619-7dbb-48cb-b709-375c94f5de9c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:38.856966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ca619-7dbb-48cb-b709-375c94f5de9c None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:38.857661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ca619-7dbb-48cb-b709-375c94f5de9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:38.859084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ca619-7dbb-48cb-b709-375c94f5de9c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:38.895069 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00585b4e-e6d0-4f62-a798-73241dee2544 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:38.927785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f5fde-d3be-446d-9a08-ae2634cb3462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:38.928458 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f5fde-d3be-446d-9a08-ae2634cb3462 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:38.928771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f5fde-d3be-446d-9a08-ae2634cb3462 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:38.929052 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f5fde-d3be-446d-9a08-ae2634cb3462 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:38.929764 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f5fde-d3be-446d-9a08-ae2634cb3462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:38.930069 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f5fde-d3be-446d-9a08-ae2634cb3462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:38.931423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f5fde-d3be-446d-9a08-ae2634cb3462 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:38.937037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 263/520] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:45:38 2022] POST /identity/v3/users => generated 247 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:38.937674 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ca619-7dbb-48cb-b709-375c94f5de9c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:38.942561 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 258/521] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:38.943465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f5fde-d3be-446d-9a08-ae2634cb3462 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.023917 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:39.058183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ca619-7dbb-48cb-b709-375c94f5de9c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.065573 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f5fde-d3be-446d-9a08-ae2634cb3462 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.097310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c640df0-5d37-476a-95f6-bf84588c8644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.098178 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640df0-5d37-476a-95f6-bf84588c8644 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.098565 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640df0-5d37-476a-95f6-bf84588c8644 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.098816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c640df0-5d37-476a-95f6-bf84588c8644 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.102072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0602e-0b08-48dd-b272-50e58db12cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.103008 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0602e-0b08-48dd-b272-50e58db12cce None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.103292 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0602e-0b08-48dd-b272-50e58db12cce None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.103587 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0602e-0b08-48dd-b272-50e58db12cce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.106711 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c640df0-5d37-476a-95f6-bf84588c8644 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:39.108312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c640df0-5d37-476a-95f6-bf84588c8644 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:39.111393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0602e-0b08-48dd-b272-50e58db12cce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:39.112953 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0602e-0b08-48dd-b272-50e58db12cce None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:39.125066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3c640df0-5d37-476a-95f6-bf84588c8644 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:39.125066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:39.125066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:39.125066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:39.125066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:39.125066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:39.125066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:39.125066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:39.125066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:39.125066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:39.125066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:39.125066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:39.125066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:45:39.125066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:45:39.125066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:39.126016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:39.128532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:45:39.128532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:45:39.128532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:45:39.128532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:45:39.128532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:45:39.128532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:45:39.128532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:39.128532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:39.128532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 264/522] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:39.128532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c640df0-5d37-476a-95f6-bf84588c8644 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.131036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-45c0602e-0b08-48dd-b272-50e58db12cce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:39.131036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:39.131036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:39.131036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:39.131036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:39.131036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:39.131036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:39.131036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:39.131036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:39.131036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:39.131036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:39.131036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:39.131036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:45:39.131036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:45:39.131036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:39.132108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:39.133451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:45:39.133451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:45:39.133451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:45:39.133451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:45:39.133451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:45:39.133451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:45:39.133451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:39.133451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:39.133451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 259/523] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:39.133451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0602e-0b08-48dd-b272-50e58db12cce None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.188916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:39.244638 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0602e-0b08-48dd-b272-50e58db12cce None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.245673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c640df0-5d37-476a-95f6-bf84588c8644 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.269410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:39.280638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc9b13-46b7-4dd2-a236-8edd3fe6fdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.280818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92ab06-b79b-4ee9-9786-42ea1bc2d6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.281298 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc9b13-46b7-4dd2-a236-8edd3fe6fdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.281491 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92ab06-b79b-4ee9-9786-42ea1bc2d6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.282047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc9b13-46b7-4dd2-a236-8edd3fe6fdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.282146 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92ab06-b79b-4ee9-9786-42ea1bc2d6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.282244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc9b13-46b7-4dd2-a236-8edd3fe6fdf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.282365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92ab06-b79b-4ee9-9786-42ea1bc2d6f1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.290430 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92ab06-b79b-4ee9-9786-42ea1bc2d6f1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:39.292031 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92ab06-b79b-4ee9-9786-42ea1bc2d6f1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:39.308445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8a92ab06-b79b-4ee9-9786-42ea1bc2d6f1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 15:45:39.308445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:39.308445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:39.308445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:39.308445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:39.308445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:39.308445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:39.308445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:39.308445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:39.308445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:39.308445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:39.308445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:39.308445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:45:39.308445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:45:39.308445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:45:39.308445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:39.309639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:39.315396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:39.315396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:39.315396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:45:39.315396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:45:39.315396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:45:39.315396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:45:39.315396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:45:39.315396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:45:39.315396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 15:45:39.315396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:39.315396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 260/524] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:39.315396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92ab06-b79b-4ee9-9786-42ea1bc2d6f1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.366701 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc9b13-46b7-4dd2-a236-8edd3fe6fdf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:39.366701 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc9b13-46b7-4dd2-a236-8edd3fe6fdf4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:39.416907 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:39.423456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92ab06-b79b-4ee9-9786-42ea1bc2d6f1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.460525 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fcdb6-12f8-432c-aea5-9fc7fd5658cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.461276 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fcdb6-12f8-432c-aea5-9fc7fd5658cc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.461683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fcdb6-12f8-432c-aea5-9fc7fd5658cc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.462066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fcdb6-12f8-432c-aea5-9fc7fd5658cc None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.462936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fcdb6-12f8-432c-aea5-9fc7fd5658cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:39.463323 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fcdb6-12f8-432c-aea5-9fc7fd5658cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:39.464853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1fcdb6-12f8-432c-aea5-9fc7fd5658cc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:39.474274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 265/525] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:39.474274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc9b13-46b7-4dd2-a236-8edd3fe6fdf4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.485215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 261/526] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:45:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:39.486164 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fcdb6-12f8-432c-aea5-9fc7fd5658cc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.537202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:39.574662 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc9b13-46b7-4dd2-a236-8edd3fe6fdf4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.596268 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fcdb6-12f8-432c-aea5-9fc7fd5658cc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.609113 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddbd95-bbf7-4161-a6e4-22cd7d6df0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.609774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddbd95-bbf7-4161-a6e4-22cd7d6df0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.610060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddbd95-bbf7-4161-a6e4-22cd7d6df0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.610340 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddbd95-bbf7-4161-a6e4-22cd7d6df0d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.611116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddbd95-bbf7-4161-a6e4-22cd7d6df0d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:39.611429 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddbd95-bbf7-4161-a6e4-22cd7d6df0d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:39.612887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ddbd95-bbf7-4161-a6e4-22cd7d6df0d0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:39.640139 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 266/527] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:45:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:39.640325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38599514-8e89-49e5-b29e-b65bd03743ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.640325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38599514-8e89-49e5-b29e-b65bd03743ae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.640325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38599514-8e89-49e5-b29e-b65bd03743ae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.640325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38599514-8e89-49e5-b29e-b65bd03743ae None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.641082 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddbd95-bbf7-4161-a6e4-22cd7d6df0d0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.641180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38599514-8e89-49e5-b29e-b65bd03743ae None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:39.641180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38599514-8e89-49e5-b29e-b65bd03743ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:39.641180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38599514-8e89-49e5-b29e-b65bd03743ae None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:39.651813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:39.658601 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 262/528] 10.222.0.50 () {56 vars in 1139 bytes} [Thu Jun 2 15:45:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:39.659420 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38599514-8e89-49e5-b29e-b65bd03743ae None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.754185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddbd95-bbf7-4161-a6e4-22cd7d6df0d0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.766865 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38599514-8e89-49e5-b29e-b65bd03743ae None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.768939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:39.790408 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13f55a-6655-470e-b380-f6e3ff67c7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.791201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13f55a-6655-470e-b380-f6e3ff67c7bc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.791486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13f55a-6655-470e-b380-f6e3ff67c7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.791766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13f55a-6655-470e-b380-f6e3ff67c7bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.802662 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13f55a-6655-470e-b380-f6e3ff67c7bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:39.802905 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edce24-f166-447a-8d11-5dbb7c8328e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.803512 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edce24-f166-447a-8d11-5dbb7c8328e6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.803831 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edce24-f166-447a-8d11-5dbb7c8328e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.804144 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edce24-f166-447a-8d11-5dbb7c8328e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:39.804239 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13f55a-6655-470e-b380-f6e3ff67c7bc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:39.804981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edce24-f166-447a-8d11-5dbb7c8328e6 None admin] RBAC: Adding query filter params (role.id=740fa9b1529f4a558de5b8987dba5ba3, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=a4c3818af2794f598c21ee4aab4b3a70) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:39.805309 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edce24-f166-447a-8d11-5dbb7c8328e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:39.806720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edce24-f166-447a-8d11-5dbb7c8328e6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:39.813019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 263/529] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:39 2022] GET /identity/v3/role_assignments?user.id=a4c3818af2794f598c21ee4aab4b3a70&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=740fa9b1529f4a558de5b8987dba5ba3 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:39.814104 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edce24-f166-447a-8d11-5dbb7c8328e6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.822199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6d13f55a-6655-470e-b380-f6e3ff67c7bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:39.822199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:39.822199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:39.822199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:39.822199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:39.822199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:39.822199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:39.822199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:39.822199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:39.822199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:39.822199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:39.822199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:39.822199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:39.822199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:39.822199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:39.823183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:39.824083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:39.824083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:39.824083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:39.824083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:39.824083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 267/530] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:39.829061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13f55a-6655-470e-b380-f6e3ff67c7bc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:39.900977 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:39.947382 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13f55a-6655-470e-b380-f6e3ff67c7bc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.964156 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edce24-f166-447a-8d11-5dbb7c8328e6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:39.983938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd27513-1495-45c8-b6d4-59a318bd244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:39.985066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd27513-1495-45c8-b6d4-59a318bd244e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:39.985360 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd27513-1495-45c8-b6d4-59a318bd244e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:39.985645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd27513-1495-45c8-b6d4-59a318bd244e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.013914 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537edee-95e9-492b-9b15-3c3577d4cf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:40.015534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537edee-95e9-492b-9b15-3c3577d4cf4f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:40.016363 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537edee-95e9-492b-9b15-3c3577d4cf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:40.016918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537edee-95e9-492b-9b15-3c3577d4cf4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.018228 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537edee-95e9-492b-9b15-3c3577d4cf4f None admin] RBAC: Adding query filter params (role.id=740fa9b1529f4a558de5b8987dba5ba3, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=2e53683ae2b34947a1550de269b74d10) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:40.019221 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537edee-95e9-492b-9b15-3c3577d4cf4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:40.022112 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537edee-95e9-492b-9b15-3c3577d4cf4f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:40.036041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 264/531] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:39 2022] GET /identity/v3/role_assignments?user.id=2e53683ae2b34947a1550de269b74d10&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=740fa9b1529f4a558de5b8987dba5ba3 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:40.036041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537edee-95e9-492b-9b15-3c3577d4cf4f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:40.081564 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:40.161156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd27513-1495-45c8-b6d4-59a318bd244e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:40.162644 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd27513-1495-45c8-b6d4-59a318bd244e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:40.168061 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537edee-95e9-492b-9b15-3c3577d4cf4f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:40.211627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82aec7-1f5c-4d27-b795-247851aa3173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:40.212807 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82aec7-1f5c-4d27-b795-247851aa3173 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:40.213240 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82aec7-1f5c-4d27-b795-247851aa3173 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:40.213679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82aec7-1f5c-4d27-b795-247851aa3173 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.214793 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82aec7-1f5c-4d27-b795-247851aa3173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:40.215249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82aec7-1f5c-4d27-b795-247851aa3173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:40.216823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82aec7-1f5c-4d27-b795-247851aa3173 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:40.243500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 265/532] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:40.249987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82aec7-1f5c-4d27-b795-247851aa3173 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:40.310276 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:40.383696 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:40.385249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 268/533] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:40.390707 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd27513-1495-45c8-b6d4-59a318bd244e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:40.394030 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82aec7-1f5c-4d27-b795-247851aa3173 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:40.438751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a14f0e-e3c2-4278-8ca2-0f276ae3edec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:40.439562 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a14f0e-e3c2-4278-8ca2-0f276ae3edec None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:40.439843 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a14f0e-e3c2-4278-8ca2-0f276ae3edec None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:40.440144 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a14f0e-e3c2-4278-8ca2-0f276ae3edec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.448016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a14f0e-e3c2-4278-8ca2-0f276ae3edec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:40.457750 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a14f0e-e3c2-4278-8ca2-0f276ae3edec None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:40.473482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-82a14f0e-e3c2-4278-8ca2-0f276ae3edec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:40.473482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:40.473482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:40.473482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:40.473482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:40.473482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:40.473482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:40.473482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:40.473482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:40.473482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:40.473482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:40.473482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:40.473482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:45:40.473482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:45:40.473482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:40.474576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:40.475803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:45:40.475803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:45:40.475803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:45:40.475803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:45:40.475803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:45:40.475803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:45:40.475803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:40.475803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:40.475803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 266/534] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:40.481189 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a14f0e-e3c2-4278-8ca2-0f276ae3edec None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:40.534091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd27513-1495-45c8-b6d4-59a318bd244e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:40.583193 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab42062-48d4-4180-ac45-8426b01b51d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:40.584566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab42062-48d4-4180-ac45-8426b01b51d6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:40.586290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab42062-48d4-4180-ac45-8426b01b51d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:40.588032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab42062-48d4-4180-ac45-8426b01b51d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.604754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab42062-48d4-4180-ac45-8426b01b51d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:40.607874 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab42062-48d4-4180-ac45-8426b01b51d6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:40.624153 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a14f0e-e3c2-4278-8ca2-0f276ae3edec None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:40.648214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1ab42062-48d4-4180-ac45-8426b01b51d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:40.648214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:40.648214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:40.648214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:40.648214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:40.648214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:40.648214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:40.648214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:40.648214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:40.648214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:40.648214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:40.648214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:40.648214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:40.648214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:40.648214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:40.649270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:40.650339 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:40.650339 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:40.650339 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:40.650339 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:40.653506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 269/535] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:40.660068 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab42062-48d4-4180-ac45-8426b01b51d6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:40.677658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:40.698044 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8535fed-479e-47bd-9b6e-e00b7a3a567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:40.698721 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8535fed-479e-47bd-9b6e-e00b7a3a567f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:40.699009 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8535fed-479e-47bd-9b6e-e00b7a3a567f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:40.699486 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8535fed-479e-47bd-9b6e-e00b7a3a567f None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.700315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8535fed-479e-47bd-9b6e-e00b7a3a567f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:40.700630 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8535fed-479e-47bd-9b6e-e00b7a3a567f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:40.702165 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8535fed-479e-47bd-9b6e-e00b7a3a567f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:40.715387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 267/536] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:45:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:40.722019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8535fed-479e-47bd-9b6e-e00b7a3a567f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:40.768345 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:40.828794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab42062-48d4-4180-ac45-8426b01b51d6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:40.874654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddea44b-8745-43ed-a692-6ecafd9309f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:40.875248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddea44b-8745-43ed-a692-6ecafd9309f5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:40.875533 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddea44b-8745-43ed-a692-6ecafd9309f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:40.875810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddea44b-8745-43ed-a692-6ecafd9309f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:40.876559 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddea44b-8745-43ed-a692-6ecafd9309f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:40.876870 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddea44b-8745-43ed-a692-6ecafd9309f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:40.879403 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddea44b-8745-43ed-a692-6ecafd9309f5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:40.898869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8535fed-479e-47bd-9b6e-e00b7a3a567f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:40.904053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 270/537] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:40.917270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddea44b-8745-43ed-a692-6ecafd9309f5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:40.998627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:41.009432 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297da974-1c4a-490d-bdb9-4c033ad3aa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:41.010182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297da974-1c4a-490d-bdb9-4c033ad3aa7a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:41.010544 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297da974-1c4a-490d-bdb9-4c033ad3aa7a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:41.010900 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297da974-1c4a-490d-bdb9-4c033ad3aa7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:41.011812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297da974-1c4a-490d-bdb9-4c033ad3aa7a None admin] RBAC: Adding query filter params (role.id=740fa9b1529f4a558de5b8987dba5ba3, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=a6a5157588644972a6a4554b3a9f1d76) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:41.012287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297da974-1c4a-490d-bdb9-4c033ad3aa7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:41.013793 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297da974-1c4a-490d-bdb9-4c033ad3aa7a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:41.033257 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddea44b-8745-43ed-a692-6ecafd9309f5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:41.034347 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 268/538] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:40 2022] GET /identity/v3/role_assignments?user.id=a6a5157588644972a6a4554b3a9f1d76&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=740fa9b1529f4a558de5b8987dba5ba3 => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:41.089653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6273f7-94d5-4b4e-b73e-48e353d41a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:41.090723 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6273f7-94d5-4b4e-b73e-48e353d41a94 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:41.091204 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6273f7-94d5-4b4e-b73e-48e353d41a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:41.091661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6273f7-94d5-4b4e-b73e-48e353d41a94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:41.104644 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6273f7-94d5-4b4e-b73e-48e353d41a94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:41.106400 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6273f7-94d5-4b4e-b73e-48e353d41a94 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:41.132327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1c6273f7-94d5-4b4e-b73e-48e353d41a94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:41.132327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:41.132327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:41.132327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:41.132327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:41.132327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:41.132327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:41.132327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:41.132327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:41.132327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:41.132327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:41.132327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:41.132327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:45:41.132327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:45:41.132327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:41.133435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:41.134489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:45:41.134489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:45:41.134489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:45:41.134489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:45:41.134489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:45:41.134489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:45:41.134489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:41.134489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:41.136837 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 271/539] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:41.142717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297da974-1c4a-490d-bdb9-4c033ad3aa7a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:41.262215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:41.288557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297da974-1c4a-490d-bdb9-4c033ad3aa7a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:41.333970 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a7da1-4fc4-4783-8b33-6408c1ca49ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:41.334644 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a7da1-4fc4-4783-8b33-6408c1ca49ae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:41.335467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a7da1-4fc4-4783-8b33-6408c1ca49ae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:41.335756 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a7da1-4fc4-4783-8b33-6408c1ca49ae None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:41.336638 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a7da1-4fc4-4783-8b33-6408c1ca49ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:41.336956 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a7da1-4fc4-4783-8b33-6408c1ca49ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:41.338455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a7da1-4fc4-4783-8b33-6408c1ca49ae None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:41.351794 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 269/540] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:45:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:41.357430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6273f7-94d5-4b4e-b73e-48e353d41a94 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:41.438383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541da58d-3fc5-437a-9ead-f45f3d55e8f9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:41.438690 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541da58d-3fc5-437a-9ead-f45f3d55e8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:41.439043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541da58d-3fc5-437a-9ead-f45f3d55e8f9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:41.440611 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 270/541] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:41.457906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219703e-2b72-4c2f-80b1-5110a6e16ff2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:41.458211 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219703e-2b72-4c2f-80b1-5110a6e16ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:41.458482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219703e-2b72-4c2f-80b1-5110a6e16ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:41.503632 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6273f7-94d5-4b4e-b73e-48e353d41a94 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:41.506036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f219703e-2b72-4c2f-80b1-5110a6e16ff2 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:41.507772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f219703e-2b72-4c2f-80b1-5110a6e16ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:41.562936 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:41.573690 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e930a-5483-42e1-aaf4-c1ca9d8ee1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:41.574347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e930a-5483-42e1-aaf4-c1ca9d8ee1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:41.574632 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e930a-5483-42e1-aaf4-c1ca9d8ee1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:41.579631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e930a-5483-42e1-aaf4-c1ca9d8ee1d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:41.579631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e930a-5483-42e1-aaf4-c1ca9d8ee1d2 None admin] RBAC: Adding query filter params (role.id=740fa9b1529f4a558de5b8987dba5ba3, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=c3ec010ab4c5414a8782cecf202fbcfe) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:41.579631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e930a-5483-42e1-aaf4-c1ca9d8ee1d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:41.579631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e930a-5483-42e1-aaf4-c1ca9d8ee1d2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:41.587184 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 272/542] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:41 2022] GET /identity/v3/role_assignments?user.id=c3ec010ab4c5414a8782cecf202fbcfe&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=740fa9b1529f4a558de5b8987dba5ba3 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:41.626283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 271/543] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:41.662311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e930a-5483-42e1-aaf4-c1ca9d8ee1d2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:41.820620 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e930a-5483-42e1-aaf4-c1ca9d8ee1d2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:41.870625 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2844d0a-3012-4820-aaed-61052342f1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:41.871437 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2844d0a-3012-4820-aaed-61052342f1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:41.871727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2844d0a-3012-4820-aaed-61052342f1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:41.872026 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2844d0a-3012-4820-aaed-61052342f1f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:41.886916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2844d0a-3012-4820-aaed-61052342f1f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:41.894759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b2844d0a-3012-4820-aaed-61052342f1f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:41.894759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:41.894759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:41.894759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:41.894759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:41.894759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:41.894759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:41.894759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:41.894759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:41.894759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:41.894759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:41.894759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:41.894759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:41.894759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:41.894759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:41.894759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:41.895638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:41.895638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:41.895638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:41.895638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:41.895638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:41.895638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:41.895638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:41.895638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:41.895638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:41.895638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:41.895638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:41.895638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:41.895638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:41.895638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:41.895638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:41.895638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:41.896462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:41.896462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:41.896462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:41.896462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:41.896462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:41.896462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:41.896462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:41.896462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:41.896462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:41.896462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:41.896462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:41.896462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:41.900326 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 273/544] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:41.909082 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219703e-2b72-4c2f-80b1-5110a6e16ff2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:41.998687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:42.047903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219703e-2b72-4c2f-80b1-5110a6e16ff2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:42.093813 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25a35e-932b-4f2d-a6a7-3fe15038daa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:42.094408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25a35e-932b-4f2d-a6a7-3fe15038daa3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:42.094696 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25a35e-932b-4f2d-a6a7-3fe15038daa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:42.094978 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25a35e-932b-4f2d-a6a7-3fe15038daa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:42.095722 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25a35e-932b-4f2d-a6a7-3fe15038daa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:42.096139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25a35e-932b-4f2d-a6a7-3fe15038daa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:42.097453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25a35e-932b-4f2d-a6a7-3fe15038daa3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:42.111568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 272/545] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:45:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:42.118043 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2844d0a-3012-4820-aaed-61052342f1f4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:42.192447 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:42.248671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2844d0a-3012-4820-aaed-61052342f1f4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:42.285663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793acc24-116e-44e1-86c4-2d486482f06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:42.286466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793acc24-116e-44e1-86c4-2d486482f06b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:42.286754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793acc24-116e-44e1-86c4-2d486482f06b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:42.287036 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793acc24-116e-44e1-86c4-2d486482f06b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:42.299953 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793acc24-116e-44e1-86c4-2d486482f06b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:42.301463 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793acc24-116e-44e1-86c4-2d486482f06b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:42.319846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-793acc24-116e-44e1-86c4-2d486482f06b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:42.319846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:42.319846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:42.319846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:42.319846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:42.319846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:42.319846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:42.319846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:42.319846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:42.319846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:42.319846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:42.319846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:42.319846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:42.319846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:42.319846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:42.321890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:42.323861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:42.323861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:42.323861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:42.323861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:42.323861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 274/546] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:42.329865 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25a35e-932b-4f2d-a6a7-3fe15038daa3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:42.478773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25a35e-932b-4f2d-a6a7-3fe15038daa3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:42.521012 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:42.536280 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d707a4c-4418-4538-908b-1c4cc42fa4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:42.536960 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d707a4c-4418-4538-908b-1c4cc42fa4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:42.537386 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d707a4c-4418-4538-908b-1c4cc42fa4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:42.537675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d707a4c-4418-4538-908b-1c4cc42fa4e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:42.539003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d707a4c-4418-4538-908b-1c4cc42fa4e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:42.539319 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d707a4c-4418-4538-908b-1c4cc42fa4e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:42.540721 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d707a4c-4418-4538-908b-1c4cc42fa4e0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:42.555855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 273/547] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:42.561534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793acc24-116e-44e1-86c4-2d486482f06b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:42.703733 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793acc24-116e-44e1-86c4-2d486482f06b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:42.714514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:42.752695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8c55d-5dfb-4bf8-810f-a642a3f7295b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:42.753903 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8c55d-5dfb-4bf8-810f-a642a3f7295b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:42.754391 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8c55d-5dfb-4bf8-810f-a642a3f7295b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:42.754868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8c55d-5dfb-4bf8-810f-a642a3f7295b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:42.758283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef648aa-7adf-40c1-8047-64e74deb8e8c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:42.758808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef648aa-7adf-40c1-8047-64e74deb8e8c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:42.758895 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef648aa-7adf-40c1-8047-64e74deb8e8c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:42.760497 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 274/548] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:42.766443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa3bbf-a1f5-4caa-acae-a20980518bbd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:42.766740 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa3bbf-a1f5-4caa-acae-a20980518bbd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:42.767225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa3bbf-a1f5-4caa-acae-a20980518bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:42.768937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8c55d-5dfb-4bf8-810f-a642a3f7295b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:42.770750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8c55d-5dfb-4bf8-810f-a642a3f7295b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:42.786514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d7aa3bbf-a1f5-4caa-acae-a20980518bbd None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:42.787703 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d7aa3bbf-a1f5-4caa-acae-a20980518bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:42.796981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-cea8c55d-5dfb-4bf8-810f-a642a3f7295b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:45:42.796981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:42.796981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:42.796981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:42.796981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:42.796981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:42.796981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:42.796981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:42.796981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:42.796981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:42.796981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:42.796981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:42.796981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:45:42.796981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:45:42.796981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:45:42.796981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:42.797910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:42.798829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:42.798829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:42.798829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:45:42.798829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:45:42.798829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:45:42.798829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:45:42.798829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:45:42.798829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:45:42.798829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:45:42.798829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:42.801143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 275/549] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:42.807935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8c55d-5dfb-4bf8-810f-a642a3f7295b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:42.870736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 275/550] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:42.875401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882ecff-90a9-4d65-a33b-98e2fb16f846 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:42.875401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882ecff-90a9-4d65-a33b-98e2fb16f846 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:42.875401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882ecff-90a9-4d65-a33b-98e2fb16f846 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:42.875401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 276/551] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:42.879661 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4dada-942e-40ac-b800-f889c63c67d9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:42.879952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4dada-942e-40ac-b800-f889c63c67d9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:42.880290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4dada-942e-40ac-b800-f889c63c67d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:42.909140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f3e4dada-942e-40ac-b800-f889c63c67d9 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:42.910490 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f3e4dada-942e-40ac-b800-f889c63c67d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:42.926376 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8c55d-5dfb-4bf8-810f-a642a3f7295b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:42.968066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3fcaf-da29-42cc-a512-91b3c3b9935b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:42.969095 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3fcaf-da29-42cc-a512-91b3c3b9935b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:42.969611 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3fcaf-da29-42cc-a512-91b3c3b9935b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:42.970088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3fcaf-da29-42cc-a512-91b3c3b9935b None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:42.971105 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3fcaf-da29-42cc-a512-91b3c3b9935b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:42.971603 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3fcaf-da29-42cc-a512-91b3c3b9935b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:42.973316 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3fcaf-da29-42cc-a512-91b3c3b9935b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:42.992068 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 276/552] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Jun 2 15:45:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:42.998476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3fcaf-da29-42cc-a512-91b3c3b9935b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:42.998600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 277/553] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:42.999646 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4dada-942e-40ac-b800-f889c63c67d9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:43.029537 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:43.077248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:43.118612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3fcaf-da29-42cc-a512-91b3c3b9935b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:43.136024 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4dada-942e-40ac-b800-f889c63c67d9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:43.154983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9b29e-9bb9-428f-90da-cabea1ca8cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:43.156354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9b29e-9bb9-428f-90da-cabea1ca8cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.156813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9b29e-9bb9-428f-90da-cabea1ca8cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.158116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9b29e-9bb9-428f-90da-cabea1ca8cf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.170176 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9b29e-9bb9-428f-90da-cabea1ca8cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:43.174516 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e39fa-c31c-480a-ba67-66f198768ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:43.175173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e39fa-c31c-480a-ba67-66f198768ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.175460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e39fa-c31c-480a-ba67-66f198768ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.175743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e39fa-c31c-480a-ba67-66f198768ac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.179508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-05c9b29e-9bb9-428f-90da-cabea1ca8cf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:43.179508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:43.179508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:43.179508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:43.179508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:43.179508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:43.179508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:43.179508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:43.179508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:43.179508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:43.179508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:43.179508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:43.179508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:43.179508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:43.179508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:43.179508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:43.180698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:43.180698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:43.180698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:43.180698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:43.180698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:43.180698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:43.180698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:43.180698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:43.180698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:43.180698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:43.180698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:43.180698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:43.180698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:43.180698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:43.180698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:43.180698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:43.181615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:43.181615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:43.181615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:43.181615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:43.181615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:43.181615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:43.181615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:43.181615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:43.181615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:43.181615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:43.181615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:43.181615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:43.183858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 277/554] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:43.184964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9b29e-9bb9-428f-90da-cabea1ca8cf6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:43.250115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e39fa-c31c-480a-ba67-66f198768ac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:43.251979 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e39fa-c31c-480a-ba67-66f198768ac5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:43.275472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:43.292633 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9b29e-9bb9-428f-90da-cabea1ca8cf6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:43.302943 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:43.328478 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae1686-10e6-462d-a9d8-cba168707b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:43.329519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae1686-10e6-462d-a9d8-cba168707b99 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.329950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae1686-10e6-462d-a9d8-cba168707b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.330373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae1686-10e6-462d-a9d8-cba168707b99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.341113 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae1686-10e6-462d-a9d8-cba168707b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:43.349643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a0ae1686-10e6-462d-a9d8-cba168707b99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:43.349643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:43.349643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:43.349643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:43.349643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:43.349643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:43.349643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:43.349643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:43.349643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:43.349643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:43.349643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:43.349643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:43.349643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:43.349643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:43.349643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:43.349643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:43.355823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:43.355823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:43.355823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:43.355823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:43.355823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:43.355823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:43.355823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:43.355823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:43.355823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:43.355823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:43.355823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:43.355823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:43.355823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:43.355823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:43.355823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:43.355823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:43.357063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:43.357063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:43.357063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:43.357063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:43.357063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:43.357063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:43.357063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:43.357063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:43.357063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:43.357063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:43.357063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:43.357063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:43.357063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 278/555] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:43.358854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae1686-10e6-462d-a9d8-cba168707b99 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:43.361457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 278/556] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:43.362424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e39fa-c31c-480a-ba67-66f198768ac5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:43.473098 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e39fa-c31c-480a-ba67-66f198768ac5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:43.473487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae1686-10e6-462d-a9d8-cba168707b99 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:43.511155 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2033b-85f3-458e-80ad-20379814f019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:43.511361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b9a66-1a6e-4be6-8d79-39d26d7f7de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:43.511758 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b9a66-1a6e-4be6-8d79-39d26d7f7de3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.512068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b9a66-1a6e-4be6-8d79-39d26d7f7de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.512352 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b9a66-1a6e-4be6-8d79-39d26d7f7de3 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.512802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2033b-85f3-458e-80ad-20379814f019 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.513095 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b9a66-1a6e-4be6-8d79-39d26d7f7de3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:43.513410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b9a66-1a6e-4be6-8d79-39d26d7f7de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:43.513510 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2033b-85f3-458e-80ad-20379814f019 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.513900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2033b-85f3-458e-80ad-20379814f019 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.514778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b9a66-1a6e-4be6-8d79-39d26d7f7de3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:43.514986 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2033b-85f3-458e-80ad-20379814f019 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:43.515420 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2033b-85f3-458e-80ad-20379814f019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:43.517153 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2033b-85f3-458e-80ad-20379814f019 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:43.524181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 279/557] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:45:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:43.524952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b9a66-1a6e-4be6-8d79-39d26d7f7de3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:43.527222 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 279/558] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:45:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:43.535284 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2033b-85f3-458e-80ad-20379814f019 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:43.538607 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:43.545591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:43.630874 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b9a66-1a6e-4be6-8d79-39d26d7f7de3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:43.642580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2033b-85f3-458e-80ad-20379814f019 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:43.667345 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d5a9b-dce1-49a6-ac2f-72527407d6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:43.668553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d5a9b-dce1-49a6-ac2f-72527407d6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.668837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d5a9b-dce1-49a6-ac2f-72527407d6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.669122 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d5a9b-dce1-49a6-ac2f-72527407d6b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.679698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafc941-9a80-46d1-875b-8854f729de1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:43.680524 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafc941-9a80-46d1-875b-8854f729de1c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.680808 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafc941-9a80-46d1-875b-8854f729de1c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.681084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafc941-9a80-46d1-875b-8854f729de1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.687604 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d5a9b-dce1-49a6-ac2f-72527407d6b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:43.689203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d5a9b-dce1-49a6-ac2f-72527407d6b0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:43.692980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafc941-9a80-46d1-875b-8854f729de1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:43.695030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafc941-9a80-46d1-875b-8854f729de1c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:43.707850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ad7d5a9b-dce1-49a6-ac2f-72527407d6b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:43.707850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:43.707850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:43.707850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:43.707850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:43.707850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:43.707850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:43.707850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:43.707850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:43.707850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:43.707850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:43.707850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:43.707850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:43.707850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:43.707850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:43.708812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:43.710836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:43.710836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:43.710836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:43.710836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:43.710836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 280/559] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:43.710836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d5a9b-dce1-49a6-ac2f-72527407d6b0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:43.713315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0cafc941-9a80-46d1-875b-8854f729de1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:43.713315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:43.713315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:43.713315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:43.713315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:43.713315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:43.713315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:43.713315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:43.713315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:43.713315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:43.713315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:43.713315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:43.713315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:43.713315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:43.713315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:43.715677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:43.717887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:43.717887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:43.717887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:43.717887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:43.717887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 280/560] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:43.717887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafc941-9a80-46d1-875b-8854f729de1c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:43.777923 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:43.783128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:43.821386 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d5a9b-dce1-49a6-ac2f-72527407d6b0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:43.827290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafc941-9a80-46d1-875b-8854f729de1c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:43.855848 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ebffb-5399-4d93-b51a-3e3b11ceebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:43.856670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ebffb-5399-4d93-b51a-3e3b11ceebe0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.856952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ebffb-5399-4d93-b51a-3e3b11ceebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.857231 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ebffb-5399-4d93-b51a-3e3b11ceebe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.864357 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcfbc6-bb54-458e-a21f-f1fe0feccd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:43.865019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcfbc6-bb54-458e-a21f-f1fe0feccd3f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.865304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcfbc6-bb54-458e-a21f-f1fe0feccd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.865584 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcfbc6-bb54-458e-a21f-f1fe0feccd3f None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.866986 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcfbc6-bb54-458e-a21f-f1fe0feccd3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:43.867548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcfbc6-bb54-458e-a21f-f1fe0feccd3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:43.868714 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ebffb-5399-4d93-b51a-3e3b11ceebe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:43.868937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcfbc6-bb54-458e-a21f-f1fe0feccd3f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:43.870172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ebffb-5399-4d93-b51a-3e3b11ceebe0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:43.885535 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 281/561] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:43.885535 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcfbc6-bb54-458e-a21f-f1fe0feccd3f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:43.886994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c35ebffb-5399-4d93-b51a-3e3b11ceebe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:43.886994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:43.886994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:43.886994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:43.886994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:43.886994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:43.886994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:43.886994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:43.886994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:43.886994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:43.886994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:43.886994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:43.886994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:43.886994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:43.886994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:43.887896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:43.889468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:43.889468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:43.889468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:43.889468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:43.889468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 281/562] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:43.889468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347620d-fa04-42d0-92e9-594024b334b6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:43.889813 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347620d-fa04-42d0-92e9-594024b334b6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:43.890028 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347620d-fa04-42d0-92e9-594024b334b6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:43.891387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 282/563] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:43.891940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347620d-fa04-42d0-92e9-594024b334b6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:43.998163 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347620d-fa04-42d0-92e9-594024b334b6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.002399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcfbc6-bb54-458e-a21f-f1fe0feccd3f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.012924 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:44.022035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:44.036468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabe34d-24de-404f-a576-e13d1205439d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.037239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabe34d-24de-404f-a576-e13d1205439d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.037543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabe34d-24de-404f-a576-e13d1205439d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.037810 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabe34d-24de-404f-a576-e13d1205439d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.042223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214116f-e03c-4a94-ae6a-30eb38fc7089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.043126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214116f-e03c-4a94-ae6a-30eb38fc7089 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.043590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214116f-e03c-4a94-ae6a-30eb38fc7089 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.044101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214116f-e03c-4a94-ae6a-30eb38fc7089 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.044820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214116f-e03c-4a94-ae6a-30eb38fc7089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:44.045133 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214116f-e03c-4a94-ae6a-30eb38fc7089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:44.045663 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabe34d-24de-404f-a576-e13d1205439d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:44.046551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214116f-e03c-4a94-ae6a-30eb38fc7089 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:44.047211 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabe34d-24de-404f-a576-e13d1205439d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:44.062476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 282/564] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:44.063153 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214116f-e03c-4a94-ae6a-30eb38fc7089 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.063528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-cfabe34d-24de-404f-a576-e13d1205439d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:44.063528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:44.063528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:44.063528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:44.063528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:44.063528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:44.063528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:44.063528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:44.063528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:44.063528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:44.063528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:44.063528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:44.063528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:45:44.063528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:45:44.063528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:44.064636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:44.065553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:45:44.065553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:45:44.065553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:45:44.065553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:45:44.065553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:45:44.065553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:45:44.065553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:44.065553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:44.065553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 283/565] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:44.066125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644d02d-291a-4db4-b354-3cd419f41fe8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.066204 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644d02d-291a-4db4-b354-3cd419f41fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.066449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644d02d-291a-4db4-b354-3cd419f41fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.085241 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c644d02d-291a-4db4-b354-3cd419f41fe8 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:44.086425 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c644d02d-291a-4db4-b354-3cd419f41fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:44.158775 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 284/566] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:44.159458 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644d02d-291a-4db4-b354-3cd419f41fe8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.183445 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214116f-e03c-4a94-ae6a-30eb38fc7089 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.219873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20a49c-93b7-4dad-a095-ad308c23860f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.220566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20a49c-93b7-4dad-a095-ad308c23860f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.220866 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20a49c-93b7-4dad-a095-ad308c23860f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.221133 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20a49c-93b7-4dad-a095-ad308c23860f None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.221886 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20a49c-93b7-4dad-a095-ad308c23860f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:44.222193 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20a49c-93b7-4dad-a095-ad308c23860f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:44.223588 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20a49c-93b7-4dad-a095-ad308c23860f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:44.236984 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 283/567] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:44.237822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20a49c-93b7-4dad-a095-ad308c23860f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.262285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644d02d-291a-4db4-b354-3cd419f41fe8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.263939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:44.280176 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:44.296296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dbf3b-a8e4-4fd2-a67e-62c28b52da26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.297036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dbf3b-a8e4-4fd2-a67e-62c28b52da26 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.297324 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dbf3b-a8e4-4fd2-a67e-62c28b52da26 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.297605 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dbf3b-a8e4-4fd2-a67e-62c28b52da26 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.304541 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138dbf3b-a8e4-4fd2-a67e-62c28b52da26 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:44.306036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138dbf3b-a8e4-4fd2-a67e-62c28b52da26 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:44.320255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-138dbf3b-a8e4-4fd2-a67e-62c28b52da26 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:45:44.320255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:44.320255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:44.320255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:44.320255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:44.320255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:44.320255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:44.320255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:44.320255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:44.320255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:44.320255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:44.320255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:44.320255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:45:44.320255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:45:44.320255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:45:44.320255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:44.321466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:44.322547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:44.322547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:44.322547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:45:44.322547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:45:44.322547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:45:44.322547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:45:44.322547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:45:44.322547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:45:44.322547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:45:44.322547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:44.322547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 285/568] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:44.323180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced8d6b-cd40-4efe-9f68-053153c7ffca None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.323302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced8d6b-cd40-4efe-9f68-053153c7ffca None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.323586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced8d6b-cd40-4efe-9f68-053153c7ffca None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.324856 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 286/569] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:44.325553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced8d6b-cd40-4efe-9f68-053153c7ffca None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.342862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20a49c-93b7-4dad-a095-ad308c23860f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.377483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfc9d3-d153-4485-a670-06a322eaa2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.378148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfc9d3-d153-4485-a670-06a322eaa2de None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.378436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfc9d3-d153-4485-a670-06a322eaa2de None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.378720 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bfc9d3-d153-4485-a670-06a322eaa2de None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.379506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfc9d3-d153-4485-a670-06a322eaa2de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:44.379821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfc9d3-d153-4485-a670-06a322eaa2de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:44.381296 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bfc9d3-d153-4485-a670-06a322eaa2de None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:44.393128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 284/570] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:44.393750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfc9d3-d153-4485-a670-06a322eaa2de None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.423091 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced8d6b-cd40-4efe-9f68-053153c7ffca None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.455007 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592e1d-0de2-4b23-90ed-264f9392e7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.455789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592e1d-0de2-4b23-90ed-264f9392e7ba None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.456104 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592e1d-0de2-4b23-90ed-264f9392e7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.456386 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592e1d-0de2-4b23-90ed-264f9392e7ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.468775 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac592e1d-0de2-4b23-90ed-264f9392e7ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:44.477010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ac592e1d-0de2-4b23-90ed-264f9392e7ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:44.477010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:44.477010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:44.477010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:44.477010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:44.477010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:44.477010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:44.477010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:44.477010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:44.477010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:44.477010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:44.477010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:44.477010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:44.477010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:44.477010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:44.477010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:44.478135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:44.478135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:44.478135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:44.478135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:44.478135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:44.478135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:44.478135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:44.478135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:44.478135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:44.478135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:44.478135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:44.478135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:44.478135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:44.478135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:44.478135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:44.478135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:44.479022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:44.479022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:44.479022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:44.479022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:44.479022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:44.479022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:44.479022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:44.479022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:44.479022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:44.479022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:44.479022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:44.479022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:44.479022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 287/571] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:44.479778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592e1d-0de2-4b23-90ed-264f9392e7ba None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.494460 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bfc9d3-d153-4485-a670-06a322eaa2de None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.505640 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:44.505822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:44.531671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adfefd-740e-4934-b75c-c1a869dc9be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.532573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adfefd-740e-4934-b75c-c1a869dc9be5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.532862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adfefd-740e-4934-b75c-c1a869dc9be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.533138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adfefd-740e-4934-b75c-c1a869dc9be5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.540609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adfefd-740e-4934-b75c-c1a869dc9be5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:44.545921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adfefd-740e-4934-b75c-c1a869dc9be5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:44.556399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-97adfefd-740e-4934-b75c-c1a869dc9be5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 15:45:44.556399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:44.556399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:44.556399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:44.556399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:44.556399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:44.556399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:44.556399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:44.556399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:44.556399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:44.556399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:44.556399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:44.556399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:45:44.556399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:45:44.556399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:45:44.556399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:44.557721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:44.559065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:44.559065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:44.559065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:45:44.559065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:45:44.559065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:45:44.559065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:45:44.559065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:45:44.559065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:45:44.559065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 15:45:44.559065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:44.559065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 285/572] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:44.559065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020b320-a7ae-42da-a6a5-0064cb776214 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.559732 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020b320-a7ae-42da-a6a5-0064cb776214 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.559732 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020b320-a7ae-42da-a6a5-0064cb776214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.576516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8020b320-a7ae-42da-a6a5-0064cb776214 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:44.577719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8020b320-a7ae-42da-a6a5-0064cb776214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:44.587673 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592e1d-0de2-4b23-90ed-264f9392e7ba None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.620377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d290cc-c98f-4b76-9808-11d8f354de8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.621089 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d290cc-c98f-4b76-9808-11d8f354de8c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.621384 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d290cc-c98f-4b76-9808-11d8f354de8c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.621674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d290cc-c98f-4b76-9808-11d8f354de8c None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.622508 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d290cc-c98f-4b76-9808-11d8f354de8c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:44.622829 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d290cc-c98f-4b76-9808-11d8f354de8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:44.624289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d290cc-c98f-4b76-9808-11d8f354de8c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:44.642214 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 288/573] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:44.643313 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d290cc-c98f-4b76-9808-11d8f354de8c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.652051 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 286/574] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:44.652051 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020b320-a7ae-42da-a6a5-0064cb776214 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.722109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:44.735013 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:44.741675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d290cc-c98f-4b76-9808-11d8f354de8c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.750064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020b320-a7ae-42da-a6a5-0064cb776214 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.775548 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455587a6-9e29-4bcd-84ce-c30c8491ceba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.776225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455587a6-9e29-4bcd-84ce-c30c8491ceba None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.776524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455587a6-9e29-4bcd-84ce-c30c8491ceba None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.776806 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455587a6-9e29-4bcd-84ce-c30c8491ceba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.777668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455587a6-9e29-4bcd-84ce-c30c8491ceba None admin] RBAC: Adding query filter params (role.id=740fa9b1529f4a558de5b8987dba5ba3, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=02eade9a475b4002bd3990f08f8a1198) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:44.777987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455587a6-9e29-4bcd-84ce-c30c8491ceba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:44.779427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455587a6-9e29-4bcd-84ce-c30c8491ceba None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:44.779638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052bf8f-bdd3-4704-aa2c-6b68c695584c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.780343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052bf8f-bdd3-4704-aa2c-6b68c695584c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.780744 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052bf8f-bdd3-4704-aa2c-6b68c695584c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.781028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052bf8f-bdd3-4704-aa2c-6b68c695584c None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.781768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052bf8f-bdd3-4704-aa2c-6b68c695584c None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:44.782082 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052bf8f-bdd3-4704-aa2c-6b68c695584c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:44.783434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052bf8f-bdd3-4704-aa2c-6b68c695584c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:44.784857 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 289/575] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/role_assignments?user.id=02eade9a475b4002bd3990f08f8a1198&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=740fa9b1529f4a558de5b8987dba5ba3 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:44.785643 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455587a6-9e29-4bcd-84ce-c30c8491ceba None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.792419 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 287/576] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:44.793111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052bf8f-bdd3-4704-aa2c-6b68c695584c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.901349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455587a6-9e29-4bcd-84ce-c30c8491ceba None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.915733 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052bf8f-bdd3-4704-aa2c-6b68c695584c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:44.941650 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234055d1-01b0-471a-8c42-1611f477ecf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.942340 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234055d1-01b0-471a-8c42-1611f477ecf7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.942632 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234055d1-01b0-471a-8c42-1611f477ecf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.942945 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234055d1-01b0-471a-8c42-1611f477ecf7 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.943774 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234055d1-01b0-471a-8c42-1611f477ecf7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:44.944123 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234055d1-01b0-471a-8c42-1611f477ecf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:44.946173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234055d1-01b0-471a-8c42-1611f477ecf7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:44.955559 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e351be0-05c7-4c1d-bff0-f381e7c535ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:44.956401 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e351be0-05c7-4c1d-bff0-f381e7c535ac None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:44.956693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e351be0-05c7-4c1d-bff0-f381e7c535ac None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:44.956972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e351be0-05c7-4c1d-bff0-f381e7c535ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:44.969414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 290/577] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:44.969414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234055d1-01b0-471a-8c42-1611f477ecf7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:44.969414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:44.974623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e351be0-05c7-4c1d-bff0-f381e7c535ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:44.977004 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e351be0-05c7-4c1d-bff0-f381e7c535ac None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:44.996027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9e351be0-05c7-4c1d-bff0-f381e7c535ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:44.996027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:44.996027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:44.996027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:44.996027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:44.996027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:44.996027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:44.996027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:44.996027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:44.996027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:44.996027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:44.996027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:44.996027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:44.996027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:44.996027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:44.996999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:44.997921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:44.997921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:44.997921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:44.997921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:44.997921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 288/578] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:44.998228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e351be0-05c7-4c1d-bff0-f381e7c535ac None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.012960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:45.135268 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234055d1-01b0-471a-8c42-1611f477ecf7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.170634 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e351be0-05c7-4c1d-bff0-f381e7c535ac None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.171204 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c086f-b3fb-4b55-8894-d33d411c12e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.172022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c086f-b3fb-4b55-8894-d33d411c12e5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.172319 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c086f-b3fb-4b55-8894-d33d411c12e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.172604 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c086f-b3fb-4b55-8894-d33d411c12e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.183192 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c086f-b3fb-4b55-8894-d33d411c12e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:45.191518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b60c086f-b3fb-4b55-8894-d33d411c12e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:45.191518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:45.191518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:45.191518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:45.191518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:45.191518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:45.191518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:45.191518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:45.191518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:45.191518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:45.191518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:45.191518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:45.191518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:45.191518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:45.191518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:45.191518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:45.192519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:45.192519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:45.192519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:45.192519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:45.192519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:45.192519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:45.192519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:45.192519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:45.192519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:45.192519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:45.192519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:45.192519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:45.192519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:45.192519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:45.192519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:45.192519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:45.193404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:45.193404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:45.193404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:45.193404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:45.193404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:45.193404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:45.193404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:45.193404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:45.193404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:45.193404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:45.193404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:45.193404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:45.193404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 291/579] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:45.194123 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c086f-b3fb-4b55-8894-d33d411c12e5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.211256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091515b-a120-4a4f-bd7e-bc5b09d37124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.212154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091515b-a120-4a4f-bd7e-bc5b09d37124 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.212442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091515b-a120-4a4f-bd7e-bc5b09d37124 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.212720 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091515b-a120-4a4f-bd7e-bc5b09d37124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.223669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091515b-a120-4a4f-bd7e-bc5b09d37124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:45.225164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091515b-a120-4a4f-bd7e-bc5b09d37124 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:45.242868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3091515b-a120-4a4f-bd7e-bc5b09d37124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:45.242868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:45.242868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:45.242868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:45.242868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:45.242868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:45.242868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:45.242868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:45.242868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:45.242868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:45.242868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:45.242868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:45.242868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:45.242868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:45.242868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:45.243843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:45.245100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:45.245100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:45.245100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:45.245100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:45.245100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 289/580] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:45.245100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091515b-a120-4a4f-bd7e-bc5b09d37124 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.265109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:45.304405 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:45.309671 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c086f-b3fb-4b55-8894-d33d411c12e5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.345288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e391a04-b8ed-454c-b522-f36095f48c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.346085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e391a04-b8ed-454c-b522-f36095f48c60 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.346372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e391a04-b8ed-454c-b522-f36095f48c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.346735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e391a04-b8ed-454c-b522-f36095f48c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.349305 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091515b-a120-4a4f-bd7e-bc5b09d37124 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.360998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e391a04-b8ed-454c-b522-f36095f48c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:45.362948 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e391a04-b8ed-454c-b522-f36095f48c60 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:45.385456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4e391a04-b8ed-454c-b522-f36095f48c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:45.385456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:45.385456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:45.385456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:45.385456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:45.385456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:45.385456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:45.385456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:45.385456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:45.385456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:45.385456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:45.385456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:45.385456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:45.385456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:45.385456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:45.386579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:45.387734 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:45.387734 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:45.387734 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:45.387734 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:45.389311 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 292/581] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:45.390236 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e391a04-b8ed-454c-b522-f36095f48c60 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.397815 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397ab58-7549-402e-afe8-ccbbc9c039a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.398479 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397ab58-7549-402e-afe8-ccbbc9c039a3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.398765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397ab58-7549-402e-afe8-ccbbc9c039a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.399046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397ab58-7549-402e-afe8-ccbbc9c039a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.399758 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397ab58-7549-402e-afe8-ccbbc9c039a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:45.400098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397ab58-7549-402e-afe8-ccbbc9c039a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:45.401881 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397ab58-7549-402e-afe8-ccbbc9c039a3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:45.414885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 290/582] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:45.419746 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397ab58-7549-402e-afe8-ccbbc9c039a3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.499218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e391a04-b8ed-454c-b522-f36095f48c60 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.514631 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:45.519583 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397ab58-7549-402e-afe8-ccbbc9c039a3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.535159 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:45.536196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b5a42-f19a-4aca-9833-08e86fc91a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.536931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b5a42-f19a-4aca-9833-08e86fc91a47 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.537178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b5a42-f19a-4aca-9833-08e86fc91a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.537475 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b5a42-f19a-4aca-9833-08e86fc91a47 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.539211 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b5a42-f19a-4aca-9833-08e86fc91a47 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:45.539889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b5a42-f19a-4aca-9833-08e86fc91a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:45.541774 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b5a42-f19a-4aca-9833-08e86fc91a47 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:45.555033 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 293/583] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:45:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:45.555882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b5a42-f19a-4aca-9833-08e86fc91a47 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.557314 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022f99-9067-4b45-bb39-cbd207cde63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.558297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022f99-9067-4b45-bb39-cbd207cde63a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.558565 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022f99-9067-4b45-bb39-cbd207cde63a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.558911 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022f99-9067-4b45-bb39-cbd207cde63a None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.559755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0022f99-9067-4b45-bb39-cbd207cde63a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:45.560349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0022f99-9067-4b45-bb39-cbd207cde63a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:45.561723 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0022f99-9067-4b45-bb39-cbd207cde63a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:45.573490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 291/584] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:45.574319 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022f99-9067-4b45-bb39-cbd207cde63a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.667459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b5a42-f19a-4aca-9833-08e86fc91a47 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.674155 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022f99-9067-4b45-bb39-cbd207cde63a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.705274 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f77ca-adc6-46d1-81b3-63b8e6eac264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.706360 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f77ca-adc6-46d1-81b3-63b8e6eac264 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.706931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f77ca-adc6-46d1-81b3-63b8e6eac264 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.707396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f77ca-adc6-46d1-81b3-63b8e6eac264 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.708352 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f77ca-adc6-46d1-81b3-63b8e6eac264 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:45.708880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f77ca-adc6-46d1-81b3-63b8e6eac264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:45.710361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f77ca-adc6-46d1-81b3-63b8e6eac264 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:45.711411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c3700-a4cd-4cc2-a320-dce675a1a017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.712223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c3700-a4cd-4cc2-a320-dce675a1a017 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.712508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c3700-a4cd-4cc2-a320-dce675a1a017 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.712787 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c3700-a4cd-4cc2-a320-dce675a1a017 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.719251 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c3700-a4cd-4cc2-a320-dce675a1a017 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:45.720740 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c3700-a4cd-4cc2-a320-dce675a1a017 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:45.723594 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 294/585] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:45.724620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f77ca-adc6-46d1-81b3-63b8e6eac264 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.734802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-894c3700-a4cd-4cc2-a320-dce675a1a017 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:45.734802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:45.734802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:45.734802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:45.734802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:45.734802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:45.734802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:45.734802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:45.734802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:45.734802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:45.734802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:45.734802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:45.734802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:45:45.734802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:45:45.734802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:45.736198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:45.737119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:45:45.737119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:45:45.737119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:45:45.737119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:45:45.737119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:45:45.737119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:45:45.737119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:45.737119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:45.737119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 292/586] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:45.737119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c3700-a4cd-4cc2-a320-dce675a1a017 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.774101 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:45.775421 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:45.841200 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f77ca-adc6-46d1-81b3-63b8e6eac264 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.841746 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c3700-a4cd-4cc2-a320-dce675a1a017 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:45.877673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcd43d-9794-4027-90c9-9dcfdc385b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.878235 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e744e-07f7-4ff4-bf54-bb5dbd65ce81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:45.878534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd43d-9794-4027-90c9-9dcfdc385b9c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.878822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd43d-9794-4027-90c9-9dcfdc385b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.879032 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e744e-07f7-4ff4-bf54-bb5dbd65ce81 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:45.879145 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd43d-9794-4027-90c9-9dcfdc385b9c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.879324 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e744e-07f7-4ff4-bf54-bb5dbd65ce81 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:45.879642 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e744e-07f7-4ff4-bf54-bb5dbd65ce81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:45.888174 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcd43d-9794-4027-90c9-9dcfdc385b9c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:45.890114 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcd43d-9794-4027-90c9-9dcfdc385b9c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:45.891248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e744e-07f7-4ff4-bf54-bb5dbd65ce81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:45.892824 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e744e-07f7-4ff4-bf54-bb5dbd65ce81 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:45.906520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-16dcd43d-9794-4027-90c9-9dcfdc385b9c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 15:45:45.906520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:45.906520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:45.906520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:45.906520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:45.906520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:45.906520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:45.906520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:45.906520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:45.906520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:45.906520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:45.906520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:45.906520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:45:45.906520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:45:45.906520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:45:45.906520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:45.907532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:45.908900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:45.908900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:45.908900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:45:45.908900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:45:45.908900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:45:45.908900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:45:45.908900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:45:45.908900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:45:45.908900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 15:45:45.908900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:45.911709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e05e744e-07f7-4ff4-bf54-bb5dbd65ce81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:45.911709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:45.911709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:45.911709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:45.911709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:45.911709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:45.911709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:45.911709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:45.911709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:45.911709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:45.911709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:45.911709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:45.911709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:45.911709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:45.911709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:45.918035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:45.920293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:45.920293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:45.920293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:45.920293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:45.920589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 293/587] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:45.920681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 295/588] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:45.920787 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcd43d-9794-4027-90c9-9dcfdc385b9c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:45.920885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e744e-07f7-4ff4-bf54-bb5dbd65ce81 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:46.012870 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:46.023129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:46.025599 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e744e-07f7-4ff4-bf54-bb5dbd65ce81 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:46.029590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcd43d-9794-4027-90c9-9dcfdc385b9c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:46.062270 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573778a7-1bb5-411f-b0e3-c558e7171e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:46.062913 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573778a7-1bb5-411f-b0e3-c558e7171e8f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.063199 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573778a7-1bb5-411f-b0e3-c558e7171e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.063484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573778a7-1bb5-411f-b0e3-c558e7171e8f None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.063802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae122e5-0a0b-4028-a280-bbeff3127e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:46.064294 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573778a7-1bb5-411f-b0e3-c558e7171e8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:46.064606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573778a7-1bb5-411f-b0e3-c558e7171e8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:46.064703 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae122e5-0a0b-4028-a280-bbeff3127e5b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.064911 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae122e5-0a0b-4028-a280-bbeff3127e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.065196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae122e5-0a0b-4028-a280-bbeff3127e5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.066121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573778a7-1bb5-411f-b0e3-c558e7171e8f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:46.073151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae122e5-0a0b-4028-a280-bbeff3127e5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:46.075500 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae122e5-0a0b-4028-a280-bbeff3127e5b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:46.083230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 296/589] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:45:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:46.083230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573778a7-1bb5-411f-b0e3-c558e7171e8f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:46.089982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7ae122e5-0a0b-4028-a280-bbeff3127e5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:46.089982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:46.089982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:46.089982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:46.089982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:46.089982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:46.089982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:46.089982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:46.089982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:46.089982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:46.089982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:46.089982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:46.089982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:45:46.089982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:45:46.089982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:46.090887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:46.091803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:45:46.091803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:45:46.091803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:45:46.091803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:45:46.091803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:45:46.091803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:45:46.091803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:46.091803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:46.095955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 294/590] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:46.096832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae122e5-0a0b-4028-a280-bbeff3127e5b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:46.192634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573778a7-1bb5-411f-b0e3-c558e7171e8f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:46.201596 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae122e5-0a0b-4028-a280-bbeff3127e5b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:46.227351 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee37c8-a06a-4632-b8ba-9467c561e23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:46.228324 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee37c8-a06a-4632-b8ba-9467c561e23c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.228813 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee37c8-a06a-4632-b8ba-9467c561e23c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.229284 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee37c8-a06a-4632-b8ba-9467c561e23c None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.230317 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee37c8-a06a-4632-b8ba-9467c561e23c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:46.230819 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee37c8-a06a-4632-b8ba-9467c561e23c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:46.232462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee37c8-a06a-4632-b8ba-9467c561e23c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:46.236599 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ddd31-af16-43a5-a339-49c19e0d3667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:46.237252 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ddd31-af16-43a5-a339-49c19e0d3667 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.237538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ddd31-af16-43a5-a339-49c19e0d3667 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.237817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ddd31-af16-43a5-a339-49c19e0d3667 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.238525 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ddd31-af16-43a5-a339-49c19e0d3667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:46.238833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ddd31-af16-43a5-a339-49c19e0d3667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:46.240210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ddd31-af16-43a5-a339-49c19e0d3667 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:46.256121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 295/592] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:46.256121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ddd31-af16-43a5-a339-49c19e0d3667 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:46.256632 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 297/592] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Jun 2 15:45:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:46.258045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee37c8-a06a-4632-b8ba-9467c561e23c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:46.270658 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:46.276768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:46.365294 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ddd31-af16-43a5-a339-49c19e0d3667 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:46.380314 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee37c8-a06a-4632-b8ba-9467c561e23c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:46.402030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059c0ad-25ff-41fd-99bb-4301948b4d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:46.402919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059c0ad-25ff-41fd-99bb-4301948b4d6f None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.403203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059c0ad-25ff-41fd-99bb-4301948b4d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.403481 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059c0ad-25ff-41fd-99bb-4301948b4d6f None admin] PATH_INFO: `/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/2e53683ae2b34947a1550de269b74d10/roles/740fa9b1529f4a558de5b8987dba5ba3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.416979 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d56868-5e48-464b-a4c1-48ebe98e625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:46.417636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d56868-5e48-464b-a4c1-48ebe98e625f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.417924 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d56868-5e48-464b-a4c1-48ebe98e625f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.418203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d56868-5e48-464b-a4c1-48ebe98e625f None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.418649 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059c0ad-25ff-41fd-99bb-4301948b4d6f None admin] RBAC: Authorizing `identity:create_grant(project_id=e2775777647e4323a554bb3a5d045fc0, user_id=2e53683ae2b34947a1550de269b74d10, role_id=740fa9b1529f4a558de5b8987dba5ba3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:46.418992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d56868-5e48-464b-a4c1-48ebe98e625f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:46.419304 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d56868-5e48-464b-a4c1-48ebe98e625f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:46.420158 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059c0ad-25ff-41fd-99bb-4301948b4d6f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:46.420757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d56868-5e48-464b-a4c1-48ebe98e625f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:46.433205 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 298/593] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:45:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:46.437218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d56868-5e48-464b-a4c1-48ebe98e625f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:46.496109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 296/594] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:45:46 2022] PUT /identity/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/2e53683ae2b34947a1550de269b74d10/roles/740fa9b1529f4a558de5b8987dba5ba3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:46.496951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059c0ad-25ff-41fd-99bb-4301948b4d6f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:46.508906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:46.551004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d56868-5e48-464b-a4c1-48ebe98e625f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:46.592510 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:46.615082 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5781b81-65a5-4cae-b7d1-873ba033b542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:46.616320 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5781b81-65a5-4cae-b7d1-873ba033b542 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.616784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5781b81-65a5-4cae-b7d1-873ba033b542 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.619974 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5781b81-65a5-4cae-b7d1-873ba033b542 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.626830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5781b81-65a5-4cae-b7d1-873ba033b542 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:46.628805 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5781b81-65a5-4cae-b7d1-873ba033b542 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:46.629358 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059c0ad-25ff-41fd-99bb-4301948b4d6f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:46.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b5781b81-65a5-4cae-b7d1-873ba033b542 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 15:45:46.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:46.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:46.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:46.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:46.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:46.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:46.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:46.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:46.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:46.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:46.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:46.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:45:46.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:45:46.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:45:46.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:46.646994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:46.648875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:46.648875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:46.648875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:45:46.648875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:45:46.648875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:45:46.648875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:45:46.648875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:45:46.648875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:45:46.648875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 15:45:46.648875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:46.655843 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 299/595] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:46.657151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5781b81-65a5-4cae-b7d1-873ba033b542 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:46.672656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a362e8d-7471-4b51-b0b0-7c6d44629701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:46.673470 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a362e8d-7471-4b51-b0b0-7c6d44629701 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.673763 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a362e8d-7471-4b51-b0b0-7c6d44629701 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.674488 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a362e8d-7471-4b51-b0b0-7c6d44629701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.689233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a362e8d-7471-4b51-b0b0-7c6d44629701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:46.691512 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a362e8d-7471-4b51-b0b0-7c6d44629701 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:46.716548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6a362e8d-7471-4b51-b0b0-7c6d44629701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:46.716548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:46.716548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:46.716548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:46.716548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:46.716548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:46.716548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:46.716548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:46.716548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:46.716548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:46.716548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:46.716548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:46.716548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:46.716548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:46.716548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:46.717585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:46.718968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:46.718968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:46.718968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:46.718968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:46.718968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 297/596] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:46.718968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a362e8d-7471-4b51-b0b0-7c6d44629701 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:46.799648 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5781b81-65a5-4cae-b7d1-873ba033b542 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:46.833457 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a362e8d-7471-4b51-b0b0-7c6d44629701 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:46.836420 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:46.844715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89421041-6dda-400c-b611-d1990e91d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:46.845623 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421041-6dda-400c-b611-d1990e91d64a None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.845908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421041-6dda-400c-b611-d1990e91d64a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.846211 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421041-6dda-400c-b611-d1990e91d64a None admin] PATH_INFO: `/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/a4c3818af2794f598c21ee4aab4b3a70/roles/740fa9b1529f4a558de5b8987dba5ba3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.855677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:46.868101 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89421041-6dda-400c-b611-d1990e91d64a None admin] RBAC: Authorizing `identity:create_grant(project_id=e2775777647e4323a554bb3a5d045fc0, user_id=a4c3818af2794f598c21ee4aab4b3a70, role_id=740fa9b1529f4a558de5b8987dba5ba3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:46.869987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89421041-6dda-400c-b611-d1990e91d64a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:46.876423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6627853-d02c-47df-8cdc-e41b0f947395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:46.877180 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6627853-d02c-47df-8cdc-e41b0f947395 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:46.877543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6627853-d02c-47df-8cdc-e41b0f947395 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:46.877896 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6627853-d02c-47df-8cdc-e41b0f947395 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:46.878810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6627853-d02c-47df-8cdc-e41b0f947395 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:46.879212 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6627853-d02c-47df-8cdc-e41b0f947395 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:46.880880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6627853-d02c-47df-8cdc-e41b0f947395 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:46.904119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 298/597] 10.222.0.50 () {56 vars in 1139 bytes} [Thu Jun 2 15:45:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:46.904968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6627853-d02c-47df-8cdc-e41b0f947395 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:46.939918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 300/598] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:45:46 2022] PUT /identity/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/a4c3818af2794f598c21ee4aab4b3a70/roles/740fa9b1529f4a558de5b8987dba5ba3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:46.941604 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89421041-6dda-400c-b611-d1990e91d64a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:47.093708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6627853-d02c-47df-8cdc-e41b0f947395 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:47.106718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89421041-6dda-400c-b611-d1990e91d64a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:47.171187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048713c-6761-4812-b230-0bed91f5447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:47.171922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048713c-6761-4812-b230-0bed91f5447e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.172248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048713c-6761-4812-b230-0bed91f5447e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.172526 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048713c-6761-4812-b230-0bed91f5447e None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.172691 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b875c2c-a25d-47f7-a469-f6b7d1eae877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:47.173265 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048713c-6761-4812-b230-0bed91f5447e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:47.173507 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b875c2c-a25d-47f7-a469-f6b7d1eae877 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.173616 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048713c-6761-4812-b230-0bed91f5447e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:47.173795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b875c2c-a25d-47f7-a469-f6b7d1eae877 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.174077 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b875c2c-a25d-47f7-a469-f6b7d1eae877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.174954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048713c-6761-4812-b230-0bed91f5447e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:47.190091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 299/599] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:47.191931 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e8720-8b5f-4222-bc37-2613069c70cc None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.192201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b875c2c-a25d-47f7-a469-f6b7d1eae877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:47.192287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e8720-8b5f-4222-bc37-2613069c70cc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.192518 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e8720-8b5f-4222-bc37-2613069c70cc None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.193571 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b875c2c-a25d-47f7-a469-f6b7d1eae877 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:47.194351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 300/600] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:47.194975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e8720-8b5f-4222-bc37-2613069c70cc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:47.216566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8b875c2c-a25d-47f7-a469-f6b7d1eae877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:47.216566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:47.216566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:47.216566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:47.216566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:47.216566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:47.216566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:47.216566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:47.216566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:47.216566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:47.216566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:47.216566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:47.216566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:47.216566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:47.216566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:47.217532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:47.218440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:47.218440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:47.218440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:47.218440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:47.220873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 301/601] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:47.222433 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8acf5-4f85-439e-aa11-653c927e6f44 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.222943 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8acf5-4f85-439e-aa11-653c927e6f44 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.223427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8acf5-4f85-439e-aa11-653c927e6f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.240362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:47.240918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a8c8acf5-4f85-439e-aa11-653c927e6f44 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:47.243366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a8c8acf5-4f85-439e-aa11-653c927e6f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:47.267919 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:47.320935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 302/602] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:47.322066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8acf5-4f85-439e-aa11-653c927e6f44 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:47.337749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e8720-8b5f-4222-bc37-2613069c70cc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:47.397475 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6aca8a-9b61-4144-a85d-2c96756be408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:47.398362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6aca8a-9b61-4144-a85d-2c96756be408 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.398657 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6aca8a-9b61-4144-a85d-2c96756be408 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.398941 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6aca8a-9b61-4144-a85d-2c96756be408 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.419868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6aca8a-9b61-4144-a85d-2c96756be408 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:47.421376 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6aca8a-9b61-4144-a85d-2c96756be408 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:47.442824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4d6aca8a-9b61-4144-a85d-2c96756be408 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:47.442824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:47.442824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:47.442824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:47.442824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:47.442824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:47.442824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:47.442824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:47.442824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:47.442824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:47.442824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:47.442824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:47.442824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:45:47.442824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:45:47.442824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:47.443775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:47.444814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:45:47.444814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:45:47.444814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:45:47.444814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:45:47.444814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:45:47.444814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:45:47.444814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:47.444814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:47.444814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 301/603] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:47.446192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6aca8a-9b61-4144-a85d-2c96756be408 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:47.511111 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8acf5-4f85-439e-aa11-653c927e6f44 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:47.593902 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da1385-54c0-411b-b076-7fb3fc3bc4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:47.594969 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da1385-54c0-411b-b076-7fb3fc3bc4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.595455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da1385-54c0-411b-b076-7fb3fc3bc4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.595949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da1385-54c0-411b-b076-7fb3fc3bc4e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.598457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da1385-54c0-411b-b076-7fb3fc3bc4e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:47.598981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da1385-54c0-411b-b076-7fb3fc3bc4e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:47.602161 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:47.605275 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da1385-54c0-411b-b076-7fb3fc3bc4e8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:47.609345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6aca8a-9b61-4144-a85d-2c96756be408 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:47.627159 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 303/604] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:47.628404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da1385-54c0-411b-b076-7fb3fc3bc4e8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:47.663901 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea515e1-08fd-4f4a-807f-ddd53c76e857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:47.664882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:47.665735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea515e1-08fd-4f4a-807f-ddd53c76e857 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.666278 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea515e1-08fd-4f4a-807f-ddd53c76e857 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.666767 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea515e1-08fd-4f4a-807f-ddd53c76e857 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.677973 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea515e1-08fd-4f4a-807f-ddd53c76e857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:47.686185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-aea515e1-08fd-4f4a-807f-ddd53c76e857 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:47.686185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:47.686185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:47.686185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:47.686185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:47.686185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:47.686185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:47.686185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:47.686185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:47.686185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:47.686185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:47.686185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:47.686185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:47.686185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:47.686185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:47.686185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:47.687122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:47.687122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:47.687122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:47.687122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:47.687122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:47.687122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:47.687122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:47.687122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:47.687122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:47.687122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:47.687122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:47.687122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:47.687122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:47.687122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:47.687122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:47.687122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:47.688007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:47.688007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:47.688007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:47.688007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:47.688007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:47.688007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:47.688007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:47.688007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:47.688007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:47.688007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:47.688007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:47.688007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:47.690772 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 302/605] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:47.691776 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea515e1-08fd-4f4a-807f-ddd53c76e857 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:47.771223 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da1385-54c0-411b-b076-7fb3fc3bc4e8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:47.814059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5300738-8811-48f0-b81e-0c9b195dd714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:47.815140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5300738-8811-48f0-b81e-0c9b195dd714 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.815626 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5300738-8811-48f0-b81e-0c9b195dd714 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.816193 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5300738-8811-48f0-b81e-0c9b195dd714 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.816889 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea515e1-08fd-4f4a-807f-ddd53c76e857 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:47.817424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5300738-8811-48f0-b81e-0c9b195dd714 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:47.817938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5300738-8811-48f0-b81e-0c9b195dd714 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:47.820121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5300738-8811-48f0-b81e-0c9b195dd714 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:47.832991 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 304/606] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:45:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:47.834190 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5300738-8811-48f0-b81e-0c9b195dd714 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:47.859468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdfdcc-7693-48da-b81a-0eaa47dcbd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:47.860329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdfdcc-7693-48da-b81a-0eaa47dcbd4c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.860621 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdfdcc-7693-48da-b81a-0eaa47dcbd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.860904 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdfdcc-7693-48da-b81a-0eaa47dcbd4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.868689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdfdcc-7693-48da-b81a-0eaa47dcbd4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:47.870147 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdfdcc-7693-48da-b81a-0eaa47dcbd4c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:47.885084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-90cdfdcc-7693-48da-b81a-0eaa47dcbd4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:47.885084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:47.885084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:47.885084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:47.885084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:47.885084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:47.885084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:47.885084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:47.885084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:47.885084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:47.885084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:47.885084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:47.885084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:45:47.885084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:45:47.885084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:47.886108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:47.887011 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:45:47.887011 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:45:47.887011 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:45:47.887011 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:45:47.887011 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:45:47.887011 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:45:47.887011 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:47.887011 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:47.887011 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 303/607] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:47.887512 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdfdcc-7693-48da-b81a-0eaa47dcbd4c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:47.904864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:47.923606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:47.946760 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5300738-8811-48f0-b81e-0c9b195dd714 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:47.985292 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464ac56-9d00-47d2-a544-203cefbe339f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:47.986126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464ac56-9d00-47d2-a544-203cefbe339f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:47.986623 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464ac56-9d00-47d2-a544-203cefbe339f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:47.986879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464ac56-9d00-47d2-a544-203cefbe339f None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:47.987901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464ac56-9d00-47d2-a544-203cefbe339f None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:47.988359 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464ac56-9d00-47d2-a544-203cefbe339f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:47.989932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1464ac56-9d00-47d2-a544-203cefbe339f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:48.000302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 305/608] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:45:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:48.001332 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464ac56-9d00-47d2-a544-203cefbe339f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:48.021042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdfdcc-7693-48da-b81a-0eaa47dcbd4c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:48.058071 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc31356-655c-4f5f-9329-15d58c37161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:48.059124 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc31356-655c-4f5f-9329-15d58c37161a None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:48.059496 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc31356-655c-4f5f-9329-15d58c37161a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:48.059874 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc31356-655c-4f5f-9329-15d58c37161a None admin] PATH_INFO: `/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/a6a5157588644972a6a4554b3a9f1d76/roles/740fa9b1529f4a558de5b8987dba5ba3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:48.074065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc31356-655c-4f5f-9329-15d58c37161a None admin] RBAC: Authorizing `identity:create_grant(project_id=e2775777647e4323a554bb3a5d045fc0, user_id=a6a5157588644972a6a4554b3a9f1d76, role_id=740fa9b1529f4a558de5b8987dba5ba3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:48.075621 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc31356-655c-4f5f-9329-15d58c37161a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:48.114928 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464ac56-9d00-47d2-a544-203cefbe339f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:48.151010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb6bfd-b392-44b6-962f-85fd2e6153ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:48.151871 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb6bfd-b392-44b6-962f-85fd2e6153ed None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:48.152357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb6bfd-b392-44b6-962f-85fd2e6153ed None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:48.152808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb6bfd-b392-44b6-962f-85fd2e6153ed None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:48.153740 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb6bfd-b392-44b6-962f-85fd2e6153ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:48.154204 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb6bfd-b392-44b6-962f-85fd2e6153ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:48.155778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb6bfd-b392-44b6-962f-85fd2e6153ed None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:48.165218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:48.169530 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 306/609] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:45:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:48.170690 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb6bfd-b392-44b6-962f-85fd2e6153ed None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:48.173311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 304/610] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:45:47 2022] PUT /identity/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/a6a5157588644972a6a4554b3a9f1d76/roles/740fa9b1529f4a558de5b8987dba5ba3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:48.180314 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc31356-655c-4f5f-9329-15d58c37161a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:48.281250 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:48.287048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb6bfd-b392-44b6-962f-85fd2e6153ed None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:48.329617 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d09413-2a0d-494e-a2cc-4ed54dc2dc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:48.330771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d09413-2a0d-494e-a2cc-4ed54dc2dc5c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:48.331270 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d09413-2a0d-494e-a2cc-4ed54dc2dc5c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:48.331747 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d09413-2a0d-494e-a2cc-4ed54dc2dc5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:48.344020 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d09413-2a0d-494e-a2cc-4ed54dc2dc5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:48.345805 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d09413-2a0d-494e-a2cc-4ed54dc2dc5c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:48.349626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc31356-655c-4f5f-9329-15d58c37161a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:48.367139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c3d09413-2a0d-494e-a2cc-4ed54dc2dc5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:48.367139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:48.367139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:48.367139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:48.367139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:48.367139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:48.367139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:48.367139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:48.367139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:48.367139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:48.367139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:48.367139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:48.367139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:48.367139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:48.367139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:48.368666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:48.369811 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:48.369811 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:48.369811 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:48.369811 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:48.373542 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 307/611] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:48.380108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d09413-2a0d-494e-a2cc-4ed54dc2dc5c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:48.438790 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7e2a9-7f31-47fb-b02b-2a447cce5537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:48.440028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7e2a9-7f31-47fb-b02b-2a447cce5537 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:48.440534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7e2a9-7f31-47fb-b02b-2a447cce5537 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:48.441015 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7e2a9-7f31-47fb-b02b-2a447cce5537 None admin] PATH_INFO: `/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/c3ec010ab4c5414a8782cecf202fbcfe/roles/740fa9b1529f4a558de5b8987dba5ba3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:48.463857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7e2a9-7f31-47fb-b02b-2a447cce5537 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2775777647e4323a554bb3a5d045fc0, user_id=c3ec010ab4c5414a8782cecf202fbcfe, role_id=740fa9b1529f4a558de5b8987dba5ba3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:48.466387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7e2a9-7f31-47fb-b02b-2a447cce5537 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:48.477574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:48.529644 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d09413-2a0d-494e-a2cc-4ed54dc2dc5c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:48.542984 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 305/612] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:45:48 2022] PUT /identity/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/c3ec010ab4c5414a8782cecf202fbcfe/roles/740fa9b1529f4a558de5b8987dba5ba3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:48.579708 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516a213-fee1-4b03-a76e-3a9e4e452876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:48.580758 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516a213-fee1-4b03-a76e-3a9e4e452876 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:48.581256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516a213-fee1-4b03-a76e-3a9e4e452876 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:48.581718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516a213-fee1-4b03-a76e-3a9e4e452876 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:48.582631 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516a213-fee1-4b03-a76e-3a9e4e452876 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:48.583126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516a213-fee1-4b03-a76e-3a9e4e452876 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:48.584757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516a213-fee1-4b03-a76e-3a9e4e452876 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:48.602754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 308/613] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:48.608248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7e2a9-7f31-47fb-b02b-2a447cce5537 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:48.731292 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7e2a9-7f31-47fb-b02b-2a447cce5537 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:48.750253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:48.774235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee6f16-6a88-4005-8e18-08339276fde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:48.775909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6f16-6a88-4005-8e18-08339276fde2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:48.775909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6f16-6a88-4005-8e18-08339276fde2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:48.775909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6f16-6a88-4005-8e18-08339276fde2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:48.784155 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee6f16-6a88-4005-8e18-08339276fde2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:48.785647 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee6f16-6a88-4005-8e18-08339276fde2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:48.802476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8bee6f16-6a88-4005-8e18-08339276fde2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:45:48.802476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:48.802476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:48.802476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:48.802476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:48.802476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:48.802476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:48.802476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:48.802476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:48.802476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:48.802476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:48.802476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:48.802476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:45:48.802476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:45:48.802476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:45:48.802476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:48.804285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:48.805493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:48.805493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:48.805493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:45:48.805493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:45:48.805493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:45:48.805493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:45:48.805493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:45:48.805493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:45:48.805493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:45:48.805493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:48.808376 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 306/614] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:48.817163 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516a213-fee1-4b03-a76e-3a9e4e452876 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:48.945816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516a213-fee1-4b03-a76e-3a9e4e452876 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:48.961318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:48.982850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d4809-0f1c-4515-addb-0530e589d4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:48.983899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d4809-0f1c-4515-addb-0530e589d4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:48.984447 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d4809-0f1c-4515-addb-0530e589d4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:48.984928 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d4809-0f1c-4515-addb-0530e589d4a0 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:48.985966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d4809-0f1c-4515-addb-0530e589d4a0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:48.986502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d4809-0f1c-4515-addb-0530e589d4a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:48.988174 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d4809-0f1c-4515-addb-0530e589d4a0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:49.009195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 309/615] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Jun 2 15:45:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:49.015105 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee6f16-6a88-4005-8e18-08339276fde2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:49.119670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1200f3-c000-4273-98a9-ecc4d5062403 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:49.120085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1200f3-c000-4273-98a9-ecc4d5062403 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:49.120272 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1200f3-c000-4273-98a9-ecc4d5062403 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:49.122063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 310/616] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:49.127203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690daac-e201-4717-b4ea-19148cf05051 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:49.127502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690daac-e201-4717-b4ea-19148cf05051 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:49.127782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690daac-e201-4717-b4ea-19148cf05051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:49.134000 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee6f16-6a88-4005-8e18-08339276fde2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:49.166100 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3690daac-e201-4717-b4ea-19148cf05051 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:49.167693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3690daac-e201-4717-b4ea-19148cf05051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:49.171882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccafa6-2d7b-4e09-823f-6e19deeea975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:49.172709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccafa6-2d7b-4e09-823f-6e19deeea975 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:49.172990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccafa6-2d7b-4e09-823f-6e19deeea975 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:49.173266 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccafa6-2d7b-4e09-823f-6e19deeea975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:49.191219 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccafa6-2d7b-4e09-823f-6e19deeea975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:49.192720 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccafa6-2d7b-4e09-823f-6e19deeea975 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:49.227356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-cbccafa6-2d7b-4e09-823f-6e19deeea975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:49.227356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:49.227356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:49.227356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:49.227356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:49.227356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:49.227356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:49.227356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:49.227356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:49.227356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:49.227356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:49.227356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:49.227356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:49.227356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:49.227356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:49.228361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:49.229271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:49.229271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:49.229271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:49.229271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:49.229271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 307/617] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:49.237018 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccafa6-2d7b-4e09-823f-6e19deeea975 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:49.266168 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:49.320584 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 311/618] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:49.345114 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccafa6-2d7b-4e09-823f-6e19deeea975 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:49.345977 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690daac-e201-4717-b4ea-19148cf05051 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:49.388947 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dc3e4-63fb-4c12-a17f-faad4f479c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:49.390911 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dc3e4-63fb-4c12-a17f-faad4f479c8e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:49.391203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dc3e4-63fb-4c12-a17f-faad4f479c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:49.391488 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dc3e4-63fb-4c12-a17f-faad4f479c8e None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:49.392239 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dc3e4-63fb-4c12-a17f-faad4f479c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:49.392555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dc3e4-63fb-4c12-a17f-faad4f479c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:49.393943 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dc3e4-63fb-4c12-a17f-faad4f479c8e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:49.424527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 308/619] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:49.427655 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dc3e4-63fb-4c12-a17f-faad4f479c8e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:49.532449 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:49.535738 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690daac-e201-4717-b4ea-19148cf05051 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:49.538317 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:49.558349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dc3e4-63fb-4c12-a17f-faad4f479c8e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:49.578637 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c0111-e1cb-4974-b1fc-3bfef75b2661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:49.579450 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c0111-e1cb-4974-b1fc-3bfef75b2661 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:49.579743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c0111-e1cb-4974-b1fc-3bfef75b2661 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:49.580032 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c0111-e1cb-4974-b1fc-3bfef75b2661 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:49.602355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c0111-e1cb-4974-b1fc-3bfef75b2661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:49.617952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-605c0111-e1cb-4974-b1fc-3bfef75b2661 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:49.617952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:49.617952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:49.617952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:49.617952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:49.617952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:49.617952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:49.617952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:49.617952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:49.617952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:49.617952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:49.617952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:49.617952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:49.617952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:49.617952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:49.617952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:49.618982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:49.618982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:49.618982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:49.618982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:49.618982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:49.618982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:49.618982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:49.618982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:49.618982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:49.618982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:49.618982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:49.618982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:49.618982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:49.618982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:49.618982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:49.618982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:49.619854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:49.619854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:49.619854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:49.619854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:49.619854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:49.619854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:49.619854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:49.619854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:49.619854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:49.619854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:49.619854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:49.619854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:49.619854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 312/620] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:49.622673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bef79b-2d9b-4803-9544-38f8d79d799a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:49.623473 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bef79b-2d9b-4803-9544-38f8d79d799a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:49.623755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bef79b-2d9b-4803-9544-38f8d79d799a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:49.624316 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bef79b-2d9b-4803-9544-38f8d79d799a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:49.625694 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c0111-e1cb-4974-b1fc-3bfef75b2661 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:49.639058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bef79b-2d9b-4803-9544-38f8d79d799a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:49.640628 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bef79b-2d9b-4803-9544-38f8d79d799a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:49.658234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-25bef79b-2d9b-4803-9544-38f8d79d799a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:49.658234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:49.658234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:49.658234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:49.658234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:49.658234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:49.658234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:49.658234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:49.658234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:49.658234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:49.658234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:49.658234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:49.658234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:45:49.658234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:45:49.658234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:49.660428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:49.662516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:45:49.662516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:45:49.662516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:45:49.662516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:45:49.662516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:45:49.662516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:45:49.662516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:49.662516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:49.662516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 309/621] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:49.666129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bef79b-2d9b-4803-9544-38f8d79d799a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:49.785842 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c0111-e1cb-4974-b1fc-3bfef75b2661 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:49.815451 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bef79b-2d9b-4803-9544-38f8d79d799a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:49.824088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efbb6c-fb51-46b8-b424-45e295e67e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:49.825051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efbb6c-fb51-46b8-b424-45e295e67e2a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:49.825633 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efbb6c-fb51-46b8-b424-45e295e67e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:49.826115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efbb6c-fb51-46b8-b424-45e295e67e2a None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:49.827171 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efbb6c-fb51-46b8-b424-45e295e67e2a None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:49.827702 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efbb6c-fb51-46b8-b424-45e295e67e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:49.829421 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efbb6c-fb51-46b8-b424-45e295e67e2a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:49.838726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 313/622] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:45:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:49.840373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4081e5-ba1b-492b-95db-3d7b2f9f8f8e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:49.840963 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4081e5-ba1b-492b-95db-3d7b2f9f8f8e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:49.841480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4081e5-ba1b-492b-95db-3d7b2f9f8f8e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:49.847214 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 314/623] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:49.848275 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4081e5-ba1b-492b-95db-3d7b2f9f8f8e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:49.853209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429680e-547d-4c4b-a0e6-bb994988cc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:49.853896 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429680e-547d-4c4b-a0e6-bb994988cc3c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:49.854192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429680e-547d-4c4b-a0e6-bb994988cc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:49.854459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429680e-547d-4c4b-a0e6-bb994988cc3c None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:49.855237 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429680e-547d-4c4b-a0e6-bb994988cc3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:49.855548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429680e-547d-4c4b-a0e6-bb994988cc3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:49.857010 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429680e-547d-4c4b-a0e6-bb994988cc3c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:49.875333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 310/624] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:45:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:49.876650 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c72530-b202-4054-aa31-b07ef67bc362 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:49.876944 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c72530-b202-4054-aa31-b07ef67bc362 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:49.877223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c72530-b202-4054-aa31-b07ef67bc362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:49.885921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:49.892409 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:49.897995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-59c72530-b202-4054-aa31-b07ef67bc362 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:49.899186 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-59c72530-b202-4054-aa31-b07ef67bc362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:49.976271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 311/625] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:49.977150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c72530-b202-4054-aa31-b07ef67bc362 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:49.996892 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4081e5-ba1b-492b-95db-3d7b2f9f8f8e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:50.048704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539abc2-52ae-4423-bcd0-b3b9a029e0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:50.050353 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539abc2-52ae-4423-bcd0-b3b9a029e0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.050886 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539abc2-52ae-4423-bcd0-b3b9a029e0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.051657 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539abc2-52ae-4423-bcd0-b3b9a029e0c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.071250 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539abc2-52ae-4423-bcd0-b3b9a029e0c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:50.073434 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539abc2-52ae-4423-bcd0-b3b9a029e0c9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:50.096679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4539abc2-52ae-4423-bcd0-b3b9a029e0c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:50.096679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:50.096679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:50.096679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:50.096679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:50.096679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:50.096679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:50.096679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:50.096679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:50.096679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:50.096679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:50.096679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:50.096679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:50.096679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:50.096679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:50.097672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:50.098888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:50.098888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:50.098888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:50.098888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:50.098888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 315/626] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:50.099349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539abc2-52ae-4423-bcd0-b3b9a029e0c9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:50.111908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c72530-b202-4054-aa31-b07ef67bc362 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:50.160356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51cfd1-fca5-48c9-98f9-4a625f01b60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:50.161764 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51cfd1-fca5-48c9-98f9-4a625f01b60e None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.162205 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51cfd1-fca5-48c9-98f9-4a625f01b60e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.162819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51cfd1-fca5-48c9-98f9-4a625f01b60e None admin] PATH_INFO: `/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/02eade9a475b4002bd3990f08f8a1198/roles/740fa9b1529f4a558de5b8987dba5ba3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.167796 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:50.181765 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:50.183267 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51cfd1-fca5-48c9-98f9-4a625f01b60e None admin] RBAC: Authorizing `identity:create_grant(project_id=e2775777647e4323a554bb3a5d045fc0, user_id=02eade9a475b4002bd3990f08f8a1198, role_id=740fa9b1529f4a558de5b8987dba5ba3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:50.185301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51cfd1-fca5-48c9-98f9-4a625f01b60e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:50.207495 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539abc2-52ae-4423-bcd0-b3b9a029e0c9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:50.241192 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789035f-eeef-415e-a094-70666330dede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:50.241987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789035f-eeef-415e-a094-70666330dede None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.242278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789035f-eeef-415e-a094-70666330dede None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.242812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789035f-eeef-415e-a094-70666330dede None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.252807 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789035f-eeef-415e-a094-70666330dede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:50.260845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4789035f-eeef-415e-a094-70666330dede None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:50.260845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:50.260845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:50.260845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:50.260845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:50.260845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:50.260845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:50.260845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:50.260845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:50.260845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:50.260845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:50.260845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:50.260845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:50.260845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:50.260845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:50.260845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:50.262023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:50.262023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:50.262023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:50.262023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:50.262023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:50.262023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:50.262023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:50.262023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:50.262023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:50.262023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:50.262023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:50.262023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:50.262023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:50.262023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:50.262023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:50.262023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:50.263141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:50.263141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:50.263141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:50.263141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:50.263141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:50.263141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:50.263141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:50.263141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:50.263141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:50.263141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:50.263141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:50.263141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:50.276096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 316/628] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:50.276096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789035f-eeef-415e-a094-70666330dede None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:50.276472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 312/628] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:45:49 2022] PUT /identity/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/02eade9a475b4002bd3990f08f8a1198/roles/740fa9b1529f4a558de5b8987dba5ba3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:45:50.280960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51cfd1-fca5-48c9-98f9-4a625f01b60e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:50.482267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789035f-eeef-415e-a094-70666330dede None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:50.501431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51cfd1-fca5-48c9-98f9-4a625f01b60e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:50.542164 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9873f-eb0a-4a43-859d-d513ee7f6937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:50.542849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9873f-eb0a-4a43-859d-d513ee7f6937 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.543107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9873f-eb0a-4a43-859d-d513ee7f6937 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.543392 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9873f-eb0a-4a43-859d-d513ee7f6937 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.544145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9873f-eb0a-4a43-859d-d513ee7f6937 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:50.544462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9873f-eb0a-4a43-859d-d513ee7f6937 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:50.546102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9873f-eb0a-4a43-859d-d513ee7f6937 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:50.547433 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:50.552340 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190e21b-efcb-4295-a0c1-1853700950cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:50.553314 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190e21b-efcb-4295-a0c1-1853700950cc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.553885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190e21b-efcb-4295-a0c1-1853700950cc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.554402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190e21b-efcb-4295-a0c1-1853700950cc None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.555420 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190e21b-efcb-4295-a0c1-1853700950cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:50.555940 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190e21b-efcb-4295-a0c1-1853700950cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:50.557609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190e21b-efcb-4295-a0c1-1853700950cc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:50.559923 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 317/629] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:50.564981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9873f-eb0a-4a43-859d-d513ee7f6937 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:50.567952 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 313/630] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:45:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:50.574771 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190e21b-efcb-4295-a0c1-1853700950cc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:50.631493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:50.675015 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9873f-eb0a-4a43-859d-d513ee7f6937 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:50.690553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190e21b-efcb-4295-a0c1-1853700950cc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:50.712302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b637-7ee5-441d-876b-d736571d3012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:50.713103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b637-7ee5-441d-876b-d736571d3012 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.713391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b637-7ee5-441d-876b-d736571d3012 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.713671 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b637-7ee5-441d-876b-d736571d3012 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.721607 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97b637-7ee5-441d-876b-d736571d3012 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:50.723165 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97b637-7ee5-441d-876b-d736571d3012 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:50.730969 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e1e9b-b04e-45a3-ab59-ebe7e9998113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:50.732064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1e9b-b04e-45a3-ab59-ebe7e9998113 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.732559 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1e9b-b04e-45a3-ab59-ebe7e9998113 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.733064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1e9b-b04e-45a3-ab59-ebe7e9998113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.738804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-dc97b637-7ee5-441d-876b-d736571d3012 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:45:50.738804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:50.738804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:50.738804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:50.738804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:50.738804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:50.738804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:50.738804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:50.738804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:50.738804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:50.738804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:50.738804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:50.738804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:45:50.738804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:45:50.738804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:45:50.738804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:50.739780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:50.741334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:50.741334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:50.741334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:45:50.741334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:45:50.741334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:45:50.741334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:45:50.741334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:45:50.741334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:45:50.741334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:45:50.741334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:50.741334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 318/631] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Jun 2 15:45:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:50.745686 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b637-7ee5-441d-876b-d736571d3012 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:50.749121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e1e9b-b04e-45a3-ab59-ebe7e9998113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:50.750957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e1e9b-b04e-45a3-ab59-ebe7e9998113 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:50.770332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c76e1e9b-b04e-45a3-ab59-ebe7e9998113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:50.770332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:50.770332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:50.770332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:50.770332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:50.770332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:50.770332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:50.770332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:50.770332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:50.770332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:50.770332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:50.770332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:50.770332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:50.770332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:50.770332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:50.771472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:50.772536 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:50.772536 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:50.772536 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:50.772536 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:50.779158 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 314/632] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:50.780773 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e1e9b-b04e-45a3-ab59-ebe7e9998113 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:50.808409 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:50.860047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b637-7ee5-441d-876b-d736571d3012 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:50.902565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbffe5-c917-48ee-a360-25a5857e82b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:50.903757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbffe5-c917-48ee-a360-25a5857e82b2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.904145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbffe5-c917-48ee-a360-25a5857e82b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.904761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbffe5-c917-48ee-a360-25a5857e82b2 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.905838 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbffe5-c917-48ee-a360-25a5857e82b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:50.906255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbffe5-c917-48ee-a360-25a5857e82b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:50.908356 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbffe5-c917-48ee-a360-25a5857e82b2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:50.909404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e1e9b-b04e-45a3-ab59-ebe7e9998113 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:50.931926 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 319/633] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Jun 2 15:45:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:50.932142 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:50.933787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525533da-097e-4882-a69b-ba4289bdba24 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.934150 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525533da-097e-4882-a69b-ba4289bdba24 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.934502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525533da-097e-4882-a69b-ba4289bdba24 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.939837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 320/634] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:50.939837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525533da-097e-4882-a69b-ba4289bdba24 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:50.961330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f3c13-a250-44a0-845c-261647961ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:50.962400 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f3c13-a250-44a0-845c-261647961ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.962888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f3c13-a250-44a0-845c-261647961ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.963385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f3c13-a250-44a0-845c-261647961ab7 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:50.964864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f3c13-a250-44a0-845c-261647961ab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:50.965677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f3c13-a250-44a0-845c-261647961ab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:50.968107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f3c13-a250-44a0-845c-261647961ab7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:50.986585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 315/635] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:50.987561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa26bcb-504e-4075-b23d-cb1c3d757346 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:50.987862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa26bcb-504e-4075-b23d-cb1c3d757346 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:50.988173 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa26bcb-504e-4075-b23d-cb1c3d757346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.007550 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6aa26bcb-504e-4075-b23d-cb1c3d757346 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:51.008768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6aa26bcb-504e-4075-b23d-cb1c3d757346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:51.064535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525533da-097e-4882-a69b-ba4289bdba24 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.079999 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:51.087527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 316/636] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:51.088669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa26bcb-504e-4075-b23d-cb1c3d757346 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:51.115718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e9a82-62c0-4f48-bac9-5f7b42693a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.117208 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e9a82-62c0-4f48-bac9-5f7b42693a8d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.117914 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e9a82-62c0-4f48-bac9-5f7b42693a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.118327 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e9a82-62c0-4f48-bac9-5f7b42693a8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.210267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e9a82-62c0-4f48-bac9-5f7b42693a8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:51.211818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e9a82-62c0-4f48-bac9-5f7b42693a8d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:51.217304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:51.232115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa26bcb-504e-4075-b23d-cb1c3d757346 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.279664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0cdc3-6256-4728-97c4-eff729bed362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.281157 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0cdc3-6256-4728-97c4-eff729bed362 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.281932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0cdc3-6256-4728-97c4-eff729bed362 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.282871 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0cdc3-6256-4728-97c4-eff729bed362 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.293800 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0cdc3-6256-4728-97c4-eff729bed362 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:51.296459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0cdc3-6256-4728-97c4-eff729bed362 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:51.316069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6ad0cdc3-6256-4728-97c4-eff729bed362 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 15:45:51.316069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:51.316069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:51.316069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:51.316069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:51.316069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:51.316069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:51.316069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:51.316069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:51.316069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:51.316069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:51.316069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:51.316069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:45:51.316069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:45:51.316069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:45:51.316069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:51.317094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:51.318048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:51.318048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:51.318048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:45:51.318048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:45:51.318048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:45:51.318048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:45:51.318048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:45:51.318048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:45:51.318048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 15:45:51.318048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:51.321060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 317/637] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:51.322069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0cdc3-6256-4728-97c4-eff729bed362 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:51.334088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 321/638] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:51.335925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df72140-72fa-4907-821a-6c231dabcbc5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.336619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df72140-72fa-4907-821a-6c231dabcbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.337003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df72140-72fa-4907-821a-6c231dabcbc5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.338870 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 322/639] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:51.340063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df72140-72fa-4907-821a-6c231dabcbc5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:51.355746 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:51.436439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0cdc3-6256-4728-97c4-eff729bed362 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.464156 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df72140-72fa-4907-821a-6c231dabcbc5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.472216 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710223d-3bf6-4af1-a2bf-a3c09c073c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.473004 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710223d-3bf6-4af1-a2bf-a3c09c073c53 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.473293 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710223d-3bf6-4af1-a2bf-a3c09c073c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.473563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710223d-3bf6-4af1-a2bf-a3c09c073c53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.484362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710223d-3bf6-4af1-a2bf-a3c09c073c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:51.493329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6710223d-3bf6-4af1-a2bf-a3c09c073c53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:51.493329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:51.493329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:51.493329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:51.493329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:51.493329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:51.493329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:51.493329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:51.493329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:51.493329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:51.493329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:51.493329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:51.493329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:51.493329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:51.493329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:51.493329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:51.494273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:51.494273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:51.494273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:51.494273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:51.494273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:51.494273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:51.494273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:51.494273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:51.494273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:51.494273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:51.494273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:51.494273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:51.494273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:51.494273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:51.494273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:51.494273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:51.495813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:51.495813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:51.495813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:51.495813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:51.495813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:51.495813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:51.495813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:51.495813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:51.495813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:51.495813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:51.495813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:51.495813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:51.495813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 318/640] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:51.495813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710223d-3bf6-4af1-a2bf-a3c09c073c53 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:51.504779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b46afc-4c15-4e5b-ba8f-be4ca351cb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.505444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b46afc-4c15-4e5b-ba8f-be4ca351cb13 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.505730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b46afc-4c15-4e5b-ba8f-be4ca351cb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.506006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b46afc-4c15-4e5b-ba8f-be4ca351cb13 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.507023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b46afc-4c15-4e5b-ba8f-be4ca351cb13 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:51.507337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b46afc-4c15-4e5b-ba8f-be4ca351cb13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:51.508512 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:51.508847 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b46afc-4c15-4e5b-ba8f-be4ca351cb13 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:51.527818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 323/641] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Jun 2 15:45:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:51.529110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00264d3-6988-4c2f-8ce8-8c87d602b3e7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.529406 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00264d3-6988-4c2f-8ce8-8c87d602b3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.529689 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00264d3-6988-4c2f-8ce8-8c87d602b3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.547352 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b00264d3-6988-4c2f-8ce8-8c87d602b3e7 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:51.548575 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b00264d3-6988-4c2f-8ce8-8c87d602b3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:51.607004 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710223d-3bf6-4af1-a2bf-a3c09c073c53 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.615066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:51.624033 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 324/642] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:51.624033 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00264d3-6988-4c2f-8ce8-8c87d602b3e7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:51.643936 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad11354-79e6-48a6-b0d4-b595c9c2c0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.644764 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad11354-79e6-48a6-b0d4-b595c9c2c0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.645049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad11354-79e6-48a6-b0d4-b595c9c2c0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.645327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad11354-79e6-48a6-b0d4-b595c9c2c0c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.658004 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad11354-79e6-48a6-b0d4-b595c9c2c0c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:51.659506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad11354-79e6-48a6-b0d4-b595c9c2c0c2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:51.678345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4ad11354-79e6-48a6-b0d4-b595c9c2c0c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:51.678345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:51.678345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:51.678345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:51.678345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:51.678345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:51.678345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:51.678345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:51.678345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:51.678345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:51.678345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:51.678345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:51.678345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:51.678345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:51.678345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:51.679948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:51.681497 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:51.681497 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:51.681497 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:51.681497 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:51.681497 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 319/643] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:51.681497 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad11354-79e6-48a6-b0d4-b595c9c2c0c2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:51.744494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00264d3-6988-4c2f-8ce8-8c87d602b3e7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.746405 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:51.787915 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57969f3a-ae3e-4448-b584-562776a729fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.788644 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57969f3a-ae3e-4448-b584-562776a729fa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.788986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57969f3a-ae3e-4448-b584-562776a729fa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.789111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad11354-79e6-48a6-b0d4-b595c9c2c0c2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.789274 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57969f3a-ae3e-4448-b584-562776a729fa None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.790021 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57969f3a-ae3e-4448-b584-562776a729fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:51.790338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57969f3a-ae3e-4448-b584-562776a729fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:51.792148 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57969f3a-ae3e-4448-b584-562776a729fa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:51.804753 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 325/644] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:45:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:51.804753 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57969f3a-ae3e-4448-b584-562776a729fa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:51.829627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16378d-6f99-42eb-ba11-411f69ef9edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.830281 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16378d-6f99-42eb-ba11-411f69ef9edc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.830567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16378d-6f99-42eb-ba11-411f69ef9edc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.830848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16378d-6f99-42eb-ba11-411f69ef9edc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.870197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:51.901656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16378d-6f99-42eb-ba11-411f69ef9edc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:51.903119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16378d-6f99-42eb-ba11-411f69ef9edc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:51.908732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57969f3a-ae3e-4448-b584-562776a729fa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:51.945109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad12920-7781-4ba6-b31b-8e723cd749d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:51.945905 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad12920-7781-4ba6-b31b-8e723cd749d1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:51.946194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad12920-7781-4ba6-b31b-8e723cd749d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:51.946478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad12920-7781-4ba6-b31b-8e723cd749d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:51.957043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad12920-7781-4ba6-b31b-8e723cd749d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:51.964300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:51.965887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3ad12920-7781-4ba6-b31b-8e723cd749d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:51.965887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:51.965887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:51.965887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:51.965887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:51.965887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:51.965887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:51.965887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:51.965887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:51.965887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:51.965887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:51.965887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:51.965887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:51.965887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:51.965887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:51.965887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:51.966994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:51.966994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:51.966994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:51.966994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:51.966994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:51.966994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:51.966994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:51.966994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:51.966994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:51.966994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:51.966994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:51.966994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:51.966994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:51.966994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:51.966994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:51.966994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:51.968365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:51.968365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:51.968365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:51.968365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:51.968365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:51.968365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:51.968365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:51.968365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:51.968365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:51.968365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:51.968365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:51.968365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:51.968365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 326/645] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:51.968365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad12920-7781-4ba6-b31b-8e723cd749d1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:52.011913 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 320/646] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:52.012584 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16378d-6f99-42eb-ba11-411f69ef9edc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:52.083272 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad12920-7781-4ba6-b31b-8e723cd749d1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.107257 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:52.117370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16378d-6f99-42eb-ba11-411f69ef9edc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.122374 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7ade3-f51b-4960-ad0f-89bc2a24cff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:52.123256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7ade3-f51b-4960-ad0f-89bc2a24cff8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.123727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7ade3-f51b-4960-ad0f-89bc2a24cff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.124222 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7ade3-f51b-4960-ad0f-89bc2a24cff8 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.125560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7ade3-f51b-4960-ad0f-89bc2a24cff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:52.126059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7ade3-f51b-4960-ad0f-89bc2a24cff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:52.127956 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7ade3-f51b-4960-ad0f-89bc2a24cff8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:52.142740 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 327/647] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:52.143763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7ade3-f51b-4960-ad0f-89bc2a24cff8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:52.157987 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd5632-1876-43b4-95f6-d0b563a97671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:52.159000 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd5632-1876-43b4-95f6-d0b563a97671 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.159289 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd5632-1876-43b4-95f6-d0b563a97671 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.159580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd5632-1876-43b4-95f6-d0b563a97671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.170859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd5632-1876-43b4-95f6-d0b563a97671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:52.172234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd5632-1876-43b4-95f6-d0b563a97671 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:52.190685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-17dd5632-1876-43b4-95f6-d0b563a97671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:52.190685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:52.190685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:52.190685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:52.190685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:52.190685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:52.190685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:52.190685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:52.190685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:52.190685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:52.190685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:52.190685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:52.190685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:52.190685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:52.190685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:52.191627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:52.192608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:52.192608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:52.192608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:52.192608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:52.192608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 321/648] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:52.192900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd5632-1876-43b4-95f6-d0b563a97671 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:52.212569 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:52.260448 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7ade3-f51b-4960-ad0f-89bc2a24cff8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.296071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f729c-bc1e-4cb8-ba17-8f030ba1fe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:52.296668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f729c-bc1e-4cb8-ba17-8f030ba1fe78 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.296969 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f729c-bc1e-4cb8-ba17-8f030ba1fe78 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.297239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f729c-bc1e-4cb8-ba17-8f030ba1fe78 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.297983 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f729c-bc1e-4cb8-ba17-8f030ba1fe78 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:52.298293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f729c-bc1e-4cb8-ba17-8f030ba1fe78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:52.299669 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f729c-bc1e-4cb8-ba17-8f030ba1fe78 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:52.300063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd5632-1876-43b4-95f6-d0b563a97671 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.308090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 328/649] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:52.308920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f729c-bc1e-4cb8-ba17-8f030ba1fe78 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:52.342321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c587a6e-6e69-4340-a2cf-267731249179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:52.343612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c587a6e-6e69-4340-a2cf-267731249179 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.344287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c587a6e-6e69-4340-a2cf-267731249179 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.344636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c587a6e-6e69-4340-a2cf-267731249179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.356525 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c587a6e-6e69-4340-a2cf-267731249179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:52.358080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c587a6e-6e69-4340-a2cf-267731249179 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:52.358619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:52.379768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6c587a6e-6e69-4340-a2cf-267731249179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:52.379768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:52.379768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:52.379768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:52.379768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:52.379768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:52.379768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:52.379768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:52.379768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:52.379768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:52.379768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:52.379768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:52.379768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:52.379768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:52.379768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:52.380686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:52.381645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:52.381645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:52.381645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:52.381645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:52.381645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 322/650] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:52.381645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c587a6e-6e69-4340-a2cf-267731249179 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:52.433866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f729c-bc1e-4cb8-ba17-8f030ba1fe78 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.453112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:52.472086 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4085ba8-b064-49a3-a339-1c8c7bb03536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:52.472901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4085ba8-b064-49a3-a339-1c8c7bb03536 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.473197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4085ba8-b064-49a3-a339-1c8c7bb03536 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.473483 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4085ba8-b064-49a3-a339-1c8c7bb03536 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.482840 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4085ba8-b064-49a3-a339-1c8c7bb03536 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:52.485144 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4085ba8-b064-49a3-a339-1c8c7bb03536 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:52.491872 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c587a6e-6e69-4340-a2cf-267731249179 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.502408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a4085ba8-b064-49a3-a339-1c8c7bb03536 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:52.502408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:52.502408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:52.502408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:52.502408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:52.502408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:52.502408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:52.502408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:52.502408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:52.502408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:52.502408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:52.502408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:52.502408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:45:52.502408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:45:52.502408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:52.503581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:52.504529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:45:52.504529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:45:52.504529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:45:52.504529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:45:52.504529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:45:52.504529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:45:52.504529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:52.504529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:52.504529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 329/651] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:52.504529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4085ba8-b064-49a3-a339-1c8c7bb03536 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:52.535846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72ac2e-72b4-408f-b1d1-7a9045eedbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:52.536978 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72ac2e-72b4-408f-b1d1-7a9045eedbdf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.537264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72ac2e-72b4-408f-b1d1-7a9045eedbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.537542 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72ac2e-72b4-408f-b1d1-7a9045eedbdf None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.538311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72ac2e-72b4-408f-b1d1-7a9045eedbdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:52.538618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72ac2e-72b4-408f-b1d1-7a9045eedbdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:52.540117 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72ac2e-72b4-408f-b1d1-7a9045eedbdf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:52.556439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 323/652] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:52.556439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72ac2e-72b4-408f-b1d1-7a9045eedbdf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:52.608629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4085ba8-b064-49a3-a339-1c8c7bb03536 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.610893 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:52.644841 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44596bff-e423-43f9-be4e-6f0966da704c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:52.645631 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44596bff-e423-43f9-be4e-6f0966da704c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.645913 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44596bff-e423-43f9-be4e-6f0966da704c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.646189 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44596bff-e423-43f9-be4e-6f0966da704c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.656200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72ac2e-72b4-408f-b1d1-7a9045eedbdf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.657146 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44596bff-e423-43f9-be4e-6f0966da704c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:52.658588 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44596bff-e423-43f9-be4e-6f0966da704c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:52.676047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-44596bff-e423-43f9-be4e-6f0966da704c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:52.676047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:52.676047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:52.676047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:52.676047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:52.676047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:52.676047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:52.676047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:52.676047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:52.676047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:52.676047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:52.676047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:52.676047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:52.676047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:52.676047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:52.677060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:52.679081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:52.679081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:52.679081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:52.679081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:52.679081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 330/653] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:52.679081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44596bff-e423-43f9-be4e-6f0966da704c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:52.687084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:52.696941 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da39918-d4c6-41fd-a18a-0a8829cf0093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:52.700107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da39918-d4c6-41fd-a18a-0a8829cf0093 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.700107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da39918-d4c6-41fd-a18a-0a8829cf0093 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.700107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da39918-d4c6-41fd-a18a-0a8829cf0093 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.700107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da39918-d4c6-41fd-a18a-0a8829cf0093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:52.700107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da39918-d4c6-41fd-a18a-0a8829cf0093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:52.700614 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da39918-d4c6-41fd-a18a-0a8829cf0093 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:52.713156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 324/654] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:52.713964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da39918-d4c6-41fd-a18a-0a8829cf0093 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:52.791848 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44596bff-e423-43f9-be4e-6f0966da704c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.822491 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da39918-d4c6-41fd-a18a-0a8829cf0093 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.829401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724beba-223e-4837-b7d9-1a24018e59e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:52.830065 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724beba-223e-4837-b7d9-1a24018e59e4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.830849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724beba-223e-4837-b7d9-1a24018e59e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.831141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724beba-223e-4837-b7d9-1a24018e59e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.831964 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724beba-223e-4837-b7d9-1a24018e59e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:52.832665 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724beba-223e-4837-b7d9-1a24018e59e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:52.834117 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724beba-223e-4837-b7d9-1a24018e59e4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:52.846395 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 331/655] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:52.847210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724beba-223e-4837-b7d9-1a24018e59e4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:52.856725 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534a018-cba7-4ca0-987f-2adfcdb685b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:52.857523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534a018-cba7-4ca0-987f-2adfcdb685b7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.857810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534a018-cba7-4ca0-987f-2adfcdb685b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.858089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534a018-cba7-4ca0-987f-2adfcdb685b7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.865030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534a018-cba7-4ca0-987f-2adfcdb685b7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:52.865369 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:52.866515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534a018-cba7-4ca0-987f-2adfcdb685b7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:52.881103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b534a018-cba7-4ca0-987f-2adfcdb685b7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 15:45:52.881103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:52.881103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:52.881103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:52.881103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:52.881103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:52.881103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:52.881103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:52.881103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:52.881103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:52.881103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:52.881103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:52.881103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:45:52.881103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:45:52.881103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:45:52.881103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:52.882575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:52.883530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:52.883530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:52.883530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:45:52.883530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:45:52.883530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:45:52.883530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:45:52.883530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:45:52.883530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:45:52.883530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 15:45:52.883530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:52.883530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 325/656] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:52.884763 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534a018-cba7-4ca0-987f-2adfcdb685b7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:52.928853 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:52.946605 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724beba-223e-4837-b7d9-1a24018e59e4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.979407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b94935-5618-4800-a7f0-f7e237b73efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:52.980100 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b94935-5618-4800-a7f0-f7e237b73efc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.980390 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b94935-5618-4800-a7f0-f7e237b73efc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.980544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534a018-cba7-4ca0-987f-2adfcdb685b7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:52.980661 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b94935-5618-4800-a7f0-f7e237b73efc None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.981384 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b94935-5618-4800-a7f0-f7e237b73efc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:52.981699 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b94935-5618-4800-a7f0-f7e237b73efc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:52.983075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b94935-5618-4800-a7f0-f7e237b73efc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:52.994952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 332/657] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:52.996215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1b4fb-68c1-4013-beae-c5971e927670 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:52.996506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1b4fb-68c1-4013-beae-c5971e927670 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:52.996791 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1b4fb-68c1-4013-beae-c5971e927670 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:52.998029 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 333/658] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:53.000773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1b4fb-68c1-4013-beae-c5971e927670 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:53.014448 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6a5b3-1812-44c6-86b7-833e993cebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:53.015298 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6a5b3-1812-44c6-86b7-833e993cebcf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:53.015582 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6a5b3-1812-44c6-86b7-833e993cebcf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:53.015859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6a5b3-1812-44c6-86b7-833e993cebcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:53.022597 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6a5b3-1812-44c6-86b7-833e993cebcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:53.024143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6a5b3-1812-44c6-86b7-833e993cebcf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:53.038626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-56c6a5b3-1812-44c6-86b7-833e993cebcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:53.038626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:53.038626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:53.038626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:53.038626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:53.038626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:53.038626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:53.038626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:53.038626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:53.038626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:53.038626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:53.038626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:53.038626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:45:53.038626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:45:53.038626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:53.043195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:53.044201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:45:53.044201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:45:53.044201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:45:53.044201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:45:53.044201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:45:53.044201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:45:53.044201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:53.044201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:53.044201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 326/659] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:53.044201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6a5b3-1812-44c6-86b7-833e993cebcf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:53.078200 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:53.103874 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1b4fb-68c1-4013-beae-c5971e927670 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:53.138215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcceb7f3-e412-4fe4-a5a4-59fd4ee75ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:53.138858 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcceb7f3-e412-4fe4-a5a4-59fd4ee75ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:53.139141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcceb7f3-e412-4fe4-a5a4-59fd4ee75ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:53.139420 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcceb7f3-e412-4fe4-a5a4-59fd4ee75ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:53.140273 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcceb7f3-e412-4fe4-a5a4-59fd4ee75ae9 None admin] RBAC: Adding query filter params (role.id=740fa9b1529f4a558de5b8987dba5ba3, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=2e53683ae2b34947a1550de269b74d10) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:53.140587 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcceb7f3-e412-4fe4-a5a4-59fd4ee75ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:53.142007 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcceb7f3-e412-4fe4-a5a4-59fd4ee75ae9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:53.143453 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6a5b3-1812-44c6-86b7-833e993cebcf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:53.147924 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 334/660] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:52 2022] GET /identity/v3/role_assignments?user.id=2e53683ae2b34947a1550de269b74d10&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=740fa9b1529f4a558de5b8987dba5ba3 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:53.148723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcceb7f3-e412-4fe4-a5a4-59fd4ee75ae9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:53.151745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:53.184144 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d3648-5dc8-4e20-af85-ed977a765d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:53.184835 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d3648-5dc8-4e20-af85-ed977a765d50 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:53.185119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d3648-5dc8-4e20-af85-ed977a765d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:53.185395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d3648-5dc8-4e20-af85-ed977a765d50 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:53.186244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d3648-5dc8-4e20-af85-ed977a765d50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:53.186558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d3648-5dc8-4e20-af85-ed977a765d50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:53.188049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d3648-5dc8-4e20-af85-ed977a765d50 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:53.208135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 327/661] 10.222.0.50 () {56 vars in 1137 bytes} [Thu Jun 2 15:45:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:53.209507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1412aa2-580d-4122-bdd0-6ad40ca5274f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:53.209856 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1412aa2-580d-4122-bdd0-6ad40ca5274f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:53.210131 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1412aa2-580d-4122-bdd0-6ad40ca5274f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:53.228766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c1412aa2-580d-4122-bdd0-6ad40ca5274f None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:53.230013 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c1412aa2-580d-4122-bdd0-6ad40ca5274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:53.269124 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcceb7f3-e412-4fe4-a5a4-59fd4ee75ae9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:53.309154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 328/662] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:53.310037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1412aa2-580d-4122-bdd0-6ad40ca5274f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:53.323370 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b52304-cb83-499b-b601-464f08321da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:53.324526 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b52304-cb83-499b-b601-464f08321da7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:53.324992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b52304-cb83-499b-b601-464f08321da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:53.325447 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b52304-cb83-499b-b601-464f08321da7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:53.334229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b52304-cb83-499b-b601-464f08321da7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:53.336661 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b52304-cb83-499b-b601-464f08321da7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:53.339929 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:53.353212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f6b52304-cb83-499b-b601-464f08321da7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 15:45:53.353212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:53.353212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:53.353212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:53.353212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:53.353212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:53.353212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:53.353212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:53.353212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:53.353212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:53.353212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:53.353212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:53.353212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:45:53.353212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:45:53.353212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:45:53.353212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:53.354470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:53.355649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:53.355649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:53.355649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:45:53.355649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:45:53.355649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:45:53.355649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:45:53.355649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:45:53.355649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:45:53.355649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 15:45:53.355649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:53.355649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 335/663] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:53.355649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b52304-cb83-499b-b601-464f08321da7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:53.433680 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:53.441538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1412aa2-580d-4122-bdd0-6ad40ca5274f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:53.470249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b52304-cb83-499b-b601-464f08321da7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:53.479122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33b1e4-bcef-45ea-b35d-66585e6ca1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:53.479782 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33b1e4-bcef-45ea-b35d-66585e6ca1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:53.480103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33b1e4-bcef-45ea-b35d-66585e6ca1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:53.480678 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33b1e4-bcef-45ea-b35d-66585e6ca1d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:53.481159 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33b1e4-bcef-45ea-b35d-66585e6ca1d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:53.481468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33b1e4-bcef-45ea-b35d-66585e6ca1d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:53.482888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33b1e4-bcef-45ea-b35d-66585e6ca1d2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:53.495603 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 329/664] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:45:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:53.496364 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33b1e4-bcef-45ea-b35d-66585e6ca1d2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:53.513178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892b96d-e1b2-404a-9a0e-620e7f2cf696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:53.513919 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892b96d-e1b2-404a-9a0e-620e7f2cf696 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:53.514209 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892b96d-e1b2-404a-9a0e-620e7f2cf696 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:53.514485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892b96d-e1b2-404a-9a0e-620e7f2cf696 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:53.582618 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:53.585829 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892b96d-e1b2-404a-9a0e-620e7f2cf696 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:53.587321 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892b96d-e1b2-404a-9a0e-620e7f2cf696 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:53.606510 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33b1e4-bcef-45ea-b35d-66585e6ca1d2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:53.644750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677a558-f15e-4a3d-aa83-6b1ba1285d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:53.645929 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677a558-f15e-4a3d-aa83-6b1ba1285d26 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:53.646473 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677a558-f15e-4a3d-aa83-6b1ba1285d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:53.646928 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677a558-f15e-4a3d-aa83-6b1ba1285d26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:53.657622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677a558-f15e-4a3d-aa83-6b1ba1285d26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:53.666394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3677a558-f15e-4a3d-aa83-6b1ba1285d26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:53.666394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:53.666394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:53.666394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:53.666394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:53.666394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:53.666394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:53.666394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:53.666394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:53.666394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:53.666394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:53.666394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:53.666394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:53.666394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:53.666394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:53.666394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:53.667539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:53.667539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:53.667539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:53.667539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:53.667539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:53.667539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:53.667539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:53.667539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:53.667539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:53.667539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:53.667539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:53.667539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:53.667539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:53.667539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:53.667539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:53.667539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:53.668623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:53.668623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:53.668623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:53.668623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:53.668623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:53.668623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:53.668623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:53.668623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:53.668623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:53.668623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:53.668623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:45:53.668623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:53.675438 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 330/665] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:45:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:53.676514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677a558-f15e-4a3d-aa83-6b1ba1285d26 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:53.690328 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 336/666] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:53.691182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892b96d-e1b2-404a-9a0e-620e7f2cf696 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:53.696560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:53.784779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677a558-f15e-4a3d-aa83-6b1ba1285d26 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:53.800094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:53.806633 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892b96d-e1b2-404a-9a0e-620e7f2cf696 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:53.824651 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbbd89-415a-43ca-ada2-da9354e76431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:53.825329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbbd89-415a-43ca-ada2-da9354e76431 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:53.825675 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbbd89-415a-43ca-ada2-da9354e76431 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:53.825897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbbd89-415a-43ca-ada2-da9354e76431 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:53.826838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbbd89-415a-43ca-ada2-da9354e76431 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:53.827156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbbd89-415a-43ca-ada2-da9354e76431 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:53.828622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbbd89-415a-43ca-ada2-da9354e76431 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:53.844216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a3273-febd-49d6-a2df-9f9ca8f876f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:53.844795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3273-febd-49d6-a2df-9f9ca8f876f5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:53.845081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3273-febd-49d6-a2df-9f9ca8f876f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:53.845360 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3273-febd-49d6-a2df-9f9ca8f876f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:53.846177 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a3273-febd-49d6-a2df-9f9ca8f876f5 None admin] RBAC: Adding query filter params (role.id=740fa9b1529f4a558de5b8987dba5ba3, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=a4c3818af2794f598c21ee4aab4b3a70) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:53.851539 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a3273-febd-49d6-a2df-9f9ca8f876f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:53.851663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 331/667] 10.222.0.50 () {56 vars in 1139 bytes} [Thu Jun 2 15:45:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:53.851663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbbd89-415a-43ca-ada2-da9354e76431 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:53.851804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a3273-febd-49d6-a2df-9f9ca8f876f5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:53.856633 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 337/668] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:53 2022] GET /identity/v3/role_assignments?user.id=a4c3818af2794f598c21ee4aab4b3a70&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=740fa9b1529f4a558de5b8987dba5ba3 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:53.864065 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a3273-febd-49d6-a2df-9f9ca8f876f5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:53.949737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:53.982255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a3273-febd-49d6-a2df-9f9ca8f876f5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:53.997194 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbbd89-415a-43ca-ada2-da9354e76431 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.023964 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd472e-c0a2-4790-bba1-12cc5de136dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.024977 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd472e-c0a2-4790-bba1-12cc5de136dd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.025368 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd472e-c0a2-4790-bba1-12cc5de136dd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.025749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd472e-c0a2-4790-bba1-12cc5de136dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.038021 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd472e-c0a2-4790-bba1-12cc5de136dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:54.043312 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd472e-c0a2-4790-bba1-12cc5de136dd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:54.044872 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e4ba9-6f40-4e93-bddb-1f323d48d74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.045566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e4ba9-6f40-4e93-bddb-1f323d48d74a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.045852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e4ba9-6f40-4e93-bddb-1f323d48d74a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.046133 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e4ba9-6f40-4e93-bddb-1f323d48d74a None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.046892 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e4ba9-6f40-4e93-bddb-1f323d48d74a None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:54.047203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e4ba9-6f40-4e93-bddb-1f323d48d74a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:54.048714 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e4ba9-6f40-4e93-bddb-1f323d48d74a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:54.064411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 332/669] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:45:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:54.065084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b0cd472e-c0a2-4790-bba1-12cc5de136dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:54.065084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:54.065084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:54.065084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:54.065084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:54.065084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:54.065084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:54.065084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:54.065084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:54.065084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:54.065084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:54.065084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:54.065084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:54.065084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:54.065084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:54.065975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:54.066910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:54.066910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:54.066910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:54.066910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:54.067156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e4ba9-6f40-4e93-bddb-1f323d48d74a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.074915 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 338/670] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:54.076637 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd472e-c0a2-4790-bba1-12cc5de136dd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.103290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:54.184359 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e4ba9-6f40-4e93-bddb-1f323d48d74a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.215903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd472e-c0a2-4790-bba1-12cc5de136dd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.219867 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc9269-1c60-466c-bef9-4837e517f364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.220611 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc9269-1c60-466c-bef9-4837e517f364 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.221216 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc9269-1c60-466c-bef9-4837e517f364 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.221767 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc9269-1c60-466c-bef9-4837e517f364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.224746 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:54.262269 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acc808-6fc9-468c-9211-3ddc896a03f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.263347 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acc808-6fc9-468c-9211-3ddc896a03f0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.263789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acc808-6fc9-468c-9211-3ddc896a03f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.264272 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acc808-6fc9-468c-9211-3ddc896a03f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.279455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acc808-6fc9-468c-9211-3ddc896a03f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:54.280952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acc808-6fc9-468c-9211-3ddc896a03f0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:54.300577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c4acc808-6fc9-468c-9211-3ddc896a03f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:54.300577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:54.300577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:54.300577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:54.300577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:54.300577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:54.300577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:54.300577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:54.300577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:54.300577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:54.300577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:54.300577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:54.300577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:54.300577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:54.300577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:54.301558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:54.302464 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:54.302464 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:54.302464 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:54.302464 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:54.304751 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc9269-1c60-466c-bef9-4837e517f364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:54.306438 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc9269-1c60-466c-bef9-4837e517f364 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:54.306550 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 339/671] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:54.307325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acc808-6fc9-468c-9211-3ddc896a03f0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.397140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:54.444607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 333/672] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:54.444607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc9269-1c60-466c-bef9-4837e517f364 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.446390 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acc808-6fc9-468c-9211-3ddc896a03f0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.488964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:54.494647 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c47c01-36b8-44a9-8864-5f363dc9b4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.495506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c47c01-36b8-44a9-8864-5f363dc9b4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.495946 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c47c01-36b8-44a9-8864-5f363dc9b4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.496834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c47c01-36b8-44a9-8864-5f363dc9b4e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.497719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c47c01-36b8-44a9-8864-5f363dc9b4e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:54.498559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c47c01-36b8-44a9-8864-5f363dc9b4e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:54.500725 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c47c01-36b8-44a9-8864-5f363dc9b4e8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:54.519645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 340/673] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:54.521475 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c47c01-36b8-44a9-8864-5f363dc9b4e8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.572654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc9269-1c60-466c-bef9-4837e517f364 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.617009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670059f0-3150-4d5b-b849-d122a0c38e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.617980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670059f0-3150-4d5b-b849-d122a0c38e27 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.618266 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670059f0-3150-4d5b-b849-d122a0c38e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.618541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670059f0-3150-4d5b-b849-d122a0c38e27 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.619255 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670059f0-3150-4d5b-b849-d122a0c38e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:54.619617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670059f0-3150-4d5b-b849-d122a0c38e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:54.620979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670059f0-3150-4d5b-b849-d122a0c38e27 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:54.636966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 334/674] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:54.638457 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670059f0-3150-4d5b-b849-d122a0c38e27 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.656905 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c47c01-36b8-44a9-8864-5f363dc9b4e8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.691388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:54.701714 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab765cfb-5f54-4a57-86e8-9b759cb29a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.702775 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab765cfb-5f54-4a57-86e8-9b759cb29a3b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.702897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab765cfb-5f54-4a57-86e8-9b759cb29a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.703143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab765cfb-5f54-4a57-86e8-9b759cb29a3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.714732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab765cfb-5f54-4a57-86e8-9b759cb29a3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:54.716204 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab765cfb-5f54-4a57-86e8-9b759cb29a3b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:54.734602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ab765cfb-5f54-4a57-86e8-9b759cb29a3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:54.734602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:54.734602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:54.734602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:54.734602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:54.734602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:54.734602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:54.734602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:54.734602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:54.734602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:54.734602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:54.734602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:54.734602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:54.734602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:54.734602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:54.735749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:54.736729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:54.736729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:54.736729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:54.736729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:54.736729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 341/675] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:54.737155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab765cfb-5f54-4a57-86e8-9b759cb29a3b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.753652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:54.761191 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670059f0-3150-4d5b-b849-d122a0c38e27 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.798500 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d134c1-cfa1-4f43-9422-fad3025fc47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.799554 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d134c1-cfa1-4f43-9422-fad3025fc47d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.800045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d134c1-cfa1-4f43-9422-fad3025fc47d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.800477 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d134c1-cfa1-4f43-9422-fad3025fc47d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.807638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d134c1-cfa1-4f43-9422-fad3025fc47d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:54.809304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d134c1-cfa1-4f43-9422-fad3025fc47d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:54.823532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-17d134c1-cfa1-4f43-9422-fad3025fc47d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:54.823532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:54.823532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:54.823532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:54.823532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:54.823532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:54.823532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:54.823532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:54.823532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:54.823532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:54.823532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:54.823532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:54.823532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:45:54.823532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:45:54.823532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:54.824682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:54.825816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:45:54.825816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:45:54.825816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:45:54.825816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:45:54.825816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:45:54.825816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:45:54.825816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:54.825816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:54.828234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 335/676] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:54.829188 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d134c1-cfa1-4f43-9422-fad3025fc47d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.846621 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab765cfb-5f54-4a57-86e8-9b759cb29a3b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.882446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9d193-4c09-416f-ac6b-629776cdf7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.883371 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9d193-4c09-416f-ac6b-629776cdf7ef None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.883492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9d193-4c09-416f-ac6b-629776cdf7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.883714 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9d193-4c09-416f-ac6b-629776cdf7ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.891818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9d193-4c09-416f-ac6b-629776cdf7ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:54.893516 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9d193-4c09-416f-ac6b-629776cdf7ef None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:54.907936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e1d9d193-4c09-416f-ac6b-629776cdf7ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:45:54.907936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:54.907936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:54.907936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:54.907936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:54.907936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:54.907936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:54.907936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:54.907936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:54.907936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:54.907936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:54.907936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:54.907936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:45:54.907936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:45:54.907936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:45:54.907936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:54.909162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:54.910297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:54.910297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:54.910297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:45:54.910297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:45:54.910297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:45:54.910297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:45:54.910297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:45:54.910297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:45:54.910297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:45:54.910297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:54.910297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 342/677] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:54.910901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9d193-4c09-416f-ac6b-629776cdf7ef None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:54.939623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d134c1-cfa1-4f43-9422-fad3025fc47d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:54.954496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:54.975786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561b9b8-5af2-484d-9a1a-65690f8822ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:54.976767 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561b9b8-5af2-484d-9a1a-65690f8822ce None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:54.977207 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561b9b8-5af2-484d-9a1a-65690f8822ce None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:54.977650 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561b9b8-5af2-484d-9a1a-65690f8822ce None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:54.978510 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561b9b8-5af2-484d-9a1a-65690f8822ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:54.978969 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561b9b8-5af2-484d-9a1a-65690f8822ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:54.980564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561b9b8-5af2-484d-9a1a-65690f8822ce None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:54.994200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 336/678] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:54.995330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561b9b8-5af2-484d-9a1a-65690f8822ce None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:55.012325 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:55.015509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9d193-4c09-416f-ac6b-629776cdf7ef None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:55.051463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1b944-3ff9-4c0e-8923-f36d5d124855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:55.052197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1b944-3ff9-4c0e-8923-f36d5d124855 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:55.052485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1b944-3ff9-4c0e-8923-f36d5d124855 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:55.052763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1b944-3ff9-4c0e-8923-f36d5d124855 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:55.053593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1b944-3ff9-4c0e-8923-f36d5d124855 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:55.054403 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1b944-3ff9-4c0e-8923-f36d5d124855 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:55.055923 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1b944-3ff9-4c0e-8923-f36d5d124855 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:55.073262 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 343/679] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:45:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:55.074867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1b944-3ff9-4c0e-8923-f36d5d124855 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:55.106988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561b9b8-5af2-484d-9a1a-65690f8822ce None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:55.144608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a132d-b04a-4246-a9b0-b719d0249a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:55.145636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a132d-b04a-4246-a9b0-b719d0249a46 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:55.146128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a132d-b04a-4246-a9b0-b719d0249a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:55.146611 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a132d-b04a-4246-a9b0-b719d0249a46 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:55.147693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a132d-b04a-4246-a9b0-b719d0249a46 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:55.148252 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a132d-b04a-4246-a9b0-b719d0249a46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:55.149956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a132d-b04a-4246-a9b0-b719d0249a46 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:55.170996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 337/680] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Jun 2 15:45:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:55.172235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a132d-b04a-4246-a9b0-b719d0249a46 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:55.181453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:55.185391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1b944-3ff9-4c0e-8923-f36d5d124855 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:55.222405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32c620-be78-4523-904c-08f3a590db5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:55.223197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c620-be78-4523-904c-08f3a590db5e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:55.223481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c620-be78-4523-904c-08f3a590db5e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:55.223806 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c620-be78-4523-904c-08f3a590db5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:55.231526 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32c620-be78-4523-904c-08f3a590db5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:55.233088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32c620-be78-4523-904c-08f3a590db5e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:55.247651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ac32c620-be78-4523-904c-08f3a590db5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:55.247651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:55.247651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:55.247651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:55.247651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:55.247651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:55.247651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:55.247651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:55.247651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:55.247651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:55.247651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:55.247651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:55.247651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:45:55.247651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:45:55.247651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:55.248659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:55.249698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:45:55.249698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:45:55.249698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:45:55.249698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:45:55.249698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:45:55.249698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:45:55.249698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:55.249698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:55.249698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 344/681] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:55.250224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32c620-be78-4523-904c-08f3a590db5e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:55.257049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:55.290209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a132d-b04a-4246-a9b0-b719d0249a46 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:55.328487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d6fb6-e399-4130-ae3a-9e747ceb9cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:55.329490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d6fb6-e399-4130-ae3a-9e747ceb9cea None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:55.330090 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d6fb6-e399-4130-ae3a-9e747ceb9cea None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:55.330589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d6fb6-e399-4130-ae3a-9e747ceb9cea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:55.331732 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d6fb6-e399-4130-ae3a-9e747ceb9cea None admin] RBAC: Adding query filter params (role.id=740fa9b1529f4a558de5b8987dba5ba3, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=a6a5157588644972a6a4554b3a9f1d76) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:55.332277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d6fb6-e399-4130-ae3a-9e747ceb9cea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:55.334315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d6fb6-e399-4130-ae3a-9e747ceb9cea None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:55.342081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 338/682] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:55 2022] GET /identity/v3/role_assignments?user.id=a6a5157588644972a6a4554b3a9f1d76&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=740fa9b1529f4a558de5b8987dba5ba3 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:55.343123 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d6fb6-e399-4130-ae3a-9e747ceb9cea None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:55.364157 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32c620-be78-4523-904c-08f3a590db5e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:55.437711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21830f-287b-415b-93bf-ac02ca3f93c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:55.438297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21830f-287b-415b-93bf-ac02ca3f93c7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:55.438639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21830f-287b-415b-93bf-ac02ca3f93c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:55.438857 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21830f-287b-415b-93bf-ac02ca3f93c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:55.457932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d6fb6-e399-4130-ae3a-9e747ceb9cea None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:55.493779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:55.498422 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd1a52-6d60-4057-84bc-11ea2dd55ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:55.499507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd1a52-6d60-4057-84bc-11ea2dd55ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:55.500054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd1a52-6d60-4057-84bc-11ea2dd55ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:55.500559 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd1a52-6d60-4057-84bc-11ea2dd55ca9 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:55.501570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd1a52-6d60-4057-84bc-11ea2dd55ca9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:55.502106 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd1a52-6d60-4057-84bc-11ea2dd55ca9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:55.503766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdd1a52-6d60-4057-84bc-11ea2dd55ca9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:55.507127 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:55.519402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 339/683] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:45:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:55.521226 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a4f3d-5f1c-48c7-9059-f0b7a30c6ae4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:55.521729 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a4f3d-5f1c-48c7-9059-f0b7a30c6ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:55.522761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a4f3d-5f1c-48c7-9059-f0b7a30c6ae4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:55.524608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 340/684] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:55.525667 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a4f3d-5f1c-48c7-9059-f0b7a30c6ae4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:55.551878 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21830f-287b-415b-93bf-ac02ca3f93c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:55.553932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21830f-287b-415b-93bf-ac02ca3f93c7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:55.649623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a4f3d-5f1c-48c7-9059-f0b7a30c6ae4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:55.661425 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 345/685] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 15:45:55.662750 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c41e31-bccf-47fe-90f7-7c7cd526f311 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:55.663109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c41e31-bccf-47fe-90f7-7c7cd526f311 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:55.663390 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c41e31-bccf-47fe-90f7-7c7cd526f311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:55.680646 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-23c41e31-bccf-47fe-90f7-7c7cd526f311 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:55.681857 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-23c41e31-bccf-47fe-90f7-7c7cd526f311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:55.695585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ed165-b4a2-44ed-8f52-4c65059cc3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:55.696372 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ed165-b4a2-44ed-8f52-4c65059cc3fa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:55.696804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ed165-b4a2-44ed-8f52-4c65059cc3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:55.697083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ed165-b4a2-44ed-8f52-4c65059cc3fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:55.697913 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ed165-b4a2-44ed-8f52-4c65059cc3fa None admin] RBAC: Adding query filter params (role.id=740fa9b1529f4a558de5b8987dba5ba3, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=c3ec010ab4c5414a8782cecf202fbcfe) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:55.698391 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ed165-b4a2-44ed-8f52-4c65059cc3fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:55.700518 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ed165-b4a2-44ed-8f52-4c65059cc3fa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:55.707564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 341/686] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:55 2022] GET /identity/v3/role_assignments?user.id=c3ec010ab4c5414a8782cecf202fbcfe&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=740fa9b1529f4a558de5b8987dba5ba3 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:55.708413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ed165-b4a2-44ed-8f52-4c65059cc3fa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:55.761807 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:55.775123 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 346/687] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:55.792789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:55.802640 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c41e31-bccf-47fe-90f7-7c7cd526f311 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:55.850253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ed165-b4a2-44ed-8f52-4c65059cc3fa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:55.898882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443212d-7c76-4dc8-890d-564886ce10f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:55.900632 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443212d-7c76-4dc8-890d-564886ce10f8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:55.901136 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443212d-7c76-4dc8-890d-564886ce10f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:55.901624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443212d-7c76-4dc8-890d-564886ce10f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:55.917767 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443212d-7c76-4dc8-890d-564886ce10f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:55.920510 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443212d-7c76-4dc8-890d-564886ce10f8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:55.932343 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c41e31-bccf-47fe-90f7-7c7cd526f311 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:55.945356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3443212d-7c76-4dc8-890d-564886ce10f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:55.945356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:55.945356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:55.945356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:55.945356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:55.945356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:55.945356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:55.945356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:55.945356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:55.945356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:55.945356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:55.945356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:55.945356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:55.945356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:55.945356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:55.946384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:55.947310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:55.947310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:55.947310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:55.947310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:55.952277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 342/688] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:55.957293 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443212d-7c76-4dc8-890d-564886ce10f8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:55.987266 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afebba5-edbf-41be-b4bc-bac2fce5b3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:55.989221 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afebba5-edbf-41be-b4bc-bac2fce5b3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:55.989750 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afebba5-edbf-41be-b4bc-bac2fce5b3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:55.990037 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afebba5-edbf-41be-b4bc-bac2fce5b3d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:56.005196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afebba5-edbf-41be-b4bc-bac2fce5b3d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:45:56.015773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9afebba5-edbf-41be-b4bc-bac2fce5b3d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:56.015773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:56.015773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:56.015773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:56.015773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:56.015773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:56.015773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:56.015773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:56.015773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:56.015773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:56.015773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:56.015773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:56.015773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:45:56.015773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:45:56.015773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:45:56.015773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:45:56.016788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:45:56.016788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:45:56.016788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:45:56.016788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:45:56.016788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:56.016788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:56.016788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:56.016788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:56.016788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:56.016788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:56.016788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:56.016788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:56.016788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:56.016788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:56.016788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:56.016788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:56.017655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:56.017655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:56.017655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:56.017655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:56.017655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:45:56.017655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:45:56.017655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:45:56.017655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:45:56.017655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:45:56.017655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:45:56.017655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:45:56.017655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:56.018312 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 347/689] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:45:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:56.024579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afebba5-edbf-41be-b4bc-bac2fce5b3d4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:56.084361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443212d-7c76-4dc8-890d-564886ce10f8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:56.095398 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:56.102250 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:56.125953 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71043dd9-53f7-417b-b7d6-c8b9bd31c84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:56.126631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71043dd9-53f7-417b-b7d6-c8b9bd31c84d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:56.126986 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71043dd9-53f7-417b-b7d6-c8b9bd31c84d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:56.127231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71043dd9-53f7-417b-b7d6-c8b9bd31c84d None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:56.127963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71043dd9-53f7-417b-b7d6-c8b9bd31c84d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:56.128345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71043dd9-53f7-417b-b7d6-c8b9bd31c84d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:56.129780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71043dd9-53f7-417b-b7d6-c8b9bd31c84d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:56.146777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 343/690] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:56.154325 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71043dd9-53f7-417b-b7d6-c8b9bd31c84d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:56.179248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afebba5-edbf-41be-b4bc-bac2fce5b3d4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:56.224158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8210e9b-4c6f-40ea-94b5-1b59e8fd81f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:56.224782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210e9b-4c6f-40ea-94b5-1b59e8fd81f5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:56.225054 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210e9b-4c6f-40ea-94b5-1b59e8fd81f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:56.228010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210e9b-4c6f-40ea-94b5-1b59e8fd81f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:56.228010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8210e9b-4c6f-40ea-94b5-1b59e8fd81f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:56.228010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8210e9b-4c6f-40ea-94b5-1b59e8fd81f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:56.228010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8210e9b-4c6f-40ea-94b5-1b59e8fd81f5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:56.254346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 348/691] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:45:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:56.259721 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8210e9b-4c6f-40ea-94b5-1b59e8fd81f5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:56.379660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8210e9b-4c6f-40ea-94b5-1b59e8fd81f5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:56.386616 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71043dd9-53f7-417b-b7d6-c8b9bd31c84d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:56.397134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:56.423211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bfc4a-4937-4503-816b-7c1131370c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:56.424049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bfc4a-4937-4503-816b-7c1131370c85 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:56.424347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bfc4a-4937-4503-816b-7c1131370c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:56.424630 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bfc4a-4937-4503-816b-7c1131370c85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:56.425793 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32aed18-e896-4ede-a974-c5ce5a4e0fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:56.427063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32aed18-e896-4ede-a974-c5ce5a4e0fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:56.427940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32aed18-e896-4ede-a974-c5ce5a4e0fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:56.428986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32aed18-e896-4ede-a974-c5ce5a4e0fd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:56.432709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bfc4a-4937-4503-816b-7c1131370c85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:56.434167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bfc4a-4937-4503-816b-7c1131370c85 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:56.441964 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32aed18-e896-4ede-a974-c5ce5a4e0fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:56.444681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32aed18-e896-4ede-a974-c5ce5a4e0fd0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:56.450091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-714bfc4a-4937-4503-816b-7c1131370c85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:56.450091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:56.450091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:56.450091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:56.450091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:56.450091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:56.450091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:56.450091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:56.450091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:56.450091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:56.450091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:56.450091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:56.450091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:45:56.450091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:45:56.450091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:56.451078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:56.452019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:45:56.452019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:45:56.452019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:45:56.452019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:45:56.452019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:45:56.452019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:45:56.452019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:56.452019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:56.452019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 344/692] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:56.452881 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67580c5f-47f1-4541-8ce0-9950e3d72aaf None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:56.453114 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67580c5f-47f1-4541-8ce0-9950e3d72aaf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:56.453388 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67580c5f-47f1-4541-8ce0-9950e3d72aaf None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:56.458773 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 345/693] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:56.459559 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67580c5f-47f1-4541-8ce0-9950e3d72aaf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:56.469103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a32aed18-e896-4ede-a974-c5ce5a4e0fd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:56.469103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:56.469103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:56.469103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:56.469103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:56.469103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:56.469103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:56.469103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:56.469103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:56.469103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:56.469103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:56.469103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:56.469103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:56.469103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:56.469103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:56.470047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:56.470968 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:56.470968 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:56.470968 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:56.470968 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:56.473810 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 349/694] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:56.475830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887970a3-5337-4e49-95d4-8409aff7ccfd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:56.476603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887970a3-5337-4e49-95d4-8409aff7ccfd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:56.477041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887970a3-5337-4e49-95d4-8409aff7ccfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:56.497041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:56.500734 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-887970a3-5337-4e49-95d4-8409aff7ccfd None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:56.503077 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-887970a3-5337-4e49-95d4-8409aff7ccfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:56.585781 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67580c5f-47f1-4541-8ce0-9950e3d72aaf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:56.586565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 350/695] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:45:56.587524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887970a3-5337-4e49-95d4-8409aff7ccfd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:56.645009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7892c7e-38a8-421a-8523-35dc7fc08a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:56.645674 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7892c7e-38a8-421a-8523-35dc7fc08a6b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:56.645961 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7892c7e-38a8-421a-8523-35dc7fc08a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:56.646241 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7892c7e-38a8-421a-8523-35dc7fc08a6b None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:56.647027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7892c7e-38a8-421a-8523-35dc7fc08a6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:56.647395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7892c7e-38a8-421a-8523-35dc7fc08a6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:56.648915 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7892c7e-38a8-421a-8523-35dc7fc08a6b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:56.661437 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 346/696] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:45:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:56.662340 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7892c7e-38a8-421a-8523-35dc7fc08a6b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:56.712933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:56.719749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887970a3-5337-4e49-95d4-8409aff7ccfd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:56.755297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86884c51-bf86-4e9c-98b7-0e591ead470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:56.755880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884c51-bf86-4e9c-98b7-0e591ead470c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:56.756212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884c51-bf86-4e9c-98b7-0e591ead470c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:56.756491 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884c51-bf86-4e9c-98b7-0e591ead470c None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:56.757909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86884c51-bf86-4e9c-98b7-0e591ead470c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:56.758576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86884c51-bf86-4e9c-98b7-0e591ead470c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:56.760296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86884c51-bf86-4e9c-98b7-0e591ead470c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:56.776572 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:56.777667 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 351/697] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:56.778553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86884c51-bf86-4e9c-98b7-0e591ead470c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:56.788598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7892c7e-38a8-421a-8523-35dc7fc08a6b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:56.824665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6f05c-c4c3-4c1b-928b-152d3325ffb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:56.825078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6f05c-c4c3-4c1b-928b-152d3325ffb6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:56.825524 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6f05c-c4c3-4c1b-928b-152d3325ffb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:56.825899 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6f05c-c4c3-4c1b-928b-152d3325ffb6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:56.826652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6f05c-c4c3-4c1b-928b-152d3325ffb6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:56.828177 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6f05c-c4c3-4c1b-928b-152d3325ffb6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:56.842462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-02b6f05c-c4c3-4c1b-928b-152d3325ffb6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:45:56.842462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:56.842462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:45:56.842462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:45:56.842462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:45:56.842462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:45:56.842462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:45:56.842462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:45:56.842462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:45:56.842462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:56.842462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:45:56.842462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:56.842462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:56.842462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:56.842462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:56.842462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:56.843689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:56.843689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:56.843689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:56.843689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:56.843689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:56.843689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:56.843689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:56.843689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:45:56.843689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:45:56.843689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:45:56.843689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:45:56.843689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:56.843689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:56.843689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:56.843689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:56.843689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:56.844810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:56.844810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:56.844810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:56.844810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:56.844810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:56.844810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:56.844810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:56.844810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:56.844810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:56.844810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:56.844810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:56.844810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:45:56.844810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:45:56.844810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:45:56.844810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:56.851265 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 347/698] 10.222.0.50 () {56 vars in 1129 bytes} [Thu Jun 2 15:45:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:56.851265 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6f05c-c4c3-4c1b-928b-152d3325ffb6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:56.916536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86884c51-bf86-4e9c-98b7-0e591ead470c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:56.952421 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6f05c-c4c3-4c1b-928b-152d3325ffb6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:56.964657 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba9935-4c9b-493d-9bfc-3e235b676942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:56.966113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba9935-4c9b-493d-9bfc-3e235b676942 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:56.966875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba9935-4c9b-493d-9bfc-3e235b676942 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:56.967330 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba9935-4c9b-493d-9bfc-3e235b676942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:56.968633 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba9935-4c9b-493d-9bfc-3e235b676942 None admin] RBAC: Adding query filter params (role.id=740fa9b1529f4a558de5b8987dba5ba3, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=02eade9a475b4002bd3990f08f8a1198) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:56.969110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba9935-4c9b-493d-9bfc-3e235b676942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:56.971557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba9935-4c9b-493d-9bfc-3e235b676942 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:56.981314 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 352/699] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:56 2022] GET /identity/v3/role_assignments?user.id=02eade9a475b4002bd3990f08f8a1198&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=740fa9b1529f4a558de5b8987dba5ba3 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:56.982391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba9935-4c9b-493d-9bfc-3e235b676942 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:56.993263 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64549d69-416a-45a5-8703-07b329ce815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:56.994268 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64549d69-416a-45a5-8703-07b329ce815e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:56.994655 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64549d69-416a-45a5-8703-07b329ce815e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:56.995116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64549d69-416a-45a5-8703-07b329ce815e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:57.004617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64549d69-416a-45a5-8703-07b329ce815e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:57.005926 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64549d69-416a-45a5-8703-07b329ce815e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:57.009723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:57.023636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-64549d69-416a-45a5-8703-07b329ce815e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:45:57.023636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:57.023636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:57.023636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:57.023636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:57.023636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:57.023636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:57.023636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:57.023636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:57.023636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:57.023636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:57.023636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:57.023636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:45:57.023636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:45:57.023636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:45:57.023636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:57.027218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:57.028351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:57.028351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:57.028351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:45:57.028351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:45:57.028351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:45:57.028351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:45:57.028351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:45:57.028351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:45:57.028351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:45:57.028351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:57.028351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 348/700] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Jun 2 15:45:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:57.032154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64549d69-416a-45a5-8703-07b329ce815e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:57.054837 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:57.130060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba9935-4c9b-493d-9bfc-3e235b676942 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:57.143878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64549d69-416a-45a5-8703-07b329ce815e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:57.182199 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a975e7d-f1f2-460c-bd5e-28e5bc6f243a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:57.183406 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a975e7d-f1f2-460c-bd5e-28e5bc6f243a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:57.183857 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a975e7d-f1f2-460c-bd5e-28e5bc6f243a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:57.184245 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d250d3-a473-40a5-9ed4-fe3f403a3517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:57.184537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a975e7d-f1f2-460c-bd5e-28e5bc6f243a None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:57.185284 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d250d3-a473-40a5-9ed4-fe3f403a3517 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:57.185604 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a975e7d-f1f2-460c-bd5e-28e5bc6f243a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:57.185719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d250d3-a473-40a5-9ed4-fe3f403a3517 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:57.186107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d250d3-a473-40a5-9ed4-fe3f403a3517 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:57.186403 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a975e7d-f1f2-460c-bd5e-28e5bc6f243a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:57.187154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d250d3-a473-40a5-9ed4-fe3f403a3517 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:57.187566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d250d3-a473-40a5-9ed4-fe3f403a3517 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:57.188315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a975e7d-f1f2-460c-bd5e-28e5bc6f243a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:57.189218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d250d3-a473-40a5-9ed4-fe3f403a3517 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:57.195500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 353/701] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Jun 2 15:45:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:57.202828 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a975e7d-f1f2-460c-bd5e-28e5bc6f243a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:57.212633 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 349/702] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Jun 2 15:45:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:57.218088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d250d3-a473-40a5-9ed4-fe3f403a3517 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:57.307003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:57.318784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:57.326658 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a975e7d-f1f2-460c-bd5e-28e5bc6f243a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:57.354681 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d250d3-a473-40a5-9ed4-fe3f403a3517 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:57.368114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b225b-b7f5-489f-bcfb-ea3d99e9df8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:57.368954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b225b-b7f5-489f-bcfb-ea3d99e9df8b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:57.369340 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b225b-b7f5-489f-bcfb-ea3d99e9df8b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:57.370161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b225b-b7f5-489f-bcfb-ea3d99e9df8b None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:57.370654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b225b-b7f5-489f-bcfb-ea3d99e9df8b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:57.371137 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b225b-b7f5-489f-bcfb-ea3d99e9df8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:57.372652 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b225b-b7f5-489f-bcfb-ea3d99e9df8b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:57.379016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 354/703] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Jun 2 15:45:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:57.396461 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9c6f4-340b-4e68-93d1-2183ccedb344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:57.397362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9c6f4-340b-4e68-93d1-2183ccedb344 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:57.397653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9c6f4-340b-4e68-93d1-2183ccedb344 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:57.397935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9c6f4-340b-4e68-93d1-2183ccedb344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:57.476620 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9c6f4-340b-4e68-93d1-2183ccedb344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:57.478124 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9c6f4-340b-4e68-93d1-2183ccedb344 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:57.560094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:57.587599 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 350/704] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:45:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 15:45:57.593213 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b225b-b7f5-489f-bcfb-ea3d99e9df8b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:57.706039 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b225b-b7f5-489f-bcfb-ea3d99e9df8b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:57.741598 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe008f-7c46-47d1-bb28-a3bbe9207c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:57.743003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe008f-7c46-47d1-bb28-a3bbe9207c1f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:57.743485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe008f-7c46-47d1-bb28-a3bbe9207c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:57.743942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe008f-7c46-47d1-bb28-a3bbe9207c1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:57.755535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe008f-7c46-47d1-bb28-a3bbe9207c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:57.757367 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe008f-7c46-47d1-bb28-a3bbe9207c1f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:57.764782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:57.777639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-93fe008f-7c46-47d1-bb28-a3bbe9207c1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:57.777639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:57.777639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:57.777639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:57.777639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:57.777639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:57.777639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:57.777639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:57.777639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:57.777639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:57.777639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:57.777639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:57.777639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:57.777639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:57.777639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:57.780500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:57.781451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:57.781451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:57.781451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:57.781451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:57.781451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 355/705] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:57.784711 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9c6f4-340b-4e68-93d1-2183ccedb344 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:57.929208 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9c6f4-340b-4e68-93d1-2183ccedb344 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:57.971406 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbe7d9-804d-42df-a25d-92b6bbff4c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:57.972122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbe7d9-804d-42df-a25d-92b6bbff4c34 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:57.972412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbe7d9-804d-42df-a25d-92b6bbff4c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:57.972693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbe7d9-804d-42df-a25d-92b6bbff4c34 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:57.973419 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbe7d9-804d-42df-a25d-92b6bbff4c34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:57.973725 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbe7d9-804d-42df-a25d-92b6bbff4c34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:57.975103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbe7d9-804d-42df-a25d-92b6bbff4c34 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:57.990463 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 351/706] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:57.996659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe008f-7c46-47d1-bb28-a3bbe9207c1f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:58.127331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe008f-7c46-47d1-bb28-a3bbe9207c1f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:58.172763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d4320-5788-485a-bec6-d4783f31e118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:58.173590 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d4320-5788-485a-bec6-d4783f31e118 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.173874 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d4320-5788-485a-bec6-d4783f31e118 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.174178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d4320-5788-485a-bec6-d4783f31e118 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.182469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d4320-5788-485a-bec6-d4783f31e118 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:58.183888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d4320-5788-485a-bec6-d4783f31e118 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:58.211350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6b5d4320-5788-485a-bec6-d4783f31e118 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:58.211350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:58.211350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:58.211350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:58.211350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:58.211350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:58.211350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:58.211350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:58.211350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:58.211350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:58.211350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:58.211350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:58.211350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:45:58.211350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:45:58.211350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:58.215140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:58.216168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:45:58.216168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:45:58.216168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:45:58.216168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:45:58.216168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:45:58.216168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:45:58.216168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:45:58.216168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:58.216168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 356/707] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:45:58.227005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbe7d9-804d-42df-a25d-92b6bbff4c34 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:58.264426 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1947b-47fb-4b0f-a620-3e8b8e428dd0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.264787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1947b-47fb-4b0f-a620-3e8b8e428dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.264997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1947b-47fb-4b0f-a620-3e8b8e428dd0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.266650 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 357/708] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:58.279430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:58.282586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f442f-c36f-4556-bb28-bc92c8bf1bcf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.282886 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f442f-c36f-4556-bb28-bc92c8bf1bcf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.283170 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f442f-c36f-4556-bb28-bc92c8bf1bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.316989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-146f442f-c36f-4556-bb28-bc92c8bf1bcf None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:58.320915 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-146f442f-c36f-4556-bb28-bc92c8bf1bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:58.407870 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbe7d9-804d-42df-a25d-92b6bbff4c34 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:58.427800 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:58.457256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 358/709] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:58.472345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b7d3d-4e8c-45a9-9e61-867f49abb795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:58.473022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b7d3d-4e8c-45a9-9e61-867f49abb795 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.473307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b7d3d-4e8c-45a9-9e61-867f49abb795 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.473587 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b7d3d-4e8c-45a9-9e61-867f49abb795 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.474371 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b7d3d-4e8c-45a9-9e61-867f49abb795 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:58.474685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b7d3d-4e8c-45a9-9e61-867f49abb795 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:58.476201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b7d3d-4e8c-45a9-9e61-867f49abb795 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:58.484840 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f442f-c36f-4556-bb28-bc92c8bf1bcf None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:58.507428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 352/710] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:45:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:58.507428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b7d3d-4e8c-45a9-9e61-867f49abb795 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:58.635655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f442f-c36f-4556-bb28-bc92c8bf1bcf None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:58.649724 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:58.656643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b7d3d-4e8c-45a9-9e61-867f49abb795 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:58.682144 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f183f8-c15d-454d-81e2-2bd4016c5fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:58.683585 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f183f8-c15d-454d-81e2-2bd4016c5fea None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.685162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f183f8-c15d-454d-81e2-2bd4016c5fea None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.685162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f183f8-c15d-454d-81e2-2bd4016c5fea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.690421 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5a807-c9ed-4fdc-9693-f57c1742fb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:58.691169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5a807-c9ed-4fdc-9693-f57c1742fb9f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.691454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5a807-c9ed-4fdc-9693-f57c1742fb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.691734 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5a807-c9ed-4fdc-9693-f57c1742fb9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.692636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5a807-c9ed-4fdc-9693-f57c1742fb9f None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=2e53683ae2b34947a1550de269b74d10) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:58.692949 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5a807-c9ed-4fdc-9693-f57c1742fb9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:58.694554 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5a807-c9ed-4fdc-9693-f57c1742fb9f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:58.697950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f183f8-c15d-454d-81e2-2bd4016c5fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:58.699790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f183f8-c15d-454d-81e2-2bd4016c5fea None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:58.700243 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 353/711] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:45:58 2022] GET /identity/v3/role_assignments?user.id=2e53683ae2b34947a1550de269b74d10&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:58.701676 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e097a66-b6cf-4431-9ada-136ae8de6ce7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.701967 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e097a66-b6cf-4431-9ada-136ae8de6ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.702246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e097a66-b6cf-4431-9ada-136ae8de6ce7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.708019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 354/712] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:45:58.710144 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8709d50-2572-4f43-a5ce-b7f584825b63 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:58.712377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8709d50-2572-4f43-a5ce-b7f584825b63 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:58.712564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8709d50-2572-4f43-a5ce-b7f584825b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:58.729167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-67f183f8-c15d-454d-81e2-2bd4016c5fea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:58.729167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:58.729167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:58.729167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:58.729167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:58.729167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:58.729167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:58.729167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:58.729167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:58.729167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:58.729167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:58.729167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:58.729167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:45:58.729167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:45:58.729167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:58.730229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:58.731222 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:45:58.731222 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:45:58.731222 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:45:58.731222 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:45:58.731222 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 359/713] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:58.736532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f183f8-c15d-454d-81e2-2bd4016c5fea None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:58.737806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b8709d50-2572-4f43-a5ce-b7f584825b63 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:45:58.739492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b8709d50-2572-4f43-a5ce-b7f584825b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:45:58.833130 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 355/714] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:45:58.843952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:58.888921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8709d50-2572-4f43-a5ce-b7f584825b63 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:58.950491 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f183f8-c15d-454d-81e2-2bd4016c5fea None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:59.009327 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408a588-fa47-4aef-8ec4-41685dee45e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:59.010426 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408a588-fa47-4aef-8ec4-41685dee45e2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:59.011016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408a588-fa47-4aef-8ec4-41685dee45e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:59.011502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408a588-fa47-4aef-8ec4-41685dee45e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:59.012531 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408a588-fa47-4aef-8ec4-41685dee45e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:59.013050 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408a588-fa47-4aef-8ec4-41685dee45e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:59.014662 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408a588-fa47-4aef-8ec4-41685dee45e2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:59.015634 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:59.042059 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8709d50-2572-4f43-a5ce-b7f584825b63 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:59.043605 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 360/715] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:45:59.049095 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408a588-fa47-4aef-8ec4-41685dee45e2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:59.093953 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3272623-b6cc-422b-9d03-9eb5539f6778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:59.096005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3272623-b6cc-422b-9d03-9eb5539f6778 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:59.097172 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3272623-b6cc-422b-9d03-9eb5539f6778 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:59.097817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3272623-b6cc-422b-9d03-9eb5539f6778 None admin] PATH_INFO: `/v3/services/network` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:59.099760 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3272623-b6cc-422b-9d03-9eb5539f6778 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:59.102647 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3272623-b6cc-422b-9d03-9eb5539f6778 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b3272623-b6cc-422b-9d03-9eb5539f6778 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:45:59.127927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:45:59.128976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:45:59.128976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:45:59.128976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:45:59.128976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:45:59.128976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:45:59.128976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:45:59.128976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:45:59.128976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:45:59.128976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:45:59.128976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:45:59.128976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:45:59.128976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:45:59.128976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:45:59.128976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:45:59.128976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:45:59.128976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:45:59.129832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:45:59.129832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:45:59.129832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:45:59.129832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:45:59.129832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:45:59.129832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:45:59.129832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:45:59.129832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:45:59.129832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:45:59.129832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:45:59.129832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:45:59.129832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:45:59.129832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:45:59.129832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:45:59.132776 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 356/716] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:45:58 2022] GET /identity/v3/services/network => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:45:59.141140 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3272623-b6cc-422b-9d03-9eb5539f6778 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:59.195805 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:45:59.199248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408a588-fa47-4aef-8ec4-41685dee45e2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:59.238053 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a5674-5732-4369-8578-2ac328b841c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:59.238785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a5674-5732-4369-8578-2ac328b841c5 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:59.239079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a5674-5732-4369-8578-2ac328b841c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:59.239417 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a5674-5732-4369-8578-2ac328b841c5 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:59.240154 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a5674-5732-4369-8578-2ac328b841c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:59.242705 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a5674-5732-4369-8578-2ac328b841c5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:59.304418 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3272623-b6cc-422b-9d03-9eb5539f6778 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:59.337062 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 361/717] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:45:59 2022] POST /identity/v3/users => generated 254 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:45:59.348253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed268494-b2cc-4042-a506-663306670b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:59.348938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed268494-b2cc-4042-a506-663306670b9c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:59.349222 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed268494-b2cc-4042-a506-663306670b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:59.349501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed268494-b2cc-4042-a506-663306670b9c None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:59.350541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed268494-b2cc-4042-a506-663306670b9c None admin] RBAC: Adding query filter params (name=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:59.350851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed268494-b2cc-4042-a506-663306670b9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:59.352277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed268494-b2cc-4042-a506-663306670b9c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:59.358359 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 357/718] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Jun 2 15:45:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:45:59.363923 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a5674-5732-4369-8578-2ac328b841c5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:45:59.507626 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a5674-5732-4369-8578-2ac328b841c5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:45:59.556266 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96b873-e3f0-4470-ac9f-e7f990305df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:45:59.556884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96b873-e3f0-4470-ac9f-e7f990305df6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:45:59.557173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96b873-e3f0-4470-ac9f-e7f990305df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:45:59.557454 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96b873-e3f0-4470-ac9f-e7f990305df6 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:45:59.558178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96b873-e3f0-4470-ac9f-e7f990305df6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:45:59.558490 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96b873-e3f0-4470-ac9f-e7f990305df6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:45:59.559959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96b873-e3f0-4470-ac9f-e7f990305df6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:45:59.568223 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 362/719] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Jun 2 15:45:59 2022] GET /identity/v3/services?type=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:00.171617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856d234-4603-4d0d-b45d-9987d54e964f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.172196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856d234-4603-4d0d-b45d-9987d54e964f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.172196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856d234-4603-4d0d-b45d-9987d54e964f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.173957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 358/720] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:00.179836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfc966-cad4-4e95-baef-71b698e52ef3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.180162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfc966-cad4-4e95-baef-71b698e52ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.180433 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddfc966-cad4-4e95-baef-71b698e52ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.201518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cddfc966-cad4-4e95-baef-71b698e52ef3 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:00.204603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cddfc966-cad4-4e95-baef-71b698e52ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:00.218510 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3135db0-35b0-4ea3-9f4f-a07f5d56c6f3 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.218839 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3135db0-35b0-4ea3-9f4f-a07f5d56c6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.219096 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3135db0-35b0-4ea3-9f4f-a07f5d56c6f3 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.220761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 359/721] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:00.227728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1e6e-fe49-4a83-aa7a-c2ca970ae033 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.228047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1e6e-fe49-4a83-aa7a-c2ca970ae033 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.228344 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1e6e-fe49-4a83-aa7a-c2ca970ae033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.230864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:00.265055 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-db3f1e6e-fe49-4a83-aa7a-c2ca970ae033 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:00.266282 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-db3f1e6e-fe49-4a83-aa7a-c2ca970ae033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:00.283442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:00.289587 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 363/722] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:00.337428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfc966-cad4-4e95-baef-71b698e52ef3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:00.344335 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 360/723] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:46:00.366273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f1e6e-fe49-4a83-aa7a-c2ca970ae033 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:00.500031 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddfc966-cad4-4e95-baef-71b698e52ef3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:00.553097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f1e6e-fe49-4a83-aa7a-c2ca970ae033 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:00.566822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c15bd7-32ff-4bd7-9840-4a461c29f96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:00.567906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c15bd7-32ff-4bd7-9840-4a461c29f96e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.568401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c15bd7-32ff-4bd7-9840-4a461c29f96e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.568886 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c15bd7-32ff-4bd7-9840-4a461c29f96e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.587098 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c15bd7-32ff-4bd7-9840-4a461c29f96e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:00.595951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a3c15bd7-32ff-4bd7-9840-4a461c29f96e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:00.595951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:00.595951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:00.595951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:00.595951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:00.595951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:00.595951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:00.595951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:00.595951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:00.595951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:00.595951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:00.595951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:00.595951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:00.595951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:00.595951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:00.595951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:00.596901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:00.596901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:00.596901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:00.596901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:00.596901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:00.596901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:00.596901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:00.596901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:00.596901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:00.596901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:00.596901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:00.596901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:00.596901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:00.596901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:00.596901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:00.596901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:00.597772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:00.597772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:00.597772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:00.597772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:00.597772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:00.597772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:00.597772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:00.597772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:00.597772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:00.597772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:00.597772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:00.597772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:00.608161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 364/724] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:00.612723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c15bd7-32ff-4bd7-9840-4a461c29f96e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:00.626812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e08251-574f-4edb-9b48-6b8c7ab8c910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:00.627728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e08251-574f-4edb-9b48-6b8c7ab8c910 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.628203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e08251-574f-4edb-9b48-6b8c7ab8c910 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.628633 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e08251-574f-4edb-9b48-6b8c7ab8c910 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.629507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e08251-574f-4edb-9b48-6b8c7ab8c910 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:00.631049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e08251-574f-4edb-9b48-6b8c7ab8c910 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:00.639677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:00.732413 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c15bd7-32ff-4bd7-9840-4a461c29f96e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:00.745859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 361/725] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Jun 2 15:46:00 2022] POST /identity/v3/services => generated 251 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:00.793531 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bb64e-5342-4177-826e-1bf90bbef062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:00.794475 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bb64e-5342-4177-826e-1bf90bbef062 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.794922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bb64e-5342-4177-826e-1bf90bbef062 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.795344 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bb64e-5342-4177-826e-1bf90bbef062 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.796267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bb64e-5342-4177-826e-1bf90bbef062 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:00.796723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bb64e-5342-4177-826e-1bf90bbef062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:00.798251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bb64e-5342-4177-826e-1bf90bbef062 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:00.812110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 365/726] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:00.817195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e08251-574f-4edb-9b48-6b8c7ab8c910 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:00.833473 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:00.944079 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e08251-574f-4edb-9b48-6b8c7ab8c910 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:00.980594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476372aa-c5ed-4e88-a843-edd10b24e146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:00.981419 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476372aa-c5ed-4e88-a843-edd10b24e146 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:00.981708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476372aa-c5ed-4e88-a843-edd10b24e146 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:00.981990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476372aa-c5ed-4e88-a843-edd10b24e146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:00.993992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476372aa-c5ed-4e88-a843-edd10b24e146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:00.995497 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476372aa-c5ed-4e88-a843-edd10b24e146 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:01.014185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-476372aa-c5ed-4e88-a843-edd10b24e146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:01.014185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:01.014185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:01.014185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:01.014185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:01.014185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:01.014185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:01.014185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:01.014185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:01.014185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:01.014185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:01.014185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:01.014185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:01.014185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:01.014185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:01.015171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:01.016109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:01.016109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:01.016109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:01.016109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:01.016109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 362/727] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:01.021708 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bb64e-5342-4177-826e-1bf90bbef062 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:01.158622 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:01.177479 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bb64e-5342-4177-826e-1bf90bbef062 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:01.215890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2e807-1f23-48fe-959a-153366b2c0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:01.216824 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e807-1f23-48fe-959a-153366b2c0ef None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:01.217258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e807-1f23-48fe-959a-153366b2c0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:01.217679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e807-1f23-48fe-959a-153366b2c0ef None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:01.218561 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2e807-1f23-48fe-959a-153366b2c0ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:01.219015 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2e807-1f23-48fe-959a-153366b2c0ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:01.220549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2e807-1f23-48fe-959a-153366b2c0ef None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:01.235246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 366/728] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:01.240415 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476372aa-c5ed-4e88-a843-edd10b24e146 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:01.303543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:01.372357 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476372aa-c5ed-4e88-a843-edd10b24e146 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:01.406210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e977c-9ee1-426e-a3a8-dec777221ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:01.407009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e977c-9ee1-426e-a3a8-dec777221ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:01.407292 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e977c-9ee1-426e-a3a8-dec777221ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:01.407568 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e977c-9ee1-426e-a3a8-dec777221ad6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:01.415586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e977c-9ee1-426e-a3a8-dec777221ad6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:01.416989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e977c-9ee1-426e-a3a8-dec777221ad6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:01.431543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-195e977c-9ee1-426e-a3a8-dec777221ad6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:01.431543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:01.431543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:01.431543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:01.431543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:01.431543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:01.431543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:01.431543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:01.431543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:01.431543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:01.431543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:01.431543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:01.431543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:01.431543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:01.431543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:01.431543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:01.432557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:01.433820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:01.433820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:01.433820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:01.433820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:01.433820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:01.433820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:01.433820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:01.433820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:01.433820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:01.433820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:01.433820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 363/729] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:01.443299 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2e807-1f23-48fe-959a-153366b2c0ef None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:01.505398 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c96e1-4333-4942-84b7-895f706c89bc None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:01.505722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c96e1-4333-4942-84b7-895f706c89bc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:01.505952 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c96e1-4333-4942-84b7-895f706c89bc None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:01.508240 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 364/730] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:01.513389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf44591-d00d-4f59-b60c-37001dc2d053 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:01.513681 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf44591-d00d-4f59-b60c-37001dc2d053 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:01.513966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf44591-d00d-4f59-b60c-37001dc2d053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:01.540763 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dcf44591-d00d-4f59-b60c-37001dc2d053 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:01.542369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dcf44591-d00d-4f59-b60c-37001dc2d053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:01.604527 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2e807-1f23-48fe-959a-153366b2c0ef None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:01.655830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:01.660076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 365/731] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 15:46:01.682606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f4d8b-1d89-429c-b3f8-4d01615f4cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:01.682606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f4d8b-1d89-429c-b3f8-4d01615f4cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:01.682606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f4d8b-1d89-429c-b3f8-4d01615f4cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:01.682606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f4d8b-1d89-429c-b3f8-4d01615f4cc1 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:01.683058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f4d8b-1d89-429c-b3f8-4d01615f4cc1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:01.683058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f4d8b-1d89-429c-b3f8-4d01615f4cc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:01.683058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f4d8b-1d89-429c-b3f8-4d01615f4cc1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:01.686273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf44591-d00d-4f59-b60c-37001dc2d053 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:01.702350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 367/732] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Jun 2 15:46:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:01.703896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f4d8b-1d89-429c-b3f8-4d01615f4cc1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:01.778830 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:01.867841 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f4d8b-1d89-429c-b3f8-4d01615f4cc1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:01.915062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf44591-d00d-4f59-b60c-37001dc2d053 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:01.916836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afb860-0b5c-40b4-9fda-559228ebf75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:01.917508 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afb860-0b5c-40b4-9fda-559228ebf75d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:01.917810 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afb860-0b5c-40b4-9fda-559228ebf75d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:01.918086 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afb860-0b5c-40b4-9fda-559228ebf75d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:01.951937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8d978-1857-43be-895a-ab0ba83dee3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:01.952699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8d978-1857-43be-895a-ab0ba83dee3e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:01.952988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8d978-1857-43be-895a-ab0ba83dee3e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:01.953271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8d978-1857-43be-895a-ab0ba83dee3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:01.965017 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8d978-1857-43be-895a-ab0ba83dee3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:01.977483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5eb8d978-1857-43be-895a-ab0ba83dee3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:01.977483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:01.977483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:01.977483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:01.977483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:01.977483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:01.977483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:01.977483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:01.977483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:01.977483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:01.977483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:01.977483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:01.977483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:01.977483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:01.977483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:01.977483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:01.978515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:01.978515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:01.978515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:01.978515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:01.978515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:01.978515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:01.978515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:01.978515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:01.978515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:01.978515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:01.978515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:01.978515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:01.978515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:01.978515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:01.978515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:01.978515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:01.979580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:01.979580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:01.979580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:01.979580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:01.979580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:01.979580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:01.979580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:01.979580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:01.979580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:01.979580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:01.979580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:01.979580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:01.979580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 366/733] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:01.984530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8d978-1857-43be-895a-ab0ba83dee3e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:02.060359 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:02.071114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afb860-0b5c-40b4-9fda-559228ebf75d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:02.072762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afb860-0b5c-40b4-9fda-559228ebf75d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:02.193514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 368/734] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:01 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 15:46:02.199952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afb860-0b5c-40b4-9fda-559228ebf75d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:02.220932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8d978-1857-43be-895a-ab0ba83dee3e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:02.243230 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:02.275898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d38ae-e787-4525-ab6c-ee0ddfc56db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:02.276882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d38ae-e787-4525-ab6c-ee0ddfc56db2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:02.277319 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d38ae-e787-4525-ab6c-ee0ddfc56db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:02.277799 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d38ae-e787-4525-ab6c-ee0ddfc56db2 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:02.278889 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d38ae-e787-4525-ab6c-ee0ddfc56db2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:02.279511 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d38ae-e787-4525-ab6c-ee0ddfc56db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:02.282057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d38ae-e787-4525-ab6c-ee0ddfc56db2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:02.297155 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 367/735] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:02.297858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8ea86-42d2-4a55-89f5-c7eec3a12346 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:02.297858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8ea86-42d2-4a55-89f5-c7eec3a12346 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:02.298047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8ea86-42d2-4a55-89f5-c7eec3a12346 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:02.299447 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 368/736] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:02.300701 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8ea86-42d2-4a55-89f5-c7eec3a12346 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:02.335946 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:02.352899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afb860-0b5c-40b4-9fda-559228ebf75d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:02.394920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991e0e3-6ec3-42c2-ab91-064bbe6a168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:02.396117 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991e0e3-6ec3-42c2-ab91-064bbe6a168e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:02.396614 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991e0e3-6ec3-42c2-ab91-064bbe6a168e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:02.397612 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991e0e3-6ec3-42c2-ab91-064bbe6a168e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:02.409315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991e0e3-6ec3-42c2-ab91-064bbe6a168e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:02.411277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8ea86-42d2-4a55-89f5-c7eec3a12346 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:02.411810 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991e0e3-6ec3-42c2-ab91-064bbe6a168e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:02.431258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c991e0e3-6ec3-42c2-ab91-064bbe6a168e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:02.431258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:02.431258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:02.431258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:02.431258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:02.431258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:02.431258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:02.431258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:02.431258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:02.431258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:02.431258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:02.431258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:02.431258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:02.431258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:02.431258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:02.432346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:02.433256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:02.433256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:02.433256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:02.433256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:02.435496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 369/737] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:02.437100 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ce393-f823-4b7a-8d2b-86896f9354aa None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:02.437613 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ce393-f823-4b7a-8d2b-86896f9354aa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:02.438093 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ce393-f823-4b7a-8d2b-86896f9354aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:02.448261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97955df8-dd9d-4958-baec-6185b5c22b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:02.449117 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97955df8-dd9d-4958-baec-6185b5c22b8e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:02.449405 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97955df8-dd9d-4958-baec-6185b5c22b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:02.449728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97955df8-dd9d-4958-baec-6185b5c22b8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:02.456714 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ae6ce393-f823-4b7a-8d2b-86896f9354aa None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:02.458552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ae6ce393-f823-4b7a-8d2b-86896f9354aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:02.461380 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97955df8-dd9d-4958-baec-6185b5c22b8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:02.463081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97955df8-dd9d-4958-baec-6185b5c22b8e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:02.483097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-97955df8-dd9d-4958-baec-6185b5c22b8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:02.483097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:02.483097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:02.483097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:02.483097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:02.483097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:02.483097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:02.483097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:02.483097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:02.483097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:02.483097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:02.483097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:02.483097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:02.483097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:02.483097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:02.484089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:02.490009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:02.490009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:02.490009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:02.490009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:02.490009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 369/738] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:02.490009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97955df8-dd9d-4958-baec-6185b5c22b8e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:02.518851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:02.548233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 370/739] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:02.548233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb84ce-8f97-42b1-b39b-d5755900a446 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:02.548233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb84ce-8f97-42b1-b39b-d5755900a446 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:02.548233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb84ce-8f97-42b1-b39b-d5755900a446 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:02.548233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 371/740] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:02.548233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb84ce-8f97-42b1-b39b-d5755900a446 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:02.615509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97955df8-dd9d-4958-baec-6185b5c22b8e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:02.621562 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:02.651618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1a94d-27a2-4bbd-8047-0973377e8744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:02.652447 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1a94d-27a2-4bbd-8047-0973377e8744 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:02.652806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1a94d-27a2-4bbd-8047-0973377e8744 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:02.653159 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1a94d-27a2-4bbd-8047-0973377e8744 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:02.653950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1a94d-27a2-4bbd-8047-0973377e8744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:02.654275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1a94d-27a2-4bbd-8047-0973377e8744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:02.655674 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1a94d-27a2-4bbd-8047-0973377e8744 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:02.658866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb84ce-8f97-42b1-b39b-d5755900a446 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:02.671323 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 370/741] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:02.671323 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003ae3f-96e7-45ce-82ff-fabfd88618c8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:02.671323 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003ae3f-96e7-45ce-82ff-fabfd88618c8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:02.671323 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003ae3f-96e7-45ce-82ff-fabfd88618c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:02.687136 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0003ae3f-96e7-45ce-82ff-fabfd88618c8 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:02.688355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0003ae3f-96e7-45ce-82ff-fabfd88618c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:02.697669 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304783fa-280f-47af-ad49-7413a8d48dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:02.698420 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304783fa-280f-47af-ad49-7413a8d48dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:02.698779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304783fa-280f-47af-ad49-7413a8d48dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:02.699131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304783fa-280f-47af-ad49-7413a8d48dc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:02.699939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304783fa-280f-47af-ad49-7413a8d48dc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:02.700348 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304783fa-280f-47af-ad49-7413a8d48dc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:02.701786 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304783fa-280f-47af-ad49-7413a8d48dc3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:02.717744 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 372/742] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:02.717744 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304783fa-280f-47af-ad49-7413a8d48dc3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:02.764471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 371/743] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 15:46:02.765243 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003ae3f-96e7-45ce-82ff-fabfd88618c8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:02.790394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:02.827527 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304783fa-280f-47af-ad49-7413a8d48dc3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:02.859320 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:02.868555 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363623f0-8eea-432f-b400-821fa6b59ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:02.869129 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363623f0-8eea-432f-b400-821fa6b59ce9 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:02.869418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363623f0-8eea-432f-b400-821fa6b59ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:02.869703 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363623f0-8eea-432f-b400-821fa6b59ce9 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:02.870432 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363623f0-8eea-432f-b400-821fa6b59ce9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:02.871881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363623f0-8eea-432f-b400-821fa6b59ce9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:02.890577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003ae3f-96e7-45ce-82ff-fabfd88618c8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:02.925247 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50277a8-2784-432c-ab97-5d21f9d40cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:02.926169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50277a8-2784-432c-ab97-5d21f9d40cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:02.926515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50277a8-2784-432c-ab97-5d21f9d40cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:02.926856 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50277a8-2784-432c-ab97-5d21f9d40cc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:02.934272 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50277a8-2784-432c-ab97-5d21f9d40cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:02.935798 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50277a8-2784-432c-ab97-5d21f9d40cc1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:02.951040 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 373/744] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Jun 2 15:46:02 2022] POST /identity/v3/services => generated 240 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:02.951040 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363623f0-8eea-432f-b400-821fa6b59ce9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:02.951330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d50277a8-2784-432c-ab97-5d21f9d40cc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:02.951330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:02.951330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:02.951330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:02.951330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:02.951330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:02.951330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:02.951330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:02.951330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:02.951330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:02.951330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:02.951330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:02.951330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:02.951330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:02.951330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:02.952370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:02.953502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:02.953502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:02.953502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:02.953502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:02.953502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:02.953502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:02.953502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:02.953502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:02.953502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 372/745] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:02.953502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50277a8-2784-432c-ab97-5d21f9d40cc1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:03.052373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:03.087060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50277a8-2784-432c-ab97-5d21f9d40cc1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:03.095078 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363623f0-8eea-432f-b400-821fa6b59ce9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:03.125709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a5bbb-d457-4a08-ba44-b5e55cc91128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:03.126533 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a5bbb-d457-4a08-ba44-b5e55cc91128 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.126822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a5bbb-d457-4a08-ba44-b5e55cc91128 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.127106 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a5bbb-d457-4a08-ba44-b5e55cc91128 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.133622 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb27c8e-f244-4ca5-b9c6-226d654aa9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:03.134441 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb27c8e-f244-4ca5-b9c6-226d654aa9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.134730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb27c8e-f244-4ca5-b9c6-226d654aa9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.135011 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb27c8e-f244-4ca5-b9c6-226d654aa9f6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.139414 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a5bbb-d457-4a08-ba44-b5e55cc91128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:03.143768 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb27c8e-f244-4ca5-b9c6-226d654aa9f6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:03.145340 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb27c8e-f244-4ca5-b9c6-226d654aa9f6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:03.148304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-512a5bbb-d457-4a08-ba44-b5e55cc91128 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:03.148304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:03.148304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:03.148304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:03.148304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:03.148304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:03.148304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:03.148304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:03.148304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:03.148304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:03.148304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:03.148304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:03.148304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:03.148304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:03.148304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:03.148304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:03.149275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:03.149275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:03.149275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:03.149275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:03.149275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:03.149275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:03.149275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:03.149275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:03.149275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:03.149275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:03.149275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:03.149275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:03.149275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:03.149275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:03.149275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:03.149275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:03.150129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:03.150129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:03.150129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:03.150129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:03.150129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:03.150129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:03.150129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:03.150129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:03.150129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:03.150129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:03.150129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:03.150129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:03.154659 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 373/746] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:03.155672 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a5bbb-d457-4a08-ba44-b5e55cc91128 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:03.162161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4fb27c8e-f244-4ca5-b9c6-226d654aa9f6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:03.162161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:03.162161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:03.162161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:03.162161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:03.162161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:03.162161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:03.162161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:03.162161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:03.162161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:03.162161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:03.162161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:03.162161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:03.162161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:03.162161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:03.162161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:03.164798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:03.166875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:03.166875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:03.166875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:03.166875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:03.166875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:03.166875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:03.166875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:03.166875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:03.166875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:03.166875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:03.166875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 374/747] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Jun 2 15:46:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:03.166875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb27c8e-f244-4ca5-b9c6-226d654aa9f6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:03.234445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:03.299063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a5bbb-d457-4a08-ba44-b5e55cc91128 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:03.317120 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb27c8e-f244-4ca5-b9c6-226d654aa9f6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:03.330993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:03.336639 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d579bb3-d5e6-418f-bc3f-6c7715a18b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:03.337548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d579bb3-d5e6-418f-bc3f-6c7715a18b82 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.337981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d579bb3-d5e6-418f-bc3f-6c7715a18b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.338484 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d579bb3-d5e6-418f-bc3f-6c7715a18b82 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.339405 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d579bb3-d5e6-418f-bc3f-6c7715a18b82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:03.339862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d579bb3-d5e6-418f-bc3f-6c7715a18b82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:03.341477 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d579bb3-d5e6-418f-bc3f-6c7715a18b82 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:03.357806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 374/748] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:03.358935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d579bb3-d5e6-418f-bc3f-6c7715a18b82 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:03.365209 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef08f1-336a-4e5e-b184-a93c288f319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:03.366114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef08f1-336a-4e5e-b184-a93c288f319c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.366574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef08f1-336a-4e5e-b184-a93c288f319c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.366995 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef08f1-336a-4e5e-b184-a93c288f319c None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.368223 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef08f1-336a-4e5e-b184-a93c288f319c None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:03.371549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef08f1-336a-4e5e-b184-a93c288f319c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:03.373399 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef08f1-336a-4e5e-b184-a93c288f319c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:03.383169 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 375/749] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:03.384375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef08f1-336a-4e5e-b184-a93c288f319c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:03.476428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d579bb3-d5e6-418f-bc3f-6c7715a18b82 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:03.514058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529412a-32a4-447f-815c-da470afc9be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:03.515145 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529412a-32a4-447f-815c-da470afc9be6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.515629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529412a-32a4-447f-815c-da470afc9be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.516336 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529412a-32a4-447f-815c-da470afc9be6 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.516565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef08f1-336a-4e5e-b184-a93c288f319c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:03.518072 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529412a-32a4-447f-815c-da470afc9be6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:03.518601 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529412a-32a4-447f-815c-da470afc9be6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:03.520288 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529412a-32a4-447f-815c-da470afc9be6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:03.526439 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:03.542794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 375/750] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Jun 2 15:46:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:03.543654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529412a-32a4-447f-815c-da470afc9be6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:03.556923 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aabcfb-d8f7-465e-bfa0-25d60a730970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:03.557600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aabcfb-d8f7-465e-bfa0-25d60a730970 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.557864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aabcfb-d8f7-465e-bfa0-25d60a730970 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.558142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aabcfb-d8f7-465e-bfa0-25d60a730970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.558969 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aabcfb-d8f7-465e-bfa0-25d60a730970 None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=02eade9a475b4002bd3990f08f8a1198) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:03.559430 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aabcfb-d8f7-465e-bfa0-25d60a730970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:03.560889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aabcfb-d8f7-465e-bfa0-25d60a730970 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:03.572196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 376/751] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:03 2022] GET /identity/v3/role_assignments?user.id=02eade9a475b4002bd3990f08f8a1198&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:03.572196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cb932-7842-48c4-885b-51b4e37fc1fc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.572196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cb932-7842-48c4-885b-51b4e37fc1fc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.572196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cb932-7842-48c4-885b-51b4e37fc1fc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.572196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 377/752] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:03.573963 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cb932-7842-48c4-885b-51b4e37fc1fc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:03.613079 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:03.672902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529412a-32a4-447f-815c-da470afc9be6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:03.719256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cb932-7842-48c4-885b-51b4e37fc1fc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:03.724520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd0f60-49b3-406a-af88-3d8f0591b914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:03.725680 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd0f60-49b3-406a-af88-3d8f0591b914 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.726121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd0f60-49b3-406a-af88-3d8f0591b914 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.726550 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd0f60-49b3-406a-af88-3d8f0591b914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.743577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd0f60-49b3-406a-af88-3d8f0591b914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:03.745379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd0f60-49b3-406a-af88-3d8f0591b914 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:03.764090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701394a2-e62f-4ab6-b0e2-28a6d8d9009c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:03.765041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701394a2-e62f-4ab6-b0e2-28a6d8d9009c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.765485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701394a2-e62f-4ab6-b0e2-28a6d8d9009c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.765911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701394a2-e62f-4ab6-b0e2-28a6d8d9009c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.769993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a1fd0f60-49b3-406a-af88-3d8f0591b914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:03.769993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:03.769993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:03.769993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:03.769993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:03.769993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:03.769993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:03.769993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:03.769993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:03.769993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:03.769993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:03.769993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:03.769993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:03.769993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:03.769993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:03.770988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:03.771891 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:03.771891 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:03.771891 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:03.771891 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:03.774694 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 376/753] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:03.776951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af740c94-829e-427c-95ad-bc71ef9cf132 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.777456 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af740c94-829e-427c-95ad-bc71ef9cf132 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.777914 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af740c94-829e-427c-95ad-bc71ef9cf132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.779612 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701394a2-e62f-4ab6-b0e2-28a6d8d9009c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:03.781178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701394a2-e62f-4ab6-b0e2-28a6d8d9009c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:03.795875 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-af740c94-829e-427c-95ad-bc71ef9cf132 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:03.797401 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-af740c94-829e-427c-95ad-bc71ef9cf132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:03.802700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-701394a2-e62f-4ab6-b0e2-28a6d8d9009c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:03.802700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:03.802700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:03.802700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:03.802700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:03.802700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:03.802700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:03.802700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:03.802700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:03.802700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:03.802700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:03.802700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:03.802700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:03.802700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:03.802700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:03.804388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:03.805869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:03.805869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:03.805869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:03.805869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:03.805869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 378/754] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:03.805869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701394a2-e62f-4ab6-b0e2-28a6d8d9009c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:03.838615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:03.880187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 377/755] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:03.881444 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af740c94-829e-427c-95ad-bc71ef9cf132 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:03.932781 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:03.934387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701394a2-e62f-4ab6-b0e2-28a6d8d9009c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:03.985966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdb4a0-b82e-4e78-a91c-33baa7094f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:03.987496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdb4a0-b82e-4e78-a91c-33baa7094f9c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:03.988008 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdb4a0-b82e-4e78-a91c-33baa7094f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:03.988936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdb4a0-b82e-4e78-a91c-33baa7094f9c None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:03.989892 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdb4a0-b82e-4e78-a91c-33baa7094f9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:03.990789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdb4a0-b82e-4e78-a91c-33baa7094f9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:03.993261 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdb4a0-b82e-4e78-a91c-33baa7094f9c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:04.010941 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 379/756] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:04.012515 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdb4a0-b82e-4e78-a91c-33baa7094f9c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:04.015650 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af740c94-829e-427c-95ad-bc71ef9cf132 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:04.052586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e39a5-6578-4bbb-a1a6-3a6716823292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:04.053249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e39a5-6578-4bbb-a1a6-3a6716823292 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.053617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e39a5-6578-4bbb-a1a6-3a6716823292 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.054083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e39a5-6578-4bbb-a1a6-3a6716823292 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.054605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e39a5-6578-4bbb-a1a6-3a6716823292 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:04.054915 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e39a5-6578-4bbb-a1a6-3a6716823292 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:04.056390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e39a5-6578-4bbb-a1a6-3a6716823292 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:04.068430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 378/757] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:04.069682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e39a5-6578-4bbb-a1a6-3a6716823292 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:04.129983 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:04.149189 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdb4a0-b82e-4e78-a91c-33baa7094f9c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:04.188640 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:04.191161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928b810-1d5e-4809-94e1-fa692708557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:04.192899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928b810-1d5e-4809-94e1-fa692708557f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.193361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928b810-1d5e-4809-94e1-fa692708557f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.194589 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928b810-1d5e-4809-94e1-fa692708557f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.195465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928b810-1d5e-4809-94e1-fa692708557f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:04.198051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928b810-1d5e-4809-94e1-fa692708557f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:04.203311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e39a5-6578-4bbb-a1a6-3a6716823292 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:04.215717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b928b810-1d5e-4809-94e1-fa692708557f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:46:04.215717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:04.215717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:04.215717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:04.215717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:04.215717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:04.215717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:04.215717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:04.215717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:46:04.215717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:04.215717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:04.215717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:04.215717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:04.215717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:04.215717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:04.215717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:04.216889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:04.216889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:04.216889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:04.216889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:04.216889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:04.216889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:04.216889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:04.216889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:04.216889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:04.216889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:04.216889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:04.216889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:04.216889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:04.216889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:04.216889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:04.216889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:04.217790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:04.217790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:04.217790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:04.217790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:04.217790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:04.217790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:04.217790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:04.217790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:04.217790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:04.217790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:04.217790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:04.217790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:04.217790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:04.217790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:46:04.217790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:04.222732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 380/758] 10.222.0.50 () {56 vars in 1129 bytes} [Thu Jun 2 15:46:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:04.223934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928b810-1d5e-4809-94e1-fa692708557f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:04.243746 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae51cd-3bda-4905-b7af-dd84240c18b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:04.247465 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae51cd-3bda-4905-b7af-dd84240c18b3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.247793 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae51cd-3bda-4905-b7af-dd84240c18b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.248092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae51cd-3bda-4905-b7af-dd84240c18b3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.258524 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae51cd-3bda-4905-b7af-dd84240c18b3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:04.260014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae51cd-3bda-4905-b7af-dd84240c18b3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:04.280034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-70ae51cd-3bda-4905-b7af-dd84240c18b3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:04.280034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:04.280034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:04.280034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:04.280034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:04.280034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:04.280034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:04.280034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:04.280034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:04.280034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:04.280034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:04.280034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:04.280034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:04.280034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:04.280034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:04.280034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:04.281063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:04.282014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:04.282014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:04.282014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:04.282014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:04.282014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:04.282014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:04.282014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:04.282014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:04.282014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:04.282014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:04.282014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 379/759] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Jun 2 15:46:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:04.282014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae51cd-3bda-4905-b7af-dd84240c18b3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:04.343689 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928b810-1d5e-4809-94e1-fa692708557f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:04.379409 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adbe86-f6c4-4269-9fc7-ca7c11ee6d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:04.380418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adbe86-f6c4-4269-9fc7-ca7c11ee6d32 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.380650 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adbe86-f6c4-4269-9fc7-ca7c11ee6d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.380938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adbe86-f6c4-4269-9fc7-ca7c11ee6d32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.388404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0adbe86-f6c4-4269-9fc7-ca7c11ee6d32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:04.389968 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0adbe86-f6c4-4269-9fc7-ca7c11ee6d32 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:04.400183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae51cd-3bda-4905-b7af-dd84240c18b3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:04.405645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d0adbe86-f6c4-4269-9fc7-ca7c11ee6d32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:04.405645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:04.405645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:04.405645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:04.405645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:04.405645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:04.405645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:04.405645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:04.405645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:04.405645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:04.405645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:04.405645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:04.405645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:04.405645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:04.405645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:04.406754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:04.408036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:04.408036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:04.408036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:04.408036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:04.408036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:04.408036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:04.408036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:04.408036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:04.408036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 381/760] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:04.408036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adbe86-f6c4-4269-9fc7-ca7c11ee6d32 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:04.416980 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:04.440351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d8be6-73ab-462f-8411-aa69add6bac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:04.441265 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8be6-73ab-462f-8411-aa69add6bac1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.441722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8be6-73ab-462f-8411-aa69add6bac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.442146 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8be6-73ab-462f-8411-aa69add6bac1 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.443001 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d8be6-73ab-462f-8411-aa69add6bac1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:04.443507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d8be6-73ab-462f-8411-aa69add6bac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:04.445243 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d8be6-73ab-462f-8411-aa69add6bac1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:04.455686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 380/761] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Jun 2 15:46:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:04.456875 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d8be6-73ab-462f-8411-aa69add6bac1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:04.477018 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:04.516236 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adbe86-f6c4-4269-9fc7-ca7c11ee6d32 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:04.555079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959209a4-9eff-469c-a6fd-451b6253a8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:04.555738 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959209a4-9eff-469c-a6fd-451b6253a8bc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.556061 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959209a4-9eff-469c-a6fd-451b6253a8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.556349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959209a4-9eff-469c-a6fd-451b6253a8bc None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.557296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959209a4-9eff-469c-a6fd-451b6253a8bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:04.557616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959209a4-9eff-469c-a6fd-451b6253a8bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:04.559048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959209a4-9eff-469c-a6fd-451b6253a8bc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:04.565872 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d8be6-73ab-462f-8411-aa69add6bac1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:04.583145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 382/762] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Jun 2 15:46:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:04.584169 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959209a4-9eff-469c-a6fd-451b6253a8bc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:04.602828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797a9a0-fcad-4778-85d0-4271c54c56d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:04.603499 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797a9a0-fcad-4778-85d0-4271c54c56d3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.603787 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797a9a0-fcad-4778-85d0-4271c54c56d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.604481 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797a9a0-fcad-4778-85d0-4271c54c56d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.605280 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797a9a0-fcad-4778-85d0-4271c54c56d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:04.605595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797a9a0-fcad-4778-85d0-4271c54c56d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:04.607029 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797a9a0-fcad-4778-85d0-4271c54c56d3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:04.627850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 381/763] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:04.628747 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797a9a0-fcad-4778-85d0-4271c54c56d3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:04.657422 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:04.705244 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959209a4-9eff-469c-a6fd-451b6253a8bc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:04.724417 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:04.746872 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a45118-a37c-48ea-8ca9-33141974d4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:04.748057 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a45118-a37c-48ea-8ca9-33141974d4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.748499 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a45118-a37c-48ea-8ca9-33141974d4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.748963 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a45118-a37c-48ea-8ca9-33141974d4a0 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.749482 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797a9a0-fcad-4778-85d0-4271c54c56d3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:04.750054 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a45118-a37c-48ea-8ca9-33141974d4a0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:04.750527 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a45118-a37c-48ea-8ca9-33141974d4a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:04.753100 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a45118-a37c-48ea-8ca9-33141974d4a0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:04.760331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 383/764] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Jun 2 15:46:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:04.761377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a45118-a37c-48ea-8ca9-33141974d4a0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:04.792115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f6f17-5315-47dc-9ebe-52697689ad71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:04.792920 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f6f17-5315-47dc-9ebe-52697689ad71 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.793306 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f6f17-5315-47dc-9ebe-52697689ad71 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.793655 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f6f17-5315-47dc-9ebe-52697689ad71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.876772 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f6f17-5315-47dc-9ebe-52697689ad71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:04.878359 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f6f17-5315-47dc-9ebe-52697689ad71 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:04.894344 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a45118-a37c-48ea-8ca9-33141974d4a0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:04.926428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:04.937594 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2a06e-041c-458a-a155-617792e7b68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:04.939205 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2a06e-041c-458a-a155-617792e7b68c None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:04.939650 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2a06e-041c-458a-a155-617792e7b68c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:04.940381 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2a06e-041c-458a-a155-617792e7b68c None admin] PATH_INFO: `/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/2e53683ae2b34947a1550de269b74d10/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:04.943472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2a06e-041c-458a-a155-617792e7b68c None admin] RBAC: Authorizing `identity:create_grant(project_id=e2775777647e4323a554bb3a5d045fc0, user_id=2e53683ae2b34947a1550de269b74d10, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:04.953164 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2a06e-041c-458a-a155-617792e7b68c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:04.964452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:04.989674 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 382/765] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:46:04.991515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f6f17-5315-47dc-9ebe-52697689ad71 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:05.099455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 384/766] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:46:04 2022] PUT /identity/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/2e53683ae2b34947a1550de269b74d10/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:46:05.101578 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2a06e-041c-458a-a155-617792e7b68c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:05.108419 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f6f17-5315-47dc-9ebe-52697689ad71 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:05.173496 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149b9cb-3522-4743-ac4e-3957104c7dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:05.174195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149b9cb-3522-4743-ac4e-3957104c7dcd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.174485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149b9cb-3522-4743-ac4e-3957104c7dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.174767 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149b9cb-3522-4743-ac4e-3957104c7dcd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.175570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149b9cb-3522-4743-ac4e-3957104c7dcd None admin] RBAC: Adding query filter params (interface=public, service_id=2524e7aa30f1433f83d8b3041f74a4c2, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:05.175886 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149b9cb-3522-4743-ac4e-3957104c7dcd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:05.177382 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149b9cb-3522-4743-ac4e-3957104c7dcd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:05.195711 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 383/767] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Jun 2 15:46:04 2022] GET /identity/v3/endpoints?service_id=2524e7aa30f1433f83d8b3041f74a4c2&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:05.205134 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149b9cb-3522-4743-ac4e-3957104c7dcd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:05.228564 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2a06e-041c-458a-a155-617792e7b68c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:05.267378 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f239625-46ea-480b-b980-97fa78a6de1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:05.268646 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f239625-46ea-480b-b980-97fa78a6de1e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.268646 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f239625-46ea-480b-b980-97fa78a6de1e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.268959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f239625-46ea-480b-b980-97fa78a6de1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.281173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f239625-46ea-480b-b980-97fa78a6de1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:05.282644 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f239625-46ea-480b-b980-97fa78a6de1e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:05.303194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1f239625-46ea-480b-b980-97fa78a6de1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:05.303194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:05.303194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:05.303194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:05.303194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:05.303194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:05.303194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:05.303194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:05.303194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:05.303194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:05.303194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:05.303194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:05.303194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:05.303194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:05.303194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:05.304822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:05.306143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:05.306143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:05.306143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:05.306143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:05.306143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 385/768] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:05.311042 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f239625-46ea-480b-b980-97fa78a6de1e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:05.325261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:05.366408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:05.414172 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149b9cb-3522-4743-ac4e-3957104c7dcd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:05.451749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f239625-46ea-480b-b980-97fa78a6de1e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:05.454442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c07b8-e2b4-4827-a825-efb1844ce120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:05.455359 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c07b8-e2b4-4827-a825-efb1844ce120 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.455855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c07b8-e2b4-4827-a825-efb1844ce120 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.456449 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c07b8-e2b4-4827-a825-efb1844ce120 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.457341 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c07b8-e2b4-4827-a825-efb1844ce120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:05.458925 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c07b8-e2b4-4827-a825-efb1844ce120 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:05.472142 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 384/769] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Jun 2 15:46:05 2022] GET /identity/v3/services => generated 772 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:05.474154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f02e31-4749-4355-a7d1-795592178a77 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.474680 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f02e31-4749-4355-a7d1-795592178a77 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.475213 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f02e31-4749-4355-a7d1-795592178a77 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.477224 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 385/770] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:05.483279 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89216e-77d4-4d1a-bf1e-74da7536cc86 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.483912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89216e-77d4-4d1a-bf1e-74da7536cc86 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.484454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89216e-77d4-4d1a-bf1e-74da7536cc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.488785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d59785-0603-4307-ba6f-9f5e73cd1a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:05.489460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d59785-0603-4307-ba6f-9f5e73cd1a73 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.489745 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d59785-0603-4307-ba6f-9f5e73cd1a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.490066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d59785-0603-4307-ba6f-9f5e73cd1a73 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.490831 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d59785-0603-4307-ba6f-9f5e73cd1a73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:05.491144 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d59785-0603-4307-ba6f-9f5e73cd1a73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:05.492578 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d59785-0603-4307-ba6f-9f5e73cd1a73 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:05.508573 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 386/771] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:05.514294 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d59785-0603-4307-ba6f-9f5e73cd1a73 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:05.523711 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cd89216e-77d4-4d1a-bf1e-74da7536cc86 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:05.525436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cd89216e-77d4-4d1a-bf1e-74da7536cc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:05.641772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:05.656368 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d59785-0603-4307-ba6f-9f5e73cd1a73 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:05.676126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 386/772] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:05.717895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89216e-77d4-4d1a-bf1e-74da7536cc86 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:05.738303 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc9a60-f0f7-4e45-9040-e981dcec4bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:05.739121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc9a60-f0f7-4e45-9040-e981dcec4bbe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.739412 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc9a60-f0f7-4e45-9040-e981dcec4bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.739699 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc9a60-f0f7-4e45-9040-e981dcec4bbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.751095 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc9a60-f0f7-4e45-9040-e981dcec4bbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:05.752619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc9a60-f0f7-4e45-9040-e981dcec4bbe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:05.779141 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:05.786251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f7dc9a60-f0f7-4e45-9040-e981dcec4bbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:05.786251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:05.786251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:05.786251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:05.786251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:05.786251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:05.786251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:05.786251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:05.786251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:05.786251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:05.786251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:05.786251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:05.786251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:05.786251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:05.786251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:05.787187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:05.788645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:05.788645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:05.788645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:05.788645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:05.788645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:05.788645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:05.788645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:05.788645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:05.795492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 387/773] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:05.797567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc9a60-f0f7-4e45-9040-e981dcec4bbe None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:05.881263 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89216e-77d4-4d1a-bf1e-74da7536cc86 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:05.923636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eabf3c-3a0b-4b2b-8a74-d2f1ed4fa8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:05.924549 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eabf3c-3a0b-4b2b-8a74-d2f1ed4fa8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.924842 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eabf3c-3a0b-4b2b-8a74-d2f1ed4fa8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.925128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eabf3c-3a0b-4b2b-8a74-d2f1ed4fa8f8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.925843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eabf3c-3a0b-4b2b-8a74-d2f1ed4fa8f8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:05.927161 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eabf3c-3a0b-4b2b-8a74-d2f1ed4fa8f8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:05.942898 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc9a60-f0f7-4e45-9040-e981dcec4bbe None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-97eabf3c-3a0b-4b2b-8a74-d2f1ed4fa8f8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:05.946530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:05.947529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:05.947529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:05.947529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:05.947529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:05.947529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:05.947529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:05.947529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:05.947529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:05.947529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:05.947529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:05.947529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:05.947529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:05.947529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:05.947529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:05.947529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:05.947529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:05.948761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:05.948761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:05.948761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:05.948761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:05.948761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:05.948761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:05.948761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:05.948761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:05.948761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:05.948761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:05.948761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:05.948761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:05.948761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:46:05.948761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:05.956459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 387/774] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:05 2022] GET /identity/v3/services/network => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:05.964507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42522f71-827b-4496-8700-c7f8633244be None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.964507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42522f71-827b-4496-8700-c7f8633244be None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.964507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42522f71-827b-4496-8700-c7f8633244be None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.964507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 388/775] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:05.966404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42522f71-827b-4496-8700-c7f8633244be None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:05.993744 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e454e12-759c-4ac6-b5d9-533d0ee8311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:05.995237 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e454e12-759c-4ac6-b5d9-533d0ee8311a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:05.995809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e454e12-759c-4ac6-b5d9-533d0ee8311a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:05.996268 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e454e12-759c-4ac6-b5d9-533d0ee8311a None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:05.997484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e454e12-759c-4ac6-b5d9-533d0ee8311a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:05.998340 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e454e12-759c-4ac6-b5d9-533d0ee8311a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:05.999941 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e454e12-759c-4ac6-b5d9-533d0ee8311a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:06.017961 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 388/776] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:06.019543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dd11b-6bf0-49db-9f57-ba8620f63bce None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:06.020026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dd11b-6bf0-49db-9f57-ba8620f63bce None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:06.020455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dd11b-6bf0-49db-9f57-ba8620f63bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:06.042804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c51dd11b-6bf0-49db-9f57-ba8620f63bce None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:06.044295 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c51dd11b-6bf0-49db-9f57-ba8620f63bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:06.060820 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:06.100350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:06.106535 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42522f71-827b-4496-8700-c7f8633244be None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:06.124254 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 389/777] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:06.125730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dd11b-6bf0-49db-9f57-ba8620f63bce None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:06.149706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c8b85-c76b-4da5-9411-4456d7200f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:06.150897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c8b85-c76b-4da5-9411-4456d7200f77 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:06.151371 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c8b85-c76b-4da5-9411-4456d7200f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:06.151824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c8b85-c76b-4da5-9411-4456d7200f77 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:06.153192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c8b85-c76b-4da5-9411-4456d7200f77 None admin] RBAC: Adding query filter params (name=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:06.153688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c8b85-c76b-4da5-9411-4456d7200f77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:06.155526 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c8b85-c76b-4da5-9411-4456d7200f77 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:06.161374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 389/778] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:06.163975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c8b85-c76b-4da5-9411-4456d7200f77 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:06.251922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dd11b-6bf0-49db-9f57-ba8620f63bce None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:06.289625 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d677878-227c-4c23-b4c5-61c9edf667f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:06.290272 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d677878-227c-4c23-b4c5-61c9edf667f1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:06.290603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d677878-227c-4c23-b4c5-61c9edf667f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:06.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d677878-227c-4c23-b4c5-61c9edf667f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:06.291708 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d677878-227c-4c23-b4c5-61c9edf667f1 None admin] RBAC: Adding query filter params (role.id=740fa9b1529f4a558de5b8987dba5ba3, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=63b40cb0ce3b420a918ec12672c0eccc) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:06.292044 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d677878-227c-4c23-b4c5-61c9edf667f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:06.293532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d677878-227c-4c23-b4c5-61c9edf667f1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:06.297919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c8b85-c76b-4da5-9411-4456d7200f77 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:06.304185 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 390/779] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:06 2022] GET /identity/v3/role_assignments?user.id=63b40cb0ce3b420a918ec12672c0eccc&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=740fa9b1529f4a558de5b8987dba5ba3 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:06.305158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d677878-227c-4c23-b4c5-61c9edf667f1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:06.340282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:06.340949 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d0994-7dd0-421c-839b-27556ed9ba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:06.342385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d0994-7dd0-421c-839b-27556ed9ba1f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:06.342860 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d0994-7dd0-421c-839b-27556ed9ba1f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:06.343449 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d0994-7dd0-421c-839b-27556ed9ba1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:06.362353 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d0994-7dd0-421c-839b-27556ed9ba1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:06.372416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-023d0994-7dd0-421c-839b-27556ed9ba1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:06.372416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:06.372416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:06.372416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:06.372416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:06.372416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:06.372416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:06.372416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:06.372416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:06.372416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:06.372416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:06.372416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:06.372416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:06.372416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:06.372416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:06.372416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:06.376235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:06.376235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:06.376235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:06.376235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:06.376235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:06.376235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:06.376235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:06.376235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:06.376235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:06.376235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:06.376235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:06.376235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:06.376235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:06.376235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:06.376235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:06.376235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:06.377202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:06.377202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:06.377202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:06.377202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:06.377202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:06.377202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:06.377202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:06.377202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:06.377202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:06.377202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:06.377202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:06.377202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:06.377202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 390/780] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:06.380854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d0994-7dd0-421c-839b-27556ed9ba1f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:06.414629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:06.520233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d677878-227c-4c23-b4c5-61c9edf667f1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:06.560725 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac489b-6c78-4dfc-b86d-b1eb6646e48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:06.561973 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac489b-6c78-4dfc-b86d-b1eb6646e48d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:06.562415 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac489b-6c78-4dfc-b86d-b1eb6646e48d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:06.562700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac489b-6c78-4dfc-b86d-b1eb6646e48d None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:06.563419 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac489b-6c78-4dfc-b86d-b1eb6646e48d None admin] RBAC: Adding query filter params (type=network) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:06.563729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac489b-6c78-4dfc-b86d-b1eb6646e48d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:06.565171 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac489b-6c78-4dfc-b86d-b1eb6646e48d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:06.571971 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 391/781] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:06.578630 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac489b-6c78-4dfc-b86d-b1eb6646e48d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:06.579564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d0994-7dd0-421c-839b-27556ed9ba1f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:06.641523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04695ac0-f5d9-425f-a388-6e727a538eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:06.642195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04695ac0-f5d9-425f-a388-6e727a538eef None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:06.642480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04695ac0-f5d9-425f-a388-6e727a538eef None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:06.643504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04695ac0-f5d9-425f-a388-6e727a538eef None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:06.643638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04695ac0-f5d9-425f-a388-6e727a538eef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:06.643900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04695ac0-f5d9-425f-a388-6e727a538eef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:06.645329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04695ac0-f5d9-425f-a388-6e727a538eef None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:06.655449 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 391/782] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:06.661562 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04695ac0-f5d9-425f-a388-6e727a538eef None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:06.681809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:06.708282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac489b-6c78-4dfc-b86d-b1eb6646e48d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:06.758982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:06.775963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04695ac0-f5d9-425f-a388-6e727a538eef None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:06.809250 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09d16b-2dba-4d2a-b178-37f4780da766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:06.809924 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09d16b-2dba-4d2a-b178-37f4780da766 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:06.810220 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09d16b-2dba-4d2a-b178-37f4780da766 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:06.810505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09d16b-2dba-4d2a-b178-37f4780da766 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:06.811300 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09d16b-2dba-4d2a-b178-37f4780da766 None admin] RBAC: Adding query filter params (interface=public, service_id=bf5ebd47328645c69647153fff6ccb68, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:06.811618 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09d16b-2dba-4d2a-b178-37f4780da766 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:06.812512 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e47f3-8e29-4a6d-ae83-151f89b0dcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:06.813033 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09d16b-2dba-4d2a-b178-37f4780da766 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:06.813638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e47f3-8e29-4a6d-ae83-151f89b0dcb8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:06.814066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e47f3-8e29-4a6d-ae83-151f89b0dcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:06.814498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e47f3-8e29-4a6d-ae83-151f89b0dcb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:06.825846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e47f3-8e29-4a6d-ae83-151f89b0dcb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:06.827495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e47f3-8e29-4a6d-ae83-151f89b0dcb8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:06.831310 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 392/783] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Jun 2 15:46:06 2022] GET /identity/v3/endpoints?service_id=bf5ebd47328645c69647153fff6ccb68&interface=public®ion_id=RegionOne => generated 194 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:06.845011 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09d16b-2dba-4d2a-b178-37f4780da766 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:06.850759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c62e47f3-8e29-4a6d-ae83-151f89b0dcb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:06.850759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:06.850759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:06.850759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:06.850759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:06.850759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:06.850759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:06.850759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:06.850759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:06.850759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:06.850759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:06.850759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:06.850759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:06.850759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:06.850759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:06.851858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:06.853014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:06.853014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:06.853014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:06.853014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:06.854853 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 392/784] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:06.860352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e47f3-8e29-4a6d-ae83-151f89b0dcb8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:07.042908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09d16b-2dba-4d2a-b178-37f4780da766 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:07.058460 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e47f3-8e29-4a6d-ae83-151f89b0dcb8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:07.108434 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bb887-1853-4fa6-99e4-5cbad6f618f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:07.110297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bb887-1853-4fa6-99e4-5cbad6f618f8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:07.110926 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bb887-1853-4fa6-99e4-5cbad6f618f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:07.112110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bb887-1853-4fa6-99e4-5cbad6f618f8 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:07.113550 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066bb887-1853-4fa6-99e4-5cbad6f618f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:07.115244 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066bb887-1853-4fa6-99e4-5cbad6f618f8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:07.127441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aad714-52d9-453e-807f-abc6f6cdc270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:07.132354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aad714-52d9-453e-807f-abc6f6cdc270 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:07.132627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 393/785] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Jun 2 15:46:06 2022] GET /identity/v3/services => generated 772 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:07.133176 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aad714-52d9-453e-807f-abc6f6cdc270 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:07.133668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aad714-52d9-453e-807f-abc6f6cdc270 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:07.134566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aad714-52d9-453e-807f-abc6f6cdc270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:07.135023 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aad714-52d9-453e-807f-abc6f6cdc270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:07.136588 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aad714-52d9-453e-807f-abc6f6cdc270 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:07.145350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:07.156455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 393/786] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:07.165188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bb887-1853-4fa6-99e4-5cbad6f618f8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:07.175815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:07.298589 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bb887-1853-4fa6-99e4-5cbad6f618f8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:07.353188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecbe87-3c46-42fd-aa2b-f98950f5bb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:07.354009 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecbe87-3c46-42fd-aa2b-f98950f5bb29 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:07.354301 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecbe87-3c46-42fd-aa2b-f98950f5bb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:07.354588 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecbe87-3c46-42fd-aa2b-f98950f5bb29 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:07.373045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fecbe87-3c46-42fd-aa2b-f98950f5bb29 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:07.374555 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fecbe87-3c46-42fd-aa2b-f98950f5bb29 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:07.394502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7fecbe87-3c46-42fd-aa2b-f98950f5bb29 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:07.394502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:07.394502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:07.394502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:07.394502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:07.394502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:07.394502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:07.394502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:07.394502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:07.394502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:07.394502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:07.394502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:07.394502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:07.394502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:07.394502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:07.394502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:07.395496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:07.396487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:07.396487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:07.396487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:07.396487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:07.396487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:07.396487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:07.396487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:07.396487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:07.396487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:07.396487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:07.398946 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 394/787] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:07.402508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aad714-52d9-453e-807f-abc6f6cdc270 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:07.542829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aad714-52d9-453e-807f-abc6f6cdc270 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:07.597626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a55318-719f-4000-8d08-374f856a799a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:07.598324 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55318-719f-4000-8d08-374f856a799a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:07.598609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55318-719f-4000-8d08-374f856a799a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:07.598885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55318-719f-4000-8d08-374f856a799a None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:07.599729 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a55318-719f-4000-8d08-374f856a799a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:07.600069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a55318-719f-4000-8d08-374f856a799a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:07.601584 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a55318-719f-4000-8d08-374f856a799a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:07.620374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 394/788] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Jun 2 15:46:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:07.625542 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecbe87-3c46-42fd-aa2b-f98950f5bb29 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:07.730533 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:07.754817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b081674-2630-47df-b811-27a102c05869 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:07.755140 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b081674-2630-47df-b811-27a102c05869 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:07.755395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b081674-2630-47df-b811-27a102c05869 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:07.757832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 395/789] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:07.772312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43064f67-82c2-4b9b-8f67-60808bd70cc1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:07.772623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43064f67-82c2-4b9b-8f67-60808bd70cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:07.772893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43064f67-82c2-4b9b-8f67-60808bd70cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:07.795858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-43064f67-82c2-4b9b-8f67-60808bd70cc1 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:07.797092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-43064f67-82c2-4b9b-8f67-60808bd70cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:07.802668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecbe87-3c46-42fd-aa2b-f98950f5bb29 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:07.857538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c72e71-959c-4dcf-b02b-6a1d242a8a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:07.858253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c72e71-959c-4dcf-b02b-6a1d242a8a85 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:07.858541 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c72e71-959c-4dcf-b02b-6a1d242a8a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:07.858823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c72e71-959c-4dcf-b02b-6a1d242a8a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:07.884414 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:07.890240 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c72e71-959c-4dcf-b02b-6a1d242a8a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:07.891739 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c72e71-959c-4dcf-b02b-6a1d242a8a85 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:07.913828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 396/790] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:07.928629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d0c72e71-959c-4dcf-b02b-6a1d242a8a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:07.928629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:07.928629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:07.928629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:07.928629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:07.928629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:07.928629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:07.928629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:07.928629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:07.928629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:07.928629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:07.928629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:07.928629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:07.928629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:07.928629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:07.929619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:07.930514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:07.930514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:07.930514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:07.930514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:07.930514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 395/791] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:07.936345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43064f67-82c2-4b9b-8f67-60808bd70cc1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:07.968097 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c72e71-959c-4dcf-b02b-6a1d242a8a85 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:08.106127 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43064f67-82c2-4b9b-8f67-60808bd70cc1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:08.163152 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f7f07-4df6-478b-9160-0f72272a083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:08.163736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f7f07-4df6-478b-9160-0f72272a083e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.164047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f7f07-4df6-478b-9160-0f72272a083e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.164326 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f7f07-4df6-478b-9160-0f72272a083e None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.165039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f7f07-4df6-478b-9160-0f72272a083e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:08.165348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f7f07-4df6-478b-9160-0f72272a083e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:08.166717 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f7f07-4df6-478b-9160-0f72272a083e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:08.171512 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c72e71-959c-4dcf-b02b-6a1d242a8a85 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:08.193381 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 397/792] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:08.196824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f7f07-4df6-478b-9160-0f72272a083e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:08.202188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:08.234661 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d207126-17fe-411e-8570-6aa4536d959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:08.235460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d207126-17fe-411e-8570-6aa4536d959d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.235746 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d207126-17fe-411e-8570-6aa4536d959d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.236069 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d207126-17fe-411e-8570-6aa4536d959d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.253742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d207126-17fe-411e-8570-6aa4536d959d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:08.261467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1d207126-17fe-411e-8570-6aa4536d959d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:08.261467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:08.261467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:08.261467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:08.261467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:08.261467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:08.261467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:08.261467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:08.261467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:08.261467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:08.261467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:08.261467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:08.261467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:08.261467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:08.261467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:08.261467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:08.262393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:08.262393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:08.262393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:08.262393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:08.262393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:08.262393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:08.262393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:08.262393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:08.262393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:08.262393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:08.262393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:08.262393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:08.262393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:08.262393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:08.262393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:08.262393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:08.263282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:08.263282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:08.263282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:08.263282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:08.263282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:08.263282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:08.263282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:08.263282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:08.263282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:08.263282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:08.263282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:08.263282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:08.263282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 396/793] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:08.270705 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d207126-17fe-411e-8570-6aa4536d959d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:08.288326 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:08.358282 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f7f07-4df6-478b-9160-0f72272a083e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:08.405062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a7f44-0309-446b-afa6-4e200173912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:08.406885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a7f44-0309-446b-afa6-4e200173912e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.407674 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a7f44-0309-446b-afa6-4e200173912e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.408213 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a7f44-0309-446b-afa6-4e200173912e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.415331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d207126-17fe-411e-8570-6aa4536d959d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:08.418638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a7f44-0309-446b-afa6-4e200173912e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:08.420361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a7f44-0309-446b-afa6-4e200173912e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:08.440806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ee0a7f44-0309-446b-afa6-4e200173912e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:08.440806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:08.440806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:08.440806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:08.440806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:08.440806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:08.440806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:08.440806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:08.440806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:08.440806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:08.440806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:08.440806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:08.440806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:08.440806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:08.440806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:08.441754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:08.442663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:08.442663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:08.442663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:08.442663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:08.442663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:08.442663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:08.442663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:08.442663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:08.445759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 398/794] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:08.447957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50712deb-8e0c-435b-a327-8b012ec21b99 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.448447 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50712deb-8e0c-435b-a327-8b012ec21b99 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.449132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50712deb-8e0c-435b-a327-8b012ec21b99 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.455580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 399/795] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:08.456667 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50712deb-8e0c-435b-a327-8b012ec21b99 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:08.457390 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388baf8-b3a0-4ce8-9f8b-9415b3c84f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:08.458320 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388baf8-b3a0-4ce8-9f8b-9415b3c84f71 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.458701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388baf8-b3a0-4ce8-9f8b-9415b3c84f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.459082 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388baf8-b3a0-4ce8-9f8b-9415b3c84f71 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.460081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388baf8-b3a0-4ce8-9f8b-9415b3c84f71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:08.460537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388baf8-b3a0-4ce8-9f8b-9415b3c84f71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:08.462358 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388baf8-b3a0-4ce8-9f8b-9415b3c84f71 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:08.479453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 397/796] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:08.479453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6e17c-0b43-4740-b4cc-d16414043e38 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.479453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6e17c-0b43-4740-b4cc-d16414043e38 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.479453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6e17c-0b43-4740-b4cc-d16414043e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.499946 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-80c6e17c-0b43-4740-b4cc-d16414043e38 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:08.501589 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-80c6e17c-0b43-4740-b4cc-d16414043e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:08.547886 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:08.587902 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 398/797] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:08.593747 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6e17c-0b43-4740-b4cc-d16414043e38 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:08.605307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50712deb-8e0c-435b-a327-8b012ec21b99 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:08.608037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:08.652723 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f48d4-ebc3-4724-b9be-bc5facf16d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:08.653406 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f48d4-ebc3-4724-b9be-bc5facf16d3c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.653695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f48d4-ebc3-4724-b9be-bc5facf16d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.653980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f48d4-ebc3-4724-b9be-bc5facf16d3c None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.654774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f48d4-ebc3-4724-b9be-bc5facf16d3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:08.655085 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f48d4-ebc3-4724-b9be-bc5facf16d3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:08.656914 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f48d4-ebc3-4724-b9be-bc5facf16d3c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:08.676136 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 400/798] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:08.677339 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f48d4-ebc3-4724-b9be-bc5facf16d3c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:08.724729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6e17c-0b43-4740-b4cc-d16414043e38 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:08.764606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c3b58-b16f-47a1-a5be-b4086e14e2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:08.766293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c3b58-b16f-47a1-a5be-b4086e14e2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.766822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c3b58-b16f-47a1-a5be-b4086e14e2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.767308 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c3b58-b16f-47a1-a5be-b4086e14e2b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.779908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c3b58-b16f-47a1-a5be-b4086e14e2b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:08.781829 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c3b58-b16f-47a1-a5be-b4086e14e2b8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:08.801066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6a0c3b58-b16f-47a1-a5be-b4086e14e2b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:08.801066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:08.801066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:08.801066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:08.801066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:08.801066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:08.801066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:08.801066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:08.801066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:08.801066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:08.801066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:08.801066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:08.801066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:08.801066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:08.801066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:08.801998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:08.802897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:08.802897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:08.802897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:08.802897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:08.810123 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 399/799] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:08.810412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f48d4-ebc3-4724-b9be-bc5facf16d3c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:08.811407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c3b58-b16f-47a1-a5be-b4086e14e2b8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:08.842615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:08.852097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e2c98-f8e1-419b-9683-eea21ee0dc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:08.853901 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e2c98-f8e1-419b-9683-eea21ee0dc36 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.853901 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e2c98-f8e1-419b-9683-eea21ee0dc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.854342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e2c98-f8e1-419b-9683-eea21ee0dc36 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.855256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e2c98-f8e1-419b-9683-eea21ee0dc36 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:08.856896 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e2c98-f8e1-419b-9683-eea21ee0dc36 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:08.870315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-773e2c98-f8e1-419b-9683-eea21ee0dc36 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:46:08.870315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:08.870315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:08.870315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:08.870315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:08.870315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:08.870315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:08.870315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:08.870315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:46:08.870315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:08.870315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:08.870315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:08.870315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:08.870315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:08.870315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:08.870315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:08.871300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:08.871300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:08.871300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:08.871300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:08.871300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:08.871300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:08.871300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:08.871300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:08.871300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:08.871300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:08.871300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:08.871300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:08.871300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:08.871300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:08.871300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:08.871300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:08.873092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:08.873092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:08.873092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:08.873092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:08.873092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:08.873092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:08.873092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:08.873092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:08.873092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:08.873092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:08.873092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:08.873092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:08.873092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:08.873092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 15:46:08.873092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:08.880630 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 401/800] 10.222.0.50 () {56 vars in 1129 bytes} [Thu Jun 2 15:46:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:08.881801 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e2c98-f8e1-419b-9683-eea21ee0dc36 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:08.917428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:08.933525 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c3b58-b16f-47a1-a5be-b4086e14e2b8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:08.977253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2b678-d94a-4b45-bc06-e85c6cebe757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:08.978525 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2b678-d94a-4b45-bc06-e85c6cebe757 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:08.979061 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2b678-d94a-4b45-bc06-e85c6cebe757 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:08.979558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2b678-d94a-4b45-bc06-e85c6cebe757 None admin] PATH_INFO: `/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/02eade9a475b4002bd3990f08f8a1198/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:08.981794 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2b678-d94a-4b45-bc06-e85c6cebe757 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2775777647e4323a554bb3a5d045fc0, user_id=02eade9a475b4002bd3990f08f8a1198, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:08.983486 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2b678-d94a-4b45-bc06-e85c6cebe757 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:09.004950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e2c98-f8e1-419b-9683-eea21ee0dc36 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:09.042124 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1363b-52de-4890-8273-8a796aef0b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.042845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1363b-52de-4890-8273-8a796aef0b97 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.043138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1363b-52de-4890-8273-8a796aef0b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.043471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1363b-52de-4890-8273-8a796aef0b97 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.044223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1363b-52de-4890-8273-8a796aef0b97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:09.044583 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1363b-52de-4890-8273-8a796aef0b97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:09.046008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1363b-52de-4890-8273-8a796aef0b97 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:09.060650 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 400/801] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:46:08 2022] PUT /identity/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/02eade9a475b4002bd3990f08f8a1198/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:46:09.060650 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2b678-d94a-4b45-bc06-e85c6cebe757 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.067034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 402/802] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:09.072238 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1363b-52de-4890-8273-8a796aef0b97 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.178107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:09.200930 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2b678-d94a-4b45-bc06-e85c6cebe757 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:09.224966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:09.242780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1363b-52de-4890-8273-8a796aef0b97 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:09.247173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21965f07-f628-4308-8eef-c5617e0f4707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.248566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21965f07-f628-4308-8eef-c5617e0f4707 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.248962 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21965f07-f628-4308-8eef-c5617e0f4707 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.249386 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21965f07-f628-4308-8eef-c5617e0f4707 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.250224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21965f07-f628-4308-8eef-c5617e0f4707 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:09.250657 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21965f07-f628-4308-8eef-c5617e0f4707 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:09.252466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21965f07-f628-4308-8eef-c5617e0f4707 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:09.258981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 401/803] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Jun 2 15:46:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:09.260570 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab00f7-ed20-43d4-adc1-be91d1e92d4c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.260975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab00f7-ed20-43d4-adc1-be91d1e92d4c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.261387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab00f7-ed20-43d4-adc1-be91d1e92d4c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.266674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 402/804] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:09.266674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab00f7-ed20-43d4-adc1-be91d1e92d4c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.306814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614b34b-c423-472b-a7cc-3a0e00152a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.307750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614b34b-c423-472b-a7cc-3a0e00152a27 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.307947 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614b34b-c423-472b-a7cc-3a0e00152a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.308238 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614b34b-c423-472b-a7cc-3a0e00152a27 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.321046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614b34b-c423-472b-a7cc-3a0e00152a27 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:09.322656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614b34b-c423-472b-a7cc-3a0e00152a27 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:09.343548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5614b34b-c423-472b-a7cc-3a0e00152a27 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:09.343548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:09.343548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:09.343548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:09.343548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:09.343548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:09.343548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:09.343548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:09.343548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:09.343548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:09.343548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:09.343548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:09.343548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:09.343548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:09.343548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:09.343548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:09.344679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:09.346233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:09.346233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:09.346233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:09.346233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:09.346233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:09.346233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:09.346233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:09.346233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:09.346233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:09.346233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:09.346233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 403/805] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Jun 2 15:46:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:09.346873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724185d-fc56-4c61-94e6-f761302cb248 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.346945 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724185d-fc56-4c61-94e6-f761302cb248 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.347882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724185d-fc56-4c61-94e6-f761302cb248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.382009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0724185d-fc56-4c61-94e6-f761302cb248 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:09.383312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0724185d-fc56-4c61-94e6-f761302cb248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:09.390752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab00f7-ed20-43d4-adc1-be91d1e92d4c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:09.425928 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc920066-7985-4c14-bc0d-6e47585ac673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.426596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc920066-7985-4c14-bc0d-6e47585ac673 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.426885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc920066-7985-4c14-bc0d-6e47585ac673 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.427169 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc920066-7985-4c14-bc0d-6e47585ac673 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.427880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc920066-7985-4c14-bc0d-6e47585ac673 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:09.428259 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc920066-7985-4c14-bc0d-6e47585ac673 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:09.430200 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc920066-7985-4c14-bc0d-6e47585ac673 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:09.435617 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 403/806] 10.222.0.50 () {56 vars in 1124 bytes} [Thu Jun 2 15:46:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:09.440542 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc920066-7985-4c14-bc0d-6e47585ac673 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.453044 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:09.457367 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 404/807] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:09.458217 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724185d-fc56-4c61-94e6-f761302cb248 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.545398 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc920066-7985-4c14-bc0d-6e47585ac673 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:09.567208 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:09.582854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481e711-6984-43c7-a854-d49a55586c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.583659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481e711-6984-43c7-a854-d49a55586c21 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.583955 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481e711-6984-43c7-a854-d49a55586c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.584431 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481e711-6984-43c7-a854-d49a55586c21 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.585657 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481e711-6984-43c7-a854-d49a55586c21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:09.586252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481e711-6984-43c7-a854-d49a55586c21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:09.588495 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481e711-6984-43c7-a854-d49a55586c21 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:09.590992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724185d-fc56-4c61-94e6-f761302cb248 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:09.611004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 404/808] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Jun 2 15:46:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:09.611932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481e711-6984-43c7-a854-d49a55586c21 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.634140 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e5b24-a642-4158-be35-3f786928d847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.634964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e5b24-a642-4158-be35-3f786928d847 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.635330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e5b24-a642-4158-be35-3f786928d847 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.635716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e5b24-a642-4158-be35-3f786928d847 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.636605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e5b24-a642-4158-be35-3f786928d847 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:09.638198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e5b24-a642-4158-be35-3f786928d847 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:09.684879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:09.717660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481e711-6984-43c7-a854-d49a55586c21 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:09.751306 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f48d28-6baf-466f-9c40-6468c3a87544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.752422 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f48d28-6baf-466f-9c40-6468c3a87544 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.752735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f48d28-6baf-466f-9c40-6468c3a87544 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.753002 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f48d28-6baf-466f-9c40-6468c3a87544 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.760120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 405/809] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Jun 2 15:46:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:09.760120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e5b24-a642-4158-be35-3f786928d847 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.766862 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f48d28-6baf-466f-9c40-6468c3a87544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:09.777133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-91f48d28-6baf-466f-9c40-6468c3a87544 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:09.777133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:09.777133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:09.777133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:09.777133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:09.777133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:09.777133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:09.777133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:09.777133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:09.777133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:09.777133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:09.777133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:09.777133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:09.777133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:09.777133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:09.777133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:09.778931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:09.778931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:09.778931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:09.778931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:09.778931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:09.778931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:09.778931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:09.778931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:09.778931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:09.778931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:09.778931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:09.778931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:09.778931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:09.778931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:09.778931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:09.778931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:09.779809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:09.779809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:09.779809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:09.779809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:09.779809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:09.779809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:09.779809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:09.779809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:09.779809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:09.779809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:09.779809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:09.779809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:09.779809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 405/810] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:09.781133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8a2f5-d5ed-41f8-8ea0-200e1deaed33 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.781133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8a2f5-d5ed-41f8-8ea0-200e1deaed33 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.781133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8a2f5-d5ed-41f8-8ea0-200e1deaed33 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.786937 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 406/811] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:09.788284 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8a2f5-d5ed-41f8-8ea0-200e1deaed33 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:09.915569 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e5b24-a642-4158-be35-3f786928d847 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:09.934885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8a2f5-d5ed-41f8-8ea0-200e1deaed33 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:09.956852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:09.965351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6186f-bef8-48fc-96fa-6caa419596fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.966018 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6186f-bef8-48fc-96fa-6caa419596fc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.966300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6186f-bef8-48fc-96fa-6caa419596fc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.966579 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6186f-bef8-48fc-96fa-6caa419596fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.974151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:09.984881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23868bd6-1c29-4f11-b6db-ba8f0bc1fe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:09.985558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23868bd6-1c29-4f11-b6db-ba8f0bc1fe7d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:09.985845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23868bd6-1c29-4f11-b6db-ba8f0bc1fe7d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:09.986348 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23868bd6-1c29-4f11-b6db-ba8f0bc1fe7d None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:09.986872 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23868bd6-1c29-4f11-b6db-ba8f0bc1fe7d None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:09.987185 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23868bd6-1c29-4f11-b6db-ba8f0bc1fe7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:09.988616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23868bd6-1c29-4f11-b6db-ba8f0bc1fe7d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.002826 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 407/812] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:10.004492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70951ae-a5ac-4820-b98e-1f5feaf0a499 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.005011 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70951ae-a5ac-4820-b98e-1f5feaf0a499 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.005506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70951ae-a5ac-4820-b98e-1f5feaf0a499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.030668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c70951ae-a5ac-4820-b98e-1f5feaf0a499 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:10.031882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c70951ae-a5ac-4820-b98e-1f5feaf0a499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:10.058930 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6186f-bef8-48fc-96fa-6caa419596fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.060497 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6186f-bef8-48fc-96fa-6caa419596fc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.105878 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 408/813] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:10.107027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70951ae-a5ac-4820-b98e-1f5feaf0a499 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.203445 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 406/814] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:46:10.204606 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6186f-bef8-48fc-96fa-6caa419596fc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.229559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70951ae-a5ac-4820-b98e-1f5feaf0a499 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.237827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:10.259349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:10.279276 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe19bf-f915-414d-bff6-fb4bbda0179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.280166 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe19bf-f915-414d-bff6-fb4bbda0179e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.280687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe19bf-f915-414d-bff6-fb4bbda0179e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.280999 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe19bf-f915-414d-bff6-fb4bbda0179e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.298042 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe19bf-f915-414d-bff6-fb4bbda0179e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.299933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe19bf-f915-414d-bff6-fb4bbda0179e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.320562 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6186f-bef8-48fc-96fa-6caa419596fc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.322600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a0fe19bf-f915-414d-bff6-fb4bbda0179e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:10.322600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:10.322600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:10.322600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:10.322600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:10.322600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:10.322600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:10.322600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:10.322600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:10.322600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:10.322600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:10.322600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:10.322600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:10.322600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:10.322600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:10.323670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:10.324687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:10.324687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:10.324687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:10.324687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:10.329762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 409/815] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:10.330670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe19bf-f915-414d-bff6-fb4bbda0179e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.383276 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02d428-7732-4583-9f24-a418de076d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.384286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02d428-7732-4583-9f24-a418de076d6a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.384582 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02d428-7732-4583-9f24-a418de076d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.384866 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02d428-7732-4583-9f24-a418de076d6a None admin] PATH_INFO: `/v3/services/network` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.385534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02d428-7732-4583-9f24-a418de076d6a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.387030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02d428-7732-4583-9f24-a418de076d6a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-cf02d428-7732-4583-9f24-a418de076d6a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:10.400779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:10.402912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:10.402912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:10.402912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:10.402912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:10.402912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:10.402912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:10.402912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:10.402912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:10.402912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:10.402912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:10.402912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:10.402912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:10.402912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:10.402912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:10.402912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:10.402912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:10.404938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:10.404938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:10.404938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:10.404938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:10.404938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:10.404938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:10.404938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:10.404938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:10.404938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:10.404938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:10.404938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:10.404938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:10.404938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 15:46:10.404938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:10.404938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 407/816] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:10.406766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02d428-7732-4583-9f24-a418de076d6a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.451171 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe19bf-f915-414d-bff6-fb4bbda0179e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.495014 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465130b6-8465-44b5-a064-700e08472db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.496079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465130b6-8465-44b5-a064-700e08472db3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.496652 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465130b6-8465-44b5-a064-700e08472db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.496944 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465130b6-8465-44b5-a064-700e08472db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.510412 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465130b6-8465-44b5-a064-700e08472db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.511442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:10.511873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465130b6-8465-44b5-a064-700e08472db3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.518784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02d428-7732-4583-9f24-a418de076d6a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.534106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-465130b6-8465-44b5-a064-700e08472db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:10.534106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:10.534106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:10.534106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:10.534106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:10.534106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:10.534106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:10.534106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:10.534106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:10.534106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:10.534106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:10.534106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:10.534106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:10.534106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:10.534106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:10.535059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:10.536022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:10.536022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:10.536022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:10.536022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:10.540140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 410/817] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:10.541455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465130b6-8465-44b5-a064-700e08472db3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.562928 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b1d0d-1cf1-40a3-ae9d-9da6ac528bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.563603 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b1d0d-1cf1-40a3-ae9d-9da6ac528bcf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.563895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b1d0d-1cf1-40a3-ae9d-9da6ac528bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.564285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b1d0d-1cf1-40a3-ae9d-9da6ac528bcf None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.565005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b1d0d-1cf1-40a3-ae9d-9da6ac528bcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:10.565313 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b1d0d-1cf1-40a3-ae9d-9da6ac528bcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.566959 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b1d0d-1cf1-40a3-ae9d-9da6ac528bcf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.575062 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:10.585358 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 408/818] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:10.585358 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b1d0d-1cf1-40a3-ae9d-9da6ac528bcf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.676739 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465130b6-8465-44b5-a064-700e08472db3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.696602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b1d0d-1cf1-40a3-ae9d-9da6ac528bcf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.715801 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a50b0-42db-4076-a92e-dfc11d187a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.716737 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a50b0-42db-4076-a92e-dfc11d187a25 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.717180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a50b0-42db-4076-a92e-dfc11d187a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.717638 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a50b0-42db-4076-a92e-dfc11d187a25 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.719027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a50b0-42db-4076-a92e-dfc11d187a25 None admin] RBAC: Adding query filter params (name=network) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:10.719498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a50b0-42db-4076-a92e-dfc11d187a25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.721594 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a50b0-42db-4076-a92e-dfc11d187a25 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.728964 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 411/819] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:10.730729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a50b0-42db-4076-a92e-dfc11d187a25 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.736219 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdb946-62a3-4c8d-a5e2-2e5e7e05c437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.737034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb946-62a3-4c8d-a5e2-2e5e7e05c437 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.737458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb946-62a3-4c8d-a5e2-2e5e7e05c437 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.737843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdb946-62a3-4c8d-a5e2-2e5e7e05c437 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.738726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdb946-62a3-4c8d-a5e2-2e5e7e05c437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:10.739143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdb946-62a3-4c8d-a5e2-2e5e7e05c437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.740681 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdb946-62a3-4c8d-a5e2-2e5e7e05c437 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.758478 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 409/820] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:10.758478 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdb946-62a3-4c8d-a5e2-2e5e7e05c437 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.778523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:10.843568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:10.858431 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a50b0-42db-4076-a92e-dfc11d187a25 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.876327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdb946-62a3-4c8d-a5e2-2e5e7e05c437 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:10.901188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817fb37-bb10-47f5-a54b-048f950c22ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.902015 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817fb37-bb10-47f5-a54b-048f950c22ce None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.902308 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817fb37-bb10-47f5-a54b-048f950c22ce None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.902596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817fb37-bb10-47f5-a54b-048f950c22ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.913423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817fb37-bb10-47f5-a54b-048f950c22ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.915005 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817fb37-bb10-47f5-a54b-048f950c22ce None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.916289 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf8836-5ab2-4e79-9179-e93cbeac4b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:10.917394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf8836-5ab2-4e79-9179-e93cbeac4b3c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:10.917959 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf8836-5ab2-4e79-9179-e93cbeac4b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:10.918445 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf8836-5ab2-4e79-9179-e93cbeac4b3c None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:10.919354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf8836-5ab2-4e79-9179-e93cbeac4b3c None admin] RBAC: Adding query filter params (type=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:10.919870 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf8836-5ab2-4e79-9179-e93cbeac4b3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:10.921675 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf8836-5ab2-4e79-9179-e93cbeac4b3c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:10.929128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 410/821] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:10.930325 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf8836-5ab2-4e79-9179-e93cbeac4b3c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:10.931879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d817fb37-bb10-47f5-a54b-048f950c22ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:10.931879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:10.931879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:10.931879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:10.931879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:10.931879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:10.931879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:10.931879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:10.931879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:10.931879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:10.931879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:10.931879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:10.931879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:10.931879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:10.931879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:10.931879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:10.933138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:10.934707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:10.934707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:10.934707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:10.934707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:10.934707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:10.934707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:10.934707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:10.934707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:10.934707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:10.934707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:10.934707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 412/822] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:10.938739 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817fb37-bb10-47f5-a54b-048f950c22ce None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:11.022791 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:11.046578 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf8836-5ab2-4e79-9179-e93cbeac4b3c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:11.075604 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817fb37-bb10-47f5-a54b-048f950c22ce None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:11.084335 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f7e88-890b-4a81-988a-138b55367b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:11.086185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f7e88-890b-4a81-988a-138b55367b3b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:11.086633 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f7e88-890b-4a81-988a-138b55367b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:11.087062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f7e88-890b-4a81-988a-138b55367b3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:11.095469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f7e88-890b-4a81-988a-138b55367b3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:11.097313 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f7e88-890b-4a81-988a-138b55367b3b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:11.113301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fe5f7e88-890b-4a81-988a-138b55367b3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:11.113301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:11.113301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:11.113301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:11.113301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:11.113301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:11.113301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:11.113301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:11.113301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:11.113301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:11.113301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:11.113301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:11.113301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:11.113301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:11.113301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:11.114501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:11.115612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:11.115612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:11.115612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:11.115612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:11.115612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:11.115612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:11.115612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:11.115612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:11.123295 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 411/823] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:11.124153 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f7e88-890b-4a81-988a-138b55367b3b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:11.125197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d797075-c719-4d4f-aec3-82081c67a884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:11.126113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d797075-c719-4d4f-aec3-82081c67a884 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:11.126657 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d797075-c719-4d4f-aec3-82081c67a884 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:11.127283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d797075-c719-4d4f-aec3-82081c67a884 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:11.128434 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d797075-c719-4d4f-aec3-82081c67a884 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:11.130042 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d797075-c719-4d4f-aec3-82081c67a884 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:11.200439 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 413/824] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Jun 2 15:46:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:11.201711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d797075-c719-4d4f-aec3-82081c67a884 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:11.227545 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:11.271106 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f7e88-890b-4a81-988a-138b55367b3b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:11.331961 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81f217-ecce-4fe9-bba4-08d2418eb8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:11.332674 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81f217-ecce-4fe9-bba4-08d2418eb8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:11.332965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81f217-ecce-4fe9-bba4-08d2418eb8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:11.333369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81f217-ecce-4fe9-bba4-08d2418eb8f5 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:11.334214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81f217-ecce-4fe9-bba4-08d2418eb8f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:11.335058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81f217-ecce-4fe9-bba4-08d2418eb8f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:11.336546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81f217-ecce-4fe9-bba4-08d2418eb8f5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:11.338435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:11.367295 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 412/825] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Jun 2 15:46:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:11.375872 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81f217-ecce-4fe9-bba4-08d2418eb8f5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:11.411628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d797075-c719-4d4f-aec3-82081c67a884 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:11.473265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7592ce-def8-4d07-abbb-fb66f8c1a1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:11.474124 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7592ce-def8-4d07-abbb-fb66f8c1a1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:11.474419 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7592ce-def8-4d07-abbb-fb66f8c1a1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:11.474706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7592ce-def8-4d07-abbb-fb66f8c1a1b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:11.476090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7592ce-def8-4d07-abbb-fb66f8c1a1b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:11.476415 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7592ce-def8-4d07-abbb-fb66f8c1a1b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:11.477964 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7592ce-def8-4d07-abbb-fb66f8c1a1b1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:11.491630 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 414/826] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:11.493091 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50feee7-2686-4344-b577-43cb97a58a37 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:11.493654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50feee7-2686-4344-b577-43cb97a58a37 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:11.493945 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50feee7-2686-4344-b577-43cb97a58a37 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:11.495416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 415/827] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:11.504470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50feee7-2686-4344-b577-43cb97a58a37 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:11.508812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81f217-ecce-4fe9-bba4-08d2418eb8f5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:11.549920 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72660a13-889d-4987-b0ca-abccfb76debc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:11.550716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72660a13-889d-4987-b0ca-abccfb76debc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:11.551002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72660a13-889d-4987-b0ca-abccfb76debc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:11.551278 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72660a13-889d-4987-b0ca-abccfb76debc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:11.563544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72660a13-889d-4987-b0ca-abccfb76debc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:11.565312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72660a13-889d-4987-b0ca-abccfb76debc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:11.583909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:11.585995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-72660a13-889d-4987-b0ca-abccfb76debc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:11.585995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:11.585995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:11.585995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:11.585995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:11.585995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:11.585995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:11.585995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:11.585995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:11.585995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:11.585995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:11.585995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:11.585995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:11.585995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:11.585995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:11.586939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:11.587922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:11.587922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:11.587922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:11.587922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:11.587922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 413/828] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:11.588662 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332bf6e-e7ce-44eb-9e3c-4fc2ba8df38e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:11.588775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332bf6e-e7ce-44eb-9e3c-4fc2ba8df38e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:11.588982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332bf6e-e7ce-44eb-9e3c-4fc2ba8df38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:11.607488 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6332bf6e-e7ce-44eb-9e3c-4fc2ba8df38e None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:11.608689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6332bf6e-e7ce-44eb-9e3c-4fc2ba8df38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:11.624909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50feee7-2686-4344-b577-43cb97a58a37 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:11.651925 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:11.662369 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e17d40-f8a2-4a3d-a080-c1584839be3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:11.666057 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e17d40-f8a2-4a3d-a080-c1584839be3f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:11.666057 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e17d40-f8a2-4a3d-a080-c1584839be3f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:11.666057 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e17d40-f8a2-4a3d-a080-c1584839be3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:11.666057 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e17d40-f8a2-4a3d-a080-c1584839be3f None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=2e53683ae2b34947a1550de269b74d10) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:11.666057 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e17d40-f8a2-4a3d-a080-c1584839be3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:11.666453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e17d40-f8a2-4a3d-a080-c1584839be3f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:11.672820 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 416/829] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:11 2022] GET /identity/v3/role_assignments?user.id=2e53683ae2b34947a1550de269b74d10&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:11.677693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e17d40-f8a2-4a3d-a080-c1584839be3f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:11.679121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 414/830] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:11.716498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332bf6e-e7ce-44eb-9e3c-4fc2ba8df38e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:11.803172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e17d40-f8a2-4a3d-a080-c1584839be3f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:11.838268 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:11.851428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332bf6e-e7ce-44eb-9e3c-4fc2ba8df38e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:11.854485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f911d-68b6-4a91-9c22-3fb644ac64d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:11.854485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f911d-68b6-4a91-9c22-3fb644ac64d2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:11.854485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f911d-68b6-4a91-9c22-3fb644ac64d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:11.854485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f911d-68b6-4a91-9c22-3fb644ac64d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:11.860024 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f911d-68b6-4a91-9c22-3fb644ac64d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:11.860024 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f911d-68b6-4a91-9c22-3fb644ac64d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:11.860024 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f911d-68b6-4a91-9c22-3fb644ac64d2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:11.876101 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 417/831] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:11.883699 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f911d-68b6-4a91-9c22-3fb644ac64d2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:11.898627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc2735-c3d1-4b47-a98d-d54d32984f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:11.899908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc2735-c3d1-4b47-a98d-d54d32984f39 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:11.900436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc2735-c3d1-4b47-a98d-d54d32984f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:11.900906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc2735-c3d1-4b47-a98d-d54d32984f39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:11.915296 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc2735-c3d1-4b47-a98d-d54d32984f39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:11.923786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-eecc2735-c3d1-4b47-a98d-d54d32984f39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:11.923786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:11.923786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:11.923786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:11.923786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:11.923786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:11.923786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:11.923786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:11.923786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:11.923786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:11.923786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:11.923786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:11.923786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:11.923786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:11.923786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:11.923786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:11.925073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:11.925073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:11.925073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:11.925073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:11.925073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:11.925073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:11.925073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:11.925073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:11.925073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:11.925073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:11.925073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:11.925073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:11.925073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:11.925073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:11.925073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:11.925073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:11.926310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:11.926310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:11.926310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:11.926310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:11.926310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:11.926310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:11.926310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:11.926310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:11.926310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:11.926310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:11.926310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:11.926310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:11.926310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 415/832] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:11.932673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc2735-c3d1-4b47-a98d-d54d32984f39 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:11.968916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:12.023346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f911d-68b6-4a91-9c22-3fb644ac64d2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:12.063920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379eb68-a661-4241-a5f7-56909df8617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:12.064782 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc2735-c3d1-4b47-a98d-d54d32984f39 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:12.065242 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379eb68-a661-4241-a5f7-56909df8617c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:12.065680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379eb68-a661-4241-a5f7-56909df8617c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:12.066108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379eb68-a661-4241-a5f7-56909df8617c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:12.074118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379eb68-a661-4241-a5f7-56909df8617c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:12.075950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379eb68-a661-4241-a5f7-56909df8617c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:12.092001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d379eb68-a661-4241-a5f7-56909df8617c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:12.092001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:12.092001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:12.092001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:12.092001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:12.092001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:12.092001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:12.092001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:12.092001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:12.092001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:12.092001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:12.092001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:12.092001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:12.092001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:12.092001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:12.092935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:12.093864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:12.093864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:12.093864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:12.093864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:12.093864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:12.093864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:12.093864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:12.093864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:12.100795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 418/833] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:12.102316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379eb68-a661-4241-a5f7-56909df8617c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:12.103967 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134bd53-701f-453e-bb39-a8e52b244fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:12.104672 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134bd53-701f-453e-bb39-a8e52b244fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:12.104960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134bd53-701f-453e-bb39-a8e52b244fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:12.105241 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134bd53-701f-453e-bb39-a8e52b244fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:12.105986 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134bd53-701f-453e-bb39-a8e52b244fb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:12.106592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134bd53-701f-453e-bb39-a8e52b244fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:12.108671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134bd53-701f-453e-bb39-a8e52b244fb3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:12.118908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 416/834] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:12.126852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134bd53-701f-453e-bb39-a8e52b244fb3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:12.166332 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:12.220179 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379eb68-a661-4241-a5f7-56909df8617c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:12.247215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:12.253663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134bd53-701f-453e-bb39-a8e52b244fb3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:12.257823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbad30-1610-4721-a5c2-b73cb1e2ad3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:12.258492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbad30-1610-4721-a5c2-b73cb1e2ad3e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:12.258783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbad30-1610-4721-a5c2-b73cb1e2ad3e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:12.259069 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbad30-1610-4721-a5c2-b73cb1e2ad3e None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:12.259858 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbad30-1610-4721-a5c2-b73cb1e2ad3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:12.260202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbad30-1610-4721-a5c2-b73cb1e2ad3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:12.261666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbad30-1610-4721-a5c2-b73cb1e2ad3e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:12.274543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 419/835] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:12.275553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eeae0-21d5-4e15-9201-a197ccdb6096 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:12.275849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eeae0-21d5-4e15-9201-a197ccdb6096 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:12.276162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eeae0-21d5-4e15-9201-a197ccdb6096 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:12.277609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 420/836] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:12.280215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035eeae0-21d5-4e15-9201-a197ccdb6096 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:12.293873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81030b6a-6a97-42b4-b8be-277a1ab415b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:12.294732 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81030b6a-6a97-42b4-b8be-277a1ab415b3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:12.295006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81030b6a-6a97-42b4-b8be-277a1ab415b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:12.295333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81030b6a-6a97-42b4-b8be-277a1ab415b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:12.307391 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81030b6a-6a97-42b4-b8be-277a1ab415b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:12.308887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81030b6a-6a97-42b4-b8be-277a1ab415b3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:12.327329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-81030b6a-6a97-42b4-b8be-277a1ab415b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:12.327329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:12.327329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:12.327329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:12.327329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:12.327329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:12.327329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:12.327329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:12.327329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:12.327329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:12.327329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:12.327329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:12.327329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:12.327329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:12.327329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:12.328560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:12.329480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:12.329480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:12.329480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:12.329480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:12.329480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 417/837] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:12.330356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f4d4-653d-43de-b733-88800b7f1c76 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:12.330356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f4d4-653d-43de-b733-88800b7f1c76 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:12.330620 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f4d4-653d-43de-b733-88800b7f1c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:12.347440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9b34f4d4-653d-43de-b733-88800b7f1c76 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:12.351775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9b34f4d4-653d-43de-b733-88800b7f1c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:12.406735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035eeae0-21d5-4e15-9201-a197ccdb6096 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:12.417187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:12.428141 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 418/838] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:12.429121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34f4d4-653d-43de-b733-88800b7f1c76 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:12.445281 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809ce69-4666-4097-bca5-7d550448d226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:12.446184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809ce69-4666-4097-bca5-7d550448d226 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:12.446471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809ce69-4666-4097-bca5-7d550448d226 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:12.446751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809ce69-4666-4097-bca5-7d550448d226 None admin] PATH_INFO: `/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/63b40cb0ce3b420a918ec12672c0eccc/roles/740fa9b1529f4a558de5b8987dba5ba3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:12.461371 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809ce69-4666-4097-bca5-7d550448d226 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2775777647e4323a554bb3a5d045fc0, user_id=63b40cb0ce3b420a918ec12672c0eccc, role_id=740fa9b1529f4a558de5b8987dba5ba3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:12.462811 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809ce69-4666-4097-bca5-7d550448d226 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:12.513397 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:12.530537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 421/839] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:46:12 2022] PUT /identity/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/63b40cb0ce3b420a918ec12672c0eccc/roles/740fa9b1529f4a558de5b8987dba5ba3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 15:46:12.531679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809ce69-4666-4097-bca5-7d550448d226 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:12.545767 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34f4d4-653d-43de-b733-88800b7f1c76 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:12.588173 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331245c-c165-4b84-9741-c577dd44f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:12.588865 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331245c-c165-4b84-9741-c577dd44f986 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:12.589158 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331245c-c165-4b84-9741-c577dd44f986 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:12.589445 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331245c-c165-4b84-9741-c577dd44f986 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:12.590181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331245c-c165-4b84-9741-c577dd44f986 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:12.590509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331245c-c165-4b84-9741-c577dd44f986 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:12.591916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331245c-c165-4b84-9741-c577dd44f986 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:12.609895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 419/840] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:12.611297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331245c-c165-4b84-9741-c577dd44f986 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:12.678859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809ce69-4666-4097-bca5-7d550448d226 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:12.720294 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331245c-c165-4b84-9741-c577dd44f986 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:12.729906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de1a37-c273-421e-9a44-b3e55ab8b676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:12.731127 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de1a37-c273-421e-9a44-b3e55ab8b676 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:12.731966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de1a37-c273-421e-9a44-b3e55ab8b676 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:12.732792 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de1a37-c273-421e-9a44-b3e55ab8b676 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:12.733675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de1a37-c273-421e-9a44-b3e55ab8b676 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:12.736139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de1a37-c273-421e-9a44-b3e55ab8b676 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-77de1a37-c273-421e-9a44-b3e55ab8b676 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:12.753986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:12.755085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:12.755085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:12.755085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:12.755085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:12.755085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:12.755085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:12.755085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:12.755085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:12.755085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:12.755085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:12.755085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:12.755085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:12.755085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:12.755085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:12.755085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:12.755085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:12.755949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:12.755949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:12.755949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:12.755949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:12.755949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:12.755949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:12.755949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:12.755949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:12.755949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:12.755949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:12.755949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:12.755949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:12.755949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:46:12.755949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:12.757684 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 422/841] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:12.758311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149e24d-6e93-40cf-82de-ea11e2acd59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:12.759172 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149e24d-6e93-40cf-82de-ea11e2acd59c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:12.759461 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149e24d-6e93-40cf-82de-ea11e2acd59c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:12.759735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149e24d-6e93-40cf-82de-ea11e2acd59c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:12.764101 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de1a37-c273-421e-9a44-b3e55ab8b676 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:12.773493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149e24d-6e93-40cf-82de-ea11e2acd59c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:12.774935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149e24d-6e93-40cf-82de-ea11e2acd59c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:12.779273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:12.791053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0149e24d-6e93-40cf-82de-ea11e2acd59c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:12.791053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:12.791053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:12.791053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:12.791053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:12.791053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:12.791053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:12.791053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:12.791053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:12.791053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:12.791053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:12.791053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:12.791053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:12.791053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:12.791053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:12.791053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:12.792469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:12.793663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:12.793663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:12.793663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:12.793663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:12.793663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:12.793663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:12.793663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:12.793663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:12.793663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 15:46:12.793663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:12.796129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 420/842] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:12.798296 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149e24d-6e93-40cf-82de-ea11e2acd59c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:12.800493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:12.894379 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de1a37-c273-421e-9a44-b3e55ab8b676 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:12.926702 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149e24d-6e93-40cf-82de-ea11e2acd59c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:12.936278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2706a5-a4fa-4896-9a4f-1c55710d0dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:12.936972 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2706a5-a4fa-4896-9a4f-1c55710d0dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:12.937262 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2706a5-a4fa-4896-9a4f-1c55710d0dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:12.937544 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2706a5-a4fa-4896-9a4f-1c55710d0dd2 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:12.938276 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2706a5-a4fa-4896-9a4f-1c55710d0dd2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:12.938594 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2706a5-a4fa-4896-9a4f-1c55710d0dd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:12.940743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2706a5-a4fa-4896-9a4f-1c55710d0dd2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:12.952026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 423/843] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:12.954714 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2706a5-a4fa-4896-9a4f-1c55710d0dd2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:12.977142 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e79c2-23f8-4086-8e3a-168979cbb36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:12.977902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e79c2-23f8-4086-8e3a-168979cbb36f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:12.978199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e79c2-23f8-4086-8e3a-168979cbb36f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:12.978737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e79c2-23f8-4086-8e3a-168979cbb36f None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:12.979357 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e79c2-23f8-4086-8e3a-168979cbb36f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:12.979672 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e79c2-23f8-4086-8e3a-168979cbb36f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:12.981148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e79c2-23f8-4086-8e3a-168979cbb36f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:13.001545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 421/844] 10.222.0.50 () {56 vars in 1135 bytes} [Thu Jun 2 15:46:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:13.006964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e79c2-23f8-4086-8e3a-168979cbb36f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:13.068086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:13.069918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:13.087814 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2706a5-a4fa-4896-9a4f-1c55710d0dd2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:13.126023 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e79c2-23f8-4086-8e3a-168979cbb36f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:13.133271 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2ef4c-736e-469d-9d92-eef286361d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:13.134165 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2ef4c-736e-469d-9d92-eef286361d62 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:13.135063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2ef4c-736e-469d-9d92-eef286361d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:13.135614 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2ef4c-736e-469d-9d92-eef286361d62 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:13.137014 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2ef4c-736e-469d-9d92-eef286361d62 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:13.137494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2ef4c-736e-469d-9d92-eef286361d62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:13.139700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2ef4c-736e-469d-9d92-eef286361d62 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:13.146781 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 424/845] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:13.171260 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2323b8-1ca7-4945-85f9-e64c2fbbe5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:13.172227 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2323b8-1ca7-4945-85f9-e64c2fbbe5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:13.172666 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2323b8-1ca7-4945-85f9-e64c2fbbe5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:13.173126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2323b8-1ca7-4945-85f9-e64c2fbbe5c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:13.251857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2323b8-1ca7-4945-85f9-e64c2fbbe5c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:13.253723 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2323b8-1ca7-4945-85f9-e64c2fbbe5c7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:13.316291 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:13.367799 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 422/846] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:46:13.376194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2ef4c-736e-469d-9d92-eef286361d62 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:13.483704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2ef4c-736e-469d-9d92-eef286361d62 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:13.520203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d74f2-1871-4bd0-bf67-6a7dbd30577d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:13.521181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d74f2-1871-4bd0-bf67-6a7dbd30577d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:13.521477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d74f2-1871-4bd0-bf67-6a7dbd30577d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:13.521762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d74f2-1871-4bd0-bf67-6a7dbd30577d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:13.535506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d74f2-1871-4bd0-bf67-6a7dbd30577d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:13.537071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d74f2-1871-4bd0-bf67-6a7dbd30577d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:13.555376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2b9d74f2-1871-4bd0-bf67-6a7dbd30577d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:13.555376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:13.555376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:13.555376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:13.555376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:13.555376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:13.555376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:13.555376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:13.555376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:13.555376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:13.555376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:13.555376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:13.555376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:13.555376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:13.555376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:13.556372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:13.557702 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:13.557702 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:13.557702 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:13.557702 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:13.557702 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 425/847] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:13.562518 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2323b8-1ca7-4945-85f9-e64c2fbbe5c7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:13.664221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2323b8-1ca7-4945-85f9-e64c2fbbe5c7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:13.699939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cec39-0c86-4b59-8f6d-679548a99530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:13.700639 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cec39-0c86-4b59-8f6d-679548a99530 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:13.700927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cec39-0c86-4b59-8f6d-679548a99530 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:13.701209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cec39-0c86-4b59-8f6d-679548a99530 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:13.701932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cec39-0c86-4b59-8f6d-679548a99530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:13.702245 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cec39-0c86-4b59-8f6d-679548a99530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:13.703631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cec39-0c86-4b59-8f6d-679548a99530 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:13.720307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 423/848] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:13.721703 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d74f2-1871-4bd0-bf67-6a7dbd30577d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:13.724793 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:13.837469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d74f2-1871-4bd0-bf67-6a7dbd30577d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:13.873642 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5d3c1-f3c3-4826-a149-a772c9267b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:13.874446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5d3c1-f3c3-4826-a149-a772c9267b22 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:13.874736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5d3c1-f3c3-4826-a149-a772c9267b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:13.875016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5d3c1-f3c3-4826-a149-a772c9267b22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:13.882744 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5d3c1-f3c3-4826-a149-a772c9267b22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:13.884235 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5d3c1-f3c3-4826-a149-a772c9267b22 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:13.899477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1ff5d3c1-f3c3-4826-a149-a772c9267b22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:13.899477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:13.899477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:13.899477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:13.899477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:13.899477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:13.899477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:13.899477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:13.899477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:13.899477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:13.899477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:13.899477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:13.899477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:13.899477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:13.899477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:13.900867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:13.903246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:13.903246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:13.903246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:13.903246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:13.903246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:13.903246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:13.903246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:13.903246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:13.903246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 426/849] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:13.909277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cec39-0c86-4b59-8f6d-679548a99530 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:13.946978 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:14.014922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cec39-0c86-4b59-8f6d-679548a99530 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:14.060442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f78c5-ce07-4e90-9421-702549d816be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:14.061589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f78c5-ce07-4e90-9421-702549d816be None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.062119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f78c5-ce07-4e90-9421-702549d816be None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.062636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f78c5-ce07-4e90-9421-702549d816be None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.063752 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f78c5-ce07-4e90-9421-702549d816be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:14.064183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f78c5-ce07-4e90-9421-702549d816be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:14.065826 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f78c5-ce07-4e90-9421-702549d816be None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:14.078924 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 424/850] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:14.085401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5d3c1-f3c3-4826-a149-a772c9267b22 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:14.125947 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f7e7-066f-42b8-b234-23e933db456d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.126227 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f7e7-066f-42b8-b234-23e933db456d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.126439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f7e7-066f-42b8-b234-23e933db456d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.128191 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 425/851] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:14.133104 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa5488-c9b3-4c5a-b237-5dfe6afee14c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.133398 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa5488-c9b3-4c5a-b237-5dfe6afee14c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.133679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa5488-c9b3-4c5a-b237-5dfe6afee14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.150903 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c5fa5488-c9b3-4c5a-b237-5dfe6afee14c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:14.152191 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c5fa5488-c9b3-4c5a-b237-5dfe6afee14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:14.154583 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:14.194312 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5d3c1-f3c3-4826-a149-a772c9267b22 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:14.228270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 426/852] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:14.231386 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40910ea-09ec-4307-9457-cb4eeca07585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:14.232332 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40910ea-09ec-4307-9457-cb4eeca07585 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.232831 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40910ea-09ec-4307-9457-cb4eeca07585 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.233319 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40910ea-09ec-4307-9457-cb4eeca07585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.234385 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40910ea-09ec-4307-9457-cb4eeca07585 None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=02eade9a475b4002bd3990f08f8a1198) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:14.234921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40910ea-09ec-4307-9457-cb4eeca07585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:14.236589 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40910ea-09ec-4307-9457-cb4eeca07585 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:14.244149 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 427/853] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:14 2022] GET /identity/v3/role_assignments?user.id=02eade9a475b4002bd3990f08f8a1198&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:14.252014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa5488-c9b3-4c5a-b237-5dfe6afee14c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:14.254247 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:14.363333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa5488-c9b3-4c5a-b237-5dfe6afee14c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:14.402187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd0f7e-8b45-47c0-b7ad-dede77638a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:14.402950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd0f7e-8b45-47c0-b7ad-dede77638a5a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.403237 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd0f7e-8b45-47c0-b7ad-dede77638a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.403517 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd0f7e-8b45-47c0-b7ad-dede77638a5a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.404209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd0f7e-8b45-47c0-b7ad-dede77638a5a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:14.405632 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd0f7e-8b45-47c0-b7ad-dede77638a5a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:14.419211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-82dd0f7e-8b45-47c0-b7ad-dede77638a5a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:46:14.419211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:14.419211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:14.419211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:14.419211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:14.419211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:14.419211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:14.419211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:14.419211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:46:14.419211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:14.419211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:14.419211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:14.419211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:14.419211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:14.419211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:14.419211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:14.420290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:14.420290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:14.420290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:14.420290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:14.420290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:14.420290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:14.420290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:14.420290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:14.420290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:14.420290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:14.420290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:14.420290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:14.420290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:14.420290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:14.420290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:14.420290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:14.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:14.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:14.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:14.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:14.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:14.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:14.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:14.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:14.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:14.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:14.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:14.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:14.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:14.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:46:14.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:14.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 427/854] 10.222.0.50 () {56 vars in 1132 bytes} [Thu Jun 2 15:46:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:14.426871 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40910ea-09ec-4307-9457-cb4eeca07585 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:14.533757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40910ea-09ec-4307-9457-cb4eeca07585 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:14.560188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:14.569627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbe0f7-eacd-455e-aa23-96d3a14209d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:14.570330 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbe0f7-eacd-455e-aa23-96d3a14209d0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.570618 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbe0f7-eacd-455e-aa23-96d3a14209d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.570902 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbe0f7-eacd-455e-aa23-96d3a14209d0 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.571638 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbe0f7-eacd-455e-aa23-96d3a14209d0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:14.571960 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbe0f7-eacd-455e-aa23-96d3a14209d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:14.573449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbe0f7-eacd-455e-aa23-96d3a14209d0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:14.579322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 428/855] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Jun 2 15:46:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:14.585205 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd0f7e-8b45-47c0-b7ad-dede77638a5a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:14.657731 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:14.688689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd0f7e-8b45-47c0-b7ad-dede77638a5a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:14.723543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb01835-6a55-4018-9ec2-d607e22885a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:14.724303 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb01835-6a55-4018-9ec2-d607e22885a3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.724597 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb01835-6a55-4018-9ec2-d607e22885a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.724876 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb01835-6a55-4018-9ec2-d607e22885a3 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.726101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb01835-6a55-4018-9ec2-d607e22885a3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:14.726412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb01835-6a55-4018-9ec2-d607e22885a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:14.727817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb01835-6a55-4018-9ec2-d607e22885a3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:14.733013 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 428/856] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Jun 2 15:46:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:14.920179 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b89c25-d812-4a19-8da2-dc98b14f79cb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.920665 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b89c25-d812-4a19-8da2-dc98b14f79cb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.920665 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b89c25-d812-4a19-8da2-dc98b14f79cb None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.922149 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 429/857] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:14.928203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa79e0-0704-415d-bf3f-f02878d350c6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:14.928747 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa79e0-0704-415d-bf3f-f02878d350c6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:14.929238 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa79e0-0704-415d-bf3f-f02878d350c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:14.951833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7caa79e0-0704-415d-bf3f-f02878d350c6 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:14.954257 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7caa79e0-0704-415d-bf3f-f02878d350c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:15.032613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 429/858] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:15.057872 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b89c25-d812-4a19-8da2-dc98b14f79cb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:15.168440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b89c25-d812-4a19-8da2-dc98b14f79cb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:15.205962 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b772d6-5175-4126-a10e-49998efbc435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:15.206690 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b772d6-5175-4126-a10e-49998efbc435 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.206976 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b772d6-5175-4126-a10e-49998efbc435 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.207258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b772d6-5175-4126-a10e-49998efbc435 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.218093 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b772d6-5175-4126-a10e-49998efbc435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:15.226443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-38b772d6-5175-4126-a10e-49998efbc435 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:15.226443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:15.226443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:15.226443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:15.226443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:15.226443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:15.226443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:15.226443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:15.226443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:15.226443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:15.226443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:15.226443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:15.226443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:15.226443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:15.226443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:15.226443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:15.227470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:15.227470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:15.227470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:15.227470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:15.227470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:15.227470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:15.227470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:15.227470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:15.227470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:15.227470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:15.227470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:15.227470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:15.227470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:15.227470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:15.227470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:15.227470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:15.228459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:15.228459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:15.228459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:15.228459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:15.228459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:15.228459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:15.228459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:15.228459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:15.228459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:15.228459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:15.228459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:46:15.228459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:15.228459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 430/859] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:46:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:15.235684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa79e0-0704-415d-bf3f-f02878d350c6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:15.299470 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:15.340290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa79e0-0704-415d-bf3f-f02878d350c6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:15.381907 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98d4d9-2670-4001-aaa3-10e443c81a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:15.382587 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98d4d9-2670-4001-aaa3-10e443c81a21 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.382875 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98d4d9-2670-4001-aaa3-10e443c81a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.383158 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98d4d9-2670-4001-aaa3-10e443c81a21 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.383908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98d4d9-2670-4001-aaa3-10e443c81a21 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:15.384246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98d4d9-2670-4001-aaa3-10e443c81a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:15.385637 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98d4d9-2670-4001-aaa3-10e443c81a21 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:15.394480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 430/860] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:46:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:15.401382 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b772d6-5175-4126-a10e-49998efbc435 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:15.453939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:15.511385 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b772d6-5175-4126-a10e-49998efbc435 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:15.513107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea711-f0be-4a98-8c78-a7b32654ac15 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.513499 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea711-f0be-4a98-8c78-a7b32654ac15 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.513895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dea711-f0be-4a98-8c78-a7b32654ac15 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.515680 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 431/861] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:15.521135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca00a20-8250-4630-aaba-b98d3c3e755c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.521431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca00a20-8250-4630-aaba-b98d3c3e755c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.521719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca00a20-8250-4630-aaba-b98d3c3e755c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.542623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8ca00a20-8250-4630-aaba-b98d3c3e755c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:15.544322 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8ca00a20-8250-4630-aaba-b98d3c3e755c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:15.548759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01827ab-22c1-49c4-b78a-29458bc55dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:15.549560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01827ab-22c1-49c4-b78a-29458bc55dee None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.549852 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01827ab-22c1-49c4-b78a-29458bc55dee None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.550135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01827ab-22c1-49c4-b78a-29458bc55dee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.562559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01827ab-22c1-49c4-b78a-29458bc55dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:15.564055 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01827ab-22c1-49c4-b78a-29458bc55dee None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:15.582218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a01827ab-22c1-49c4-b78a-29458bc55dee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:15.582218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:15.582218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:15.582218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:15.582218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:15.582218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:15.582218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:15.582218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:15.582218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:15.582218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:15.582218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:15.582218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:15.582218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:15.582218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:15.582218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:15.583202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:15.584602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:15.584602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:15.584602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:15.584602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:15.584602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 431/862] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:15.588899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01827ab-22c1-49c4-b78a-29458bc55dee None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:15.636465 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 432/863] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:15.657443 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca00a20-8250-4630-aaba-b98d3c3e755c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:15.716486 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01827ab-22c1-49c4-b78a-29458bc55dee None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:15.718308 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:15.742046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:15.752037 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460364e-4032-4aeb-a1f7-f35560c37730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:15.752708 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460364e-4032-4aeb-a1f7-f35560c37730 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.753001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460364e-4032-4aeb-a1f7-f35560c37730 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.753287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460364e-4032-4aeb-a1f7-f35560c37730 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.754189 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460364e-4032-4aeb-a1f7-f35560c37730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:15.755004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460364e-4032-4aeb-a1f7-f35560c37730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:15.759685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460364e-4032-4aeb-a1f7-f35560c37730 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:15.776582 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 432/864] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:15.778150 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460364e-4032-4aeb-a1f7-f35560c37730 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:15.802181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca00a20-8250-4630-aaba-b98d3c3e755c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:15.837746 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf08a85-89be-4894-b360-d270bee10130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:15.838464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf08a85-89be-4894-b360-d270bee10130 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.838760 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf08a85-89be-4894-b360-d270bee10130 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.839047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf08a85-89be-4894-b360-d270bee10130 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.839778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf08a85-89be-4894-b360-d270bee10130 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:15.841210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf08a85-89be-4894-b360-d270bee10130 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:15.893509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460364e-4032-4aeb-a1f7-f35560c37730 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:15.916562 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 433/865] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Jun 2 15:46:15 2022] POST /identity/v3/services => generated 251 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:46:15.945822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591c8e0-be35-41a4-b4d3-72d0d7fc3a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:15.951355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591c8e0-be35-41a4-b4d3-72d0d7fc3a3a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:15.951355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591c8e0-be35-41a4-b4d3-72d0d7fc3a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:15.951355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591c8e0-be35-41a4-b4d3-72d0d7fc3a3a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:15.957308 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591c8e0-be35-41a4-b4d3-72d0d7fc3a3a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:15.958865 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4591c8e0-be35-41a4-b4d3-72d0d7fc3a3a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:15.976855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4591c8e0-be35-41a4-b4d3-72d0d7fc3a3a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:15.976855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:15.976855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:15.976855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:15.976855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:15.976855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:15.976855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:15.976855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:15.976855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:15.976855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:15.976855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:15.976855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:15.976855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:15.976855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:15.976855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:15.976855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:15.977932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:15.978939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:15.978939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:15.978939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:15.978939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:15.978939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:15.978939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:15.978939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:15.978939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:15.978939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:15.978939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:15.982997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 433/866] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Jun 2 15:46:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:15.984454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf08a85-89be-4894-b360-d270bee10130 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:16.110964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf08a85-89be-4894-b360-d270bee10130 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:16.130235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:16.149378 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fd71d-56a5-4a20-91cf-ba58e602fb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:16.150021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fd71d-56a5-4a20-91cf-ba58e602fb3f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:16.155184 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fd71d-56a5-4a20-91cf-ba58e602fb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:16.155184 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fd71d-56a5-4a20-91cf-ba58e602fb3f None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:16.155184 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fd71d-56a5-4a20-91cf-ba58e602fb3f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:16.155184 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fd71d-56a5-4a20-91cf-ba58e602fb3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:16.155184 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51fd71d-56a5-4a20-91cf-ba58e602fb3f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:16.176098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 434/867] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Jun 2 15:46:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:16.177602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591c8e0-be35-41a4-b4d3-72d0d7fc3a3a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:16.199500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:16.287468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4591c8e0-be35-41a4-b4d3-72d0d7fc3a3a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:16.323736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a7f1f-f7f4-43a1-9bc2-4cd781995c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:16.324840 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a7f1f-f7f4-43a1-9bc2-4cd781995c2e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:16.325414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a7f1f-f7f4-43a1-9bc2-4cd781995c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:16.325921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a7f1f-f7f4-43a1-9bc2-4cd781995c2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:16.416321 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a7f1f-f7f4-43a1-9bc2-4cd781995c2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:16.417862 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a7f1f-f7f4-43a1-9bc2-4cd781995c2e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:16.437210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:16.521198 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 434/868] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:16 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:46:16.527609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fd71d-56a5-4a20-91cf-ba58e602fb3f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:16.634447 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fd71d-56a5-4a20-91cf-ba58e602fb3f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:16.670474 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46688097-e6b7-4ad0-897a-7e3389ddd9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:16.671642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688097-e6b7-4ad0-897a-7e3389ddd9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:16.672164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688097-e6b7-4ad0-897a-7e3389ddd9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:16.672665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46688097-e6b7-4ad0-897a-7e3389ddd9a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:16.683937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46688097-e6b7-4ad0-897a-7e3389ddd9a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:16.685703 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46688097-e6b7-4ad0-897a-7e3389ddd9a6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:16.703857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-46688097-e6b7-4ad0-897a-7e3389ddd9a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:16.703857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:16.703857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:16.703857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:16.703857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:16.703857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:16.703857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:16.703857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:16.703857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:16.703857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:16.703857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:16.703857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:16.703857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:16.703857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:16.703857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:16.704985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:16.705893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:16.705893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:16.705893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:16.705893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:16.712083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 435/869] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:16.714572 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a7f1f-f7f4-43a1-9bc2-4cd781995c2e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:16.717768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b59684-67f3-4329-ba8f-0e72134bd625 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:16.718275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b59684-67f3-4329-ba8f-0e72134bd625 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:16.718756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b59684-67f3-4329-ba8f-0e72134bd625 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:16.720612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 436/870] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:16.729645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9fc45-48cf-4aa3-9ab2-eaacca446e98 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:16.730206 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9fc45-48cf-4aa3-9ab2-eaacca446e98 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:16.730754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9fc45-48cf-4aa3-9ab2-eaacca446e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:16.749195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-37c9fc45-48cf-4aa3-9ab2-eaacca446e98 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:16.751183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-37c9fc45-48cf-4aa3-9ab2-eaacca446e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:16.775831 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:16.836775 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a7f1f-f7f4-43a1-9bc2-4cd781995c2e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:16.844005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 437/871] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:16.861245 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9fc45-48cf-4aa3-9ab2-eaacca446e98 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:16.868707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:16.885542 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f6234-d7a5-475c-afc9-aa932d525ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:16.886672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f6234-d7a5-475c-afc9-aa932d525ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:16.887213 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f6234-d7a5-475c-afc9-aa932d525ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:16.887693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f6234-d7a5-475c-afc9-aa932d525ec4 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:16.888698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f6234-d7a5-475c-afc9-aa932d525ec4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:16.889359 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f6234-d7a5-475c-afc9-aa932d525ec4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:16.891094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f6234-d7a5-475c-afc9-aa932d525ec4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:16.909352 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 435/872] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:16.910975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f6234-d7a5-475c-afc9-aa932d525ec4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:16.983828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9fc45-48cf-4aa3-9ab2-eaacca446e98 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:17.038397 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96053243-1683-4eeb-82cd-78a16cb6ceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:17.039220 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96053243-1683-4eeb-82cd-78a16cb6ceaf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:17.039507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96053243-1683-4eeb-82cd-78a16cb6ceaf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:17.039784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96053243-1683-4eeb-82cd-78a16cb6ceaf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:17.040638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96053243-1683-4eeb-82cd-78a16cb6ceaf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:17.042613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96053243-1683-4eeb-82cd-78a16cb6ceaf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:17.044832 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f6234-d7a5-475c-afc9-aa932d525ec4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-96053243-1683-4eeb-82cd-78a16cb6ceaf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:17.059855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:17.060955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:17.060955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:17.060955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:17.060955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:17.060955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:17.060955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:17.060955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:17.060955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:17.060955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:17.060955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:17.060955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:17.060955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:17.060955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:17.060955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:17.060955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:17.060955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:17.061827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:17.061827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:17.061827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:17.061827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:17.061827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:17.061827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:17.061827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:17.061827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:17.061827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:17.061827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:17.061827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:17.061827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:17.061827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:46:17.061827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:17.066368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 438/873] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Jun 2 15:46:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:17.067224 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96053243-1683-4eeb-82cd-78a16cb6ceaf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:17.089595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640df65-9df6-4c80-a881-93b1dd9a3738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:17.090389 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640df65-9df6-4c80-a881-93b1dd9a3738 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:17.090892 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640df65-9df6-4c80-a881-93b1dd9a3738 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:17.091178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640df65-9df6-4c80-a881-93b1dd9a3738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:17.101138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640df65-9df6-4c80-a881-93b1dd9a3738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:17.102525 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:17.104844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640df65-9df6-4c80-a881-93b1dd9a3738 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:17.124779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5640df65-9df6-4c80-a881-93b1dd9a3738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:17.124779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:17.124779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:17.124779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:17.124779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:17.124779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:17.124779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:17.124779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:17.124779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:17.124779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:17.124779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:17.124779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:17.124779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:17.124779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:17.124779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:17.126036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:17.127217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:17.127217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:17.127217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:17.127217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:17.127217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:17.127217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:17.127217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:17.127217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:17.128036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 436/874] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:17.129531 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cf41d-3840-4792-80d9-832c1347abb7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:17.129861 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cf41d-3840-4792-80d9-832c1347abb7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:17.130114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cf41d-3840-4792-80d9-832c1347abb7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:17.132311 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 437/875] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:17.133183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cf41d-3840-4792-80d9-832c1347abb7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:17.179005 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:17.189961 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96053243-1683-4eeb-82cd-78a16cb6ceaf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:17.224859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468fd86-10ff-4769-bdb2-89922f1c402e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:17.225539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468fd86-10ff-4769-bdb2-89922f1c402e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:17.225828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468fd86-10ff-4769-bdb2-89922f1c402e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:17.226111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468fd86-10ff-4769-bdb2-89922f1c402e None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:17.226833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468fd86-10ff-4769-bdb2-89922f1c402e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:17.227148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468fd86-10ff-4769-bdb2-89922f1c402e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:17.228600 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468fd86-10ff-4769-bdb2-89922f1c402e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:17.238061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 439/876] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Jun 2 15:46:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:17.238061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304af9c-c2cc-41f9-9596-d5496666cddb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:17.238061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304af9c-c2cc-41f9-9596-d5496666cddb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:17.238061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304af9c-c2cc-41f9-9596-d5496666cddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:17.253016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cf41d-3840-4792-80d9-832c1347abb7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:17.253442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0304af9c-c2cc-41f9-9596-d5496666cddb None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:17.254791 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0304af9c-c2cc-41f9-9596-d5496666cddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:17.292193 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cfc7f-695e-4453-a4a8-fdc86d176234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:17.293003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cfc7f-695e-4453-a4a8-fdc86d176234 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:17.293402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cfc7f-695e-4453-a4a8-fdc86d176234 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:17.293787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cfc7f-695e-4453-a4a8-fdc86d176234 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:17.294683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cfc7f-695e-4453-a4a8-fdc86d176234 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:17.295118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cfc7f-695e-4453-a4a8-fdc86d176234 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:17.296695 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cfc7f-695e-4453-a4a8-fdc86d176234 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:17.309610 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 438/877] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:17.310735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cfc7f-695e-4453-a4a8-fdc86d176234 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:17.330155 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 440/878] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:17.331254 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304af9c-c2cc-41f9-9596-d5496666cddb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:17.356690 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:17.432769 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:17.437151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cfc7f-695e-4453-a4a8-fdc86d176234 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:17.451222 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304af9c-c2cc-41f9-9596-d5496666cddb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:17.472693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b202-dcda-404c-accc-3a7d252ae1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:17.473366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b202-dcda-404c-accc-3a7d252ae1de None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:17.473658 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b202-dcda-404c-accc-3a7d252ae1de None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:17.473942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b202-dcda-404c-accc-3a7d252ae1de None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:17.474653 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667b202-dcda-404c-accc-3a7d252ae1de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:17.474966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667b202-dcda-404c-accc-3a7d252ae1de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:17.476907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667b202-dcda-404c-accc-3a7d252ae1de None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:17.481411 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 439/879] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Jun 2 15:46:17 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:17.482173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b202-dcda-404c-accc-3a7d252ae1de None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:17.500209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5235d0-2050-4eca-956a-f274bbe154d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:17.500984 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5235d0-2050-4eca-956a-f274bbe154d4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:17.501381 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5235d0-2050-4eca-956a-f274bbe154d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:17.501724 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5235d0-2050-4eca-956a-f274bbe154d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:17.502686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5235d0-2050-4eca-956a-f274bbe154d4 None admin] RBAC: Adding query filter params (role.id=740fa9b1529f4a558de5b8987dba5ba3, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=63b40cb0ce3b420a918ec12672c0eccc) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:17.503170 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5235d0-2050-4eca-956a-f274bbe154d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:17.504862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5235d0-2050-4eca-956a-f274bbe154d4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:17.524424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 441/880] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:17 2022] GET /identity/v3/role_assignments?user.id=63b40cb0ce3b420a918ec12672c0eccc&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=740fa9b1529f4a558de5b8987dba5ba3 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:17.611155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b202-dcda-404c-accc-3a7d252ae1de None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:17.657123 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14522674-c949-428e-a91d-86e237621305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:17.657824 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14522674-c949-428e-a91d-86e237621305 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:17.658114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14522674-c949-428e-a91d-86e237621305 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:17.658397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14522674-c949-428e-a91d-86e237621305 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:17.659145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14522674-c949-428e-a91d-86e237621305 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:17.660613 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14522674-c949-428e-a91d-86e237621305 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:17.762771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 440/881] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Jun 2 15:46:17 2022] POST /identity/v3/services => generated 269 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:18.386812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d679c1e-1f74-4e47-96b9-8b19689cf728 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:18.387350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d679c1e-1f74-4e47-96b9-8b19689cf728 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:18.387350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d679c1e-1f74-4e47-96b9-8b19689cf728 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:18.389091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 442/882] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:18.394847 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a092136-9415-4ff8-8929-80b4f1d25f5b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:18.395732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a092136-9415-4ff8-8929-80b4f1d25f5b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:18.396259 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a092136-9415-4ff8-8929-80b4f1d25f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:18.415253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5a092136-9415-4ff8-8929-80b4f1d25f5b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:18.418102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5a092136-9415-4ff8-8929-80b4f1d25f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:18.438252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:18.500957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 441/883] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:18.525646 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d679c1e-1f74-4e47-96b9-8b19689cf728 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:18.605752 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:18.628613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d679c1e-1f74-4e47-96b9-8b19689cf728 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:18.664468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4144c-32cd-499d-96df-6b49fd87894d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:18.665270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4144c-32cd-499d-96df-6b49fd87894d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:18.665601 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4144c-32cd-499d-96df-6b49fd87894d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:18.665884 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4144c-32cd-499d-96df-6b49fd87894d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:18.666535 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4144c-32cd-499d-96df-6b49fd87894d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:18.667904 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4144c-32cd-499d-96df-6b49fd87894d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-94d4144c-32cd-499d-96df-6b49fd87894d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:18.680261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:18.681249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:18.681249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:18.681249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:18.681249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:18.681249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:18.681249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:18.681249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:18.681249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:18.681249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:18.681249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:18.681249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:18.681249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:18.681249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:18.681249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:18.681249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:18.681249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:18.682111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:18.682111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:18.682111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:18.682111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:18.682111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:18.682111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:18.682111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:18.682111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:18.682111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:18.682111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:18.682111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:18.682111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:18.682111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:46:18.682111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:18.682111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 443/884] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:18.687835 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a092136-9415-4ff8-8929-80b4f1d25f5b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:18.806011 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a092136-9415-4ff8-8929-80b4f1d25f5b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:18.842059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20224177-5794-4ae0-9c02-dd1a811b8056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:18.842730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20224177-5794-4ae0-9c02-dd1a811b8056 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:18.843015 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20224177-5794-4ae0-9c02-dd1a811b8056 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:18.843353 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20224177-5794-4ae0-9c02-dd1a811b8056 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:18.844093 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20224177-5794-4ae0-9c02-dd1a811b8056 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:18.844454 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20224177-5794-4ae0-9c02-dd1a811b8056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:18.845833 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20224177-5794-4ae0-9c02-dd1a811b8056 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:18.851045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 442/885] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:18.856629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4144c-32cd-499d-96df-6b49fd87894d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:18.964336 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4144c-32cd-499d-96df-6b49fd87894d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:18.999148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8e6ac-029c-4244-9077-449f7f5bf77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:19.005696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8e6ac-029c-4244-9077-449f7f5bf77c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.005696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8e6ac-029c-4244-9077-449f7f5bf77c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.005696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8e6ac-029c-4244-9077-449f7f5bf77c None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.005696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8e6ac-029c-4244-9077-449f7f5bf77c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:19.005696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8e6ac-029c-4244-9077-449f7f5bf77c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:19.005696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8e6ac-029c-4244-9077-449f7f5bf77c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:19.009875 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 444/886] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:19.015333 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20224177-5794-4ae0-9c02-dd1a811b8056 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:19.032899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:19.129615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20224177-5794-4ae0-9c02-dd1a811b8056 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:19.164339 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8d15e-b176-46b6-a3b8-b53a2aee2b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:19.164987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8d15e-b176-46b6-a3b8-b53a2aee2b60 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.165271 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8d15e-b176-46b6-a3b8-b53a2aee2b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.165547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8d15e-b176-46b6-a3b8-b53a2aee2b60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.166325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8d15e-b176-46b6-a3b8-b53a2aee2b60 None admin] RBAC: Adding query filter params (interface=public, service_id=1485b9c51f644ac98f3f2976af7e005c, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:19.166636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8d15e-b176-46b6-a3b8-b53a2aee2b60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:19.168085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8d15e-b176-46b6-a3b8-b53a2aee2b60 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:19.173572 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 443/887] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Jun 2 15:46:19 2022] GET /identity/v3/endpoints?service_id=1485b9c51f644ac98f3f2976af7e005c&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:19.179471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8e6ac-029c-4244-9077-449f7f5bf77c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:19.189036 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:19.279755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8e6ac-029c-4244-9077-449f7f5bf77c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:19.318058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc798c-e110-414d-a91d-ba882948989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:19.318912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc798c-e110-414d-a91d-ba882948989a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.319199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc798c-e110-414d-a91d-ba882948989a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.319506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc798c-e110-414d-a91d-ba882948989a None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.320235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc798c-e110-414d-a91d-ba882948989a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:19.321761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc798c-e110-414d-a91d-ba882948989a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:19.327875 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 445/888] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Jun 2 15:46:19 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 15:46:19.970012 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf76495-c094-4d4e-b67e-a43624451cd8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.971063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf76495-c094-4d4e-b67e-a43624451cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.971560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf76495-c094-4d4e-b67e-a43624451cd8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.973435 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 444/889] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:19.979409 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9539-ceb3-4b03-a4f6-f9ddd88ccc2f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.980268 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9539-ceb3-4b03-a4f6-f9ddd88ccc2f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.980754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9539-ceb3-4b03-a4f6-f9ddd88ccc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.989777 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2858dcb-5ab6-4875-8963-c6b18377c311 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.990070 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2858dcb-5ab6-4875-8963-c6b18377c311 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.990357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2858dcb-5ab6-4875-8963-c6b18377c311 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:19.992632 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 445/890] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:19.998993 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf35041-08bb-44f2-b464-de3a785defa7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:19.999286 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf35041-08bb-44f2-b464-de3a785defa7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:19.999573 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf35041-08bb-44f2-b464-de3a785defa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.001280 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-24fd9539-ceb3-4b03-a4f6-f9ddd88ccc2f None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:20.002716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-24fd9539-ceb3-4b03-a4f6-f9ddd88ccc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:20.016873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bcf35041-08bb-44f2-b464-de3a785defa7 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:20.018416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bcf35041-08bb-44f2-b464-de3a785defa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:20.096850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:20.099222 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 446/891] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:20.107223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 446/892] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:20.107386 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f3a3-d6ad-421e-85ac-dd0f6a7251f9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.107386 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f3a3-d6ad-421e-85ac-dd0f6a7251f9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.107386 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f3a3-d6ad-421e-85ac-dd0f6a7251f9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.113609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda27430-53ca-464e-bea9-9d681ff6ec67 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.113908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda27430-53ca-464e-bea9-9d681ff6ec67 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.116658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda27430-53ca-464e-bea9-9d681ff6ec67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.116807 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 447/893] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:20 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:20.128772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f3a3-d6ad-421e-85ac-dd0f6a7251f9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.135494 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bda27430-53ca-464e-bea9-9d681ff6ec67 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:20.136716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bda27430-53ca-464e-bea9-9d681ff6ec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:20.141584 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:20.208285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 447/894] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:20.216899 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda27430-53ca-464e-bea9-9d681ff6ec67 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.238616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f3a3-d6ad-421e-85ac-dd0f6a7251f9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:20.272732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c4b31-2b9c-441f-9807-337b080f94b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:20.273398 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c4b31-2b9c-441f-9807-337b080f94b1 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.273685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c4b31-2b9c-441f-9807-337b080f94b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.273966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c4b31-2b9c-441f-9807-337b080f94b1 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.274688 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c4b31-2b9c-441f-9807-337b080f94b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:20.276147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c4b31-2b9c-441f-9807-337b080f94b1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:20.325153 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda27430-53ca-464e-bea9-9d681ff6ec67 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:20.348105 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 448/895] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Jun 2 15:46:20 2022] POST /identity/v3/services => generated 241 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:46:20.348105 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c4b31-2b9c-441f-9807-337b080f94b1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.367385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:20.395096 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f794c-f54c-4d58-8af8-d7ec58b07b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:20.396106 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f794c-f54c-4d58-8af8-d7ec58b07b9a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.396470 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f794c-f54c-4d58-8af8-d7ec58b07b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.397354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f794c-f54c-4d58-8af8-d7ec58b07b9a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.415551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f794c-f54c-4d58-8af8-d7ec58b07b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:20.424736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-705f794c-f54c-4d58-8af8-d7ec58b07b9a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:46:20.424736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:20.424736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:20.424736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:20.424736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:20.424736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:20.424736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:20.424736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:20.424736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:20.424736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:20.424736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:20.424736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:20.424736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:20.424736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:20.424736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:20.424736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:20.425848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:20.425848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:20.425848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:20.425848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:20.425848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:20.425848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:20.425848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:20.425848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:20.425848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:20.425848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:20.425848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:20.425848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:20.425848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:20.425848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:20.425848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:20.425848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:20.426708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:20.426708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:20.426708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:20.426708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:20.426708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:20.426708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:20.426708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:20.426708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:20.426708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:20.426708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:20.426708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:46:20.426708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:20.431537 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 448/896] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Jun 2 15:46:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:20.432206 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:20.432534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f794c-f54c-4d58-8af8-d7ec58b07b9a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.478893 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c4b31-2b9c-441f-9807-337b080f94b1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:20.521755 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e62c5e-0bba-4e48-af53-8f4a3b227b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:20.523524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e62c5e-0bba-4e48-af53-8f4a3b227b95 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.524045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e62c5e-0bba-4e48-af53-8f4a3b227b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.524600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e62c5e-0bba-4e48-af53-8f4a3b227b95 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.525468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e62c5e-0bba-4e48-af53-8f4a3b227b95 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:20.527197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e62c5e-0bba-4e48-af53-8f4a3b227b95 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:20.541595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-71e62c5e-0bba-4e48-af53-8f4a3b227b95 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:46:20.541595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:20.541595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:20.541595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:20.541595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:20.541595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:20.541595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:20.541595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:20.541595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:46:20.541595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:20.541595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:20.541595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:20.541595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:20.541595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:20.541595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:20.541595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:20.542636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:20.542636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:20.542636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:20.542636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:20.542636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:20.542636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:20.542636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:20.542636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:20.542636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:20.542636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:20.542636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:20.542636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:20.542636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:20.542636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:20.542636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:20.542636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:20.543494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:20.543494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:20.543494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:20.543494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:20.543494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:20.543494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:20.543494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:20.543494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:20.543494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:20.543494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:20.543494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:20.543494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:20.543494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:20.543494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:46:20.543494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:20.546466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 449/897] 10.222.0.50 () {56 vars in 1132 bytes} [Thu Jun 2 15:46:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:20.552769 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e62c5e-0bba-4e48-af53-8f4a3b227b95 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.554679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f794c-f54c-4d58-8af8-d7ec58b07b9a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:20.600476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bede9-1379-472a-92c4-c6cae0204762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:20.601152 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bede9-1379-472a-92c4-c6cae0204762 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.601442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bede9-1379-472a-92c4-c6cae0204762 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.601728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bede9-1379-472a-92c4-c6cae0204762 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.602482 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bede9-1379-472a-92c4-c6cae0204762 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:20.602794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bede9-1379-472a-92c4-c6cae0204762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:20.604640 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bede9-1379-472a-92c4-c6cae0204762 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:20.615641 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 449/898] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Jun 2 15:46:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:20.622147 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bede9-1379-472a-92c4-c6cae0204762 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.682498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e62c5e-0bba-4e48-af53-8f4a3b227b95 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:20.692364 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:20.717290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:20.723615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7039ef-c064-4ab7-a8d4-730eedd79883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:20.724466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7039ef-c064-4ab7-a8d4-730eedd79883 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.724881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7039ef-c064-4ab7-a8d4-730eedd79883 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.725557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7039ef-c064-4ab7-a8d4-730eedd79883 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.726365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7039ef-c064-4ab7-a8d4-730eedd79883 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:20.726580 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7039ef-c064-4ab7-a8d4-730eedd79883 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:20.727969 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7039ef-c064-4ab7-a8d4-730eedd79883 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:20.733194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 450/899] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Jun 2 15:46:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:20.735753 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bede9-1379-472a-92c4-c6cae0204762 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:20.738895 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7039ef-c064-4ab7-a8d4-730eedd79883 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.783420 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9979fc-62de-4fb0-abd1-7464cbc853d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:20.784943 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9979fc-62de-4fb0-abd1-7464cbc853d1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.785386 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9979fc-62de-4fb0-abd1-7464cbc853d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.786198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9979fc-62de-4fb0-abd1-7464cbc853d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.801712 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9979fc-62de-4fb0-abd1-7464cbc853d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:20.805294 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9979fc-62de-4fb0-abd1-7464cbc853d1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:20.825697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4c9979fc-62de-4fb0-abd1-7464cbc853d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:20.825697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:20.825697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:20.825697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:20.825697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:20.825697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:20.825697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:20.825697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:20.825697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:20.825697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:20.825697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:20.825697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:20.825697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:20.825697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:20.825697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:20.826624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:20.827534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:20.827534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:20.827534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:20.827534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:20.829994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 450/900] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:20.838547 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9979fc-62de-4fb0-abd1-7464cbc853d1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.854623 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7039ef-c064-4ab7-a8d4-730eedd79883 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:20.900963 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb7aa2-39f3-47e6-a3dd-120abd180429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:20.901643 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb7aa2-39f3-47e6-a3dd-120abd180429 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:20.901934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb7aa2-39f3-47e6-a3dd-120abd180429 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:20.902211 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb7aa2-39f3-47e6-a3dd-120abd180429 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:20.903199 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb7aa2-39f3-47e6-a3dd-120abd180429 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:20.903514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb7aa2-39f3-47e6-a3dd-120abd180429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:20.905569 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb7aa2-39f3-47e6-a3dd-120abd180429 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:20.916024 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 451/901] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Jun 2 15:46:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:20.919096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb7aa2-39f3-47e6-a3dd-120abd180429 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:20.957461 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:20.961249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9979fc-62de-4fb0-abd1-7464cbc853d1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:20.984836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:21.009005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673eef8-a75d-421d-9949-cb62fbac6fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.009822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673eef8-a75d-421d-9949-cb62fbac6fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.010181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673eef8-a75d-421d-9949-cb62fbac6fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.010534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673eef8-a75d-421d-9949-cb62fbac6fb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.011643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673eef8-a75d-421d-9949-cb62fbac6fb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:21.012052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673eef8-a75d-421d-9949-cb62fbac6fb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.013802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673eef8-a75d-421d-9949-cb62fbac6fb7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.034137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 451/902] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:21.035747 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673eef8-a75d-421d-9949-cb62fbac6fb7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.038098 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb7aa2-39f3-47e6-a3dd-120abd180429 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.083518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119c0dd-f547-40af-bc70-9ea5be31544e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.084220 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119c0dd-f547-40af-bc70-9ea5be31544e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.085112 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119c0dd-f547-40af-bc70-9ea5be31544e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.085401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119c0dd-f547-40af-bc70-9ea5be31544e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.086490 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119c0dd-f547-40af-bc70-9ea5be31544e None admin] RBAC: Adding query filter params (interface=public, service_id=32a69a7fa09b4a25b285883fffdb3204, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:21.086808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119c0dd-f547-40af-bc70-9ea5be31544e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.088477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119c0dd-f547-40af-bc70-9ea5be31544e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.095503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 452/903] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Jun 2 15:46:20 2022] GET /identity/v3/endpoints?service_id=32a69a7fa09b4a25b285883fffdb3204&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:21.102220 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119c0dd-f547-40af-bc70-9ea5be31544e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.154092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673eef8-a75d-421d-9949-cb62fbac6fb7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.190502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de79f2d-6fee-45e3-9f03-964cc497cdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.191351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de79f2d-6fee-45e3-9f03-964cc497cdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.191637 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de79f2d-6fee-45e3-9f03-964cc497cdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.191913 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de79f2d-6fee-45e3-9f03-964cc497cdb7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.200923 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de79f2d-6fee-45e3-9f03-964cc497cdb7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.202488 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de79f2d-6fee-45e3-9f03-964cc497cdb7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.219433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2de79f2d-6fee-45e3-9f03-964cc497cdb7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:21.219433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:21.219433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:21.219433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:21.219433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:21.219433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:21.219433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:21.219433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:21.219433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:21.219433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:21.219433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:21.219433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:21.219433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:21.219433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:21.219433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:21.219433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:21.220486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:21.221469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:21.221469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:21.221469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:21.221469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:21.221469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:21.221469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:21.221469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:21.221469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:21.221469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:21.221469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:21.224486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 452/904] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:21.227504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de79f2d-6fee-45e3-9f03-964cc497cdb7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.233373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119c0dd-f547-40af-bc70-9ea5be31544e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.254385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:21.263742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:21.278615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26278ec-1ad2-4d9b-a88a-b34b0e9a9d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.279642 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26278ec-1ad2-4d9b-a88a-b34b0e9a9d6f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.280302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26278ec-1ad2-4d9b-a88a-b34b0e9a9d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.280794 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26278ec-1ad2-4d9b-a88a-b34b0e9a9d6f None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.282046 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26278ec-1ad2-4d9b-a88a-b34b0e9a9d6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.283940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26278ec-1ad2-4d9b-a88a-b34b0e9a9d6f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.300102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 453/905] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 15:46:21.367541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de79f2d-6fee-45e3-9f03-964cc497cdb7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.404026 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb790b-02cf-4596-b489-dd59cf92d1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.404728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb790b-02cf-4596-b489-dd59cf92d1aa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.405017 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb790b-02cf-4596-b489-dd59cf92d1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.405301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb790b-02cf-4596-b489-dd59cf92d1aa None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.406156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb790b-02cf-4596-b489-dd59cf92d1aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:21.406473 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb790b-02cf-4596-b489-dd59cf92d1aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.407952 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb790b-02cf-4596-b489-dd59cf92d1aa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.427950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 453/906] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:21.433942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26278ec-1ad2-4d9b-a88a-b34b0e9a9d6f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.548611 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26278ec-1ad2-4d9b-a88a-b34b0e9a9d6f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.584972 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d412c-0076-430e-979c-5611646e4da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.585935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d412c-0076-430e-979c-5611646e4da8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.586439 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d412c-0076-430e-979c-5611646e4da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.586899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d412c-0076-430e-979c-5611646e4da8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.644064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:21.657825 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d412c-0076-430e-979c-5611646e4da8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.659302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d412c-0076-430e-979c-5611646e4da8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.675295 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087a628-6501-4787-baff-023ac0397ddc None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.675617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087a628-6501-4787-baff-023ac0397ddc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.675873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087a628-6501-4787-baff-023ac0397ddc None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.677505 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 454/907] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:21.683396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127b693-367e-4593-9410-9fd3d0b5c97e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.683690 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127b693-367e-4593-9410-9fd3d0b5c97e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.683978 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127b693-367e-4593-9410-9fd3d0b5c97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.700546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1127b693-367e-4593-9410-9fd3d0b5c97e None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:21.701754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1127b693-367e-4593-9410-9fd3d0b5c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:21.780016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 454/909] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:46:21.780338 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 455/909] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:21.785804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d412c-0076-430e-979c-5611646e4da8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.799232 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127b693-367e-4593-9410-9fd3d0b5c97e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.810712 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:21.896290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:21.902420 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127b693-367e-4593-9410-9fd3d0b5c97e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.915707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d412c-0076-430e-979c-5611646e4da8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:21.937558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62c3d-5f1f-420d-87d5-f0b696143307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.938677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62c3d-5f1f-420d-87d5-f0b696143307 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.939165 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62c3d-5f1f-420d-87d5-f0b696143307 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.939673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62c3d-5f1f-420d-87d5-f0b696143307 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.940597 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d62c3d-5f1f-420d-87d5-f0b696143307 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.942176 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d62c3d-5f1f-420d-87d5-f0b696143307 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-81d62c3d-5f1f-420d-87d5-f0b696143307 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:21.954710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:21.955778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:21.955778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:21.955778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:21.955778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:21.955778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:21.955778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:21.955778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:21.955778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:21.955778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:21.955778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:21.955778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:21.955778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:21.955778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:21.955778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:21.955778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:21.955778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:21.956994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:21.956994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:21.956994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:21.956994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:21.956994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:21.956994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:21.956994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:21.956994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:21.956994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:21.956994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:21.956994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:21.956994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:21.956994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 15:46:21.956994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:21.958059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683dabca-4bba-4ac7-9cd4-19629c4bee2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:21.958665 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dabca-4bba-4ac7-9cd4-19629c4bee2b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:21.958958 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dabca-4bba-4ac7-9cd4-19629c4bee2b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:21.959240 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683dabca-4bba-4ac7-9cd4-19629c4bee2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:21.961020 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 456/910] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:21.972018 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62c3d-5f1f-420d-87d5-f0b696143307 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:21.972194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683dabca-4bba-4ac7-9cd4-19629c4bee2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:21.973144 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683dabca-4bba-4ac7-9cd4-19629c4bee2b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:21.996147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-683dabca-4bba-4ac7-9cd4-19629c4bee2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:21.996147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:21.996147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:21.996147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:21.996147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:21.996147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:21.996147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:21.996147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:21.996147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:21.996147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:21.996147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:21.996147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:21.996147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:21.996147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:21.996147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:21.997536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:21.998440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:21.998440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:21.998440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:21.998440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:22.000080 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 455/911] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:22.004584 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683dabca-4bba-4ac7-9cd4-19629c4bee2b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:22.046244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:22.079013 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62c3d-5f1f-420d-87d5-f0b696143307 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.121676 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6b102-1536-48d0-a2c3-fd8229021876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:22.122970 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6b102-1536-48d0-a2c3-fd8229021876 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.123564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6b102-1536-48d0-a2c3-fd8229021876 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.124134 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6b102-1536-48d0-a2c3-fd8229021876 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.124870 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6b102-1536-48d0-a2c3-fd8229021876 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:22.125175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6b102-1536-48d0-a2c3-fd8229021876 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:22.128577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6b102-1536-48d0-a2c3-fd8229021876 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:22.134541 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683dabca-4bba-4ac7-9cd4-19629c4bee2b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.142252 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 457/912] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:22.148361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6b102-1536-48d0-a2c3-fd8229021876 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:22.179002 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb7f6e-2006-4228-a73e-df1867473a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:22.180252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb7f6e-2006-4228-a73e-df1867473a6b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.180688 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb7f6e-2006-4228-a73e-df1867473a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.181128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb7f6e-2006-4228-a73e-df1867473a6b None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.182158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb7f6e-2006-4228-a73e-df1867473a6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:22.182952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb7f6e-2006-4228-a73e-df1867473a6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:22.184951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb7f6e-2006-4228-a73e-df1867473a6b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:22.194853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:22.203562 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 456/913] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:22.209159 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb7f6e-2006-4228-a73e-df1867473a6b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:22.267453 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6b102-1536-48d0-a2c3-fd8229021876 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.304289 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc7836-5c28-4bed-acf0-9a3ee4b311d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:22.304987 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc7836-5c28-4bed-acf0-9a3ee4b311d8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.305278 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc7836-5c28-4bed-acf0-9a3ee4b311d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.305561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc7836-5c28-4bed-acf0-9a3ee4b311d8 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.306268 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc7836-5c28-4bed-acf0-9a3ee4b311d8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:22.306580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc7836-5c28-4bed-acf0-9a3ee4b311d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:22.307970 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc7836-5c28-4bed-acf0-9a3ee4b311d8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:22.310136 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:22.314539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 458/914] 10.222.0.50 () {56 vars in 1114 bytes} [Thu Jun 2 15:46:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:22.325416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc7836-5c28-4bed-acf0-9a3ee4b311d8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:22.346508 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb7f6e-2006-4228-a73e-df1867473a6b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.393658 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc164a-8919-490c-97f9-4181ceb54ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:22.394468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc164a-8919-490c-97f9-4181ceb54ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.394908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc164a-8919-490c-97f9-4181ceb54ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.395197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc164a-8919-490c-97f9-4181ceb54ac0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.404208 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc164a-8919-490c-97f9-4181ceb54ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:22.406036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc164a-8919-490c-97f9-4181ceb54ac0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:22.423424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-85bc164a-8919-490c-97f9-4181ceb54ac0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:22.423424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:22.423424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:22.423424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:22.423424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:22.423424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:22.423424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:22.423424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:22.423424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:22.423424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:22.423424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:22.423424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:22.423424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:22.423424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:22.423424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:22.424553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:22.425451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:22.425451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:22.425451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:22.425451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:22.425451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:22.425451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:22.425451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:22.425451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:22.428725 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 457/915] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:22.432264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc164a-8919-490c-97f9-4181ceb54ac0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:22.458581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc7836-5c28-4bed-acf0-9a3ee4b311d8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.501661 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:22.508905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea1674-61ad-4f8a-894e-9af195fdd72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:22.509725 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea1674-61ad-4f8a-894e-9af195fdd72e None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.510019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea1674-61ad-4f8a-894e-9af195fdd72e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.510301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea1674-61ad-4f8a-894e-9af195fdd72e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.511042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea1674-61ad-4f8a-894e-9af195fdd72e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:22.512478 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea1674-61ad-4f8a-894e-9af195fdd72e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:22.552926 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc164a-8919-490c-97f9-4181ceb54ac0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.604027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 459/916] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Jun 2 15:46:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:22.613824 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88671fe4-3ef9-4560-8a2e-4d0af9d7d30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:22.614508 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88671fe4-3ef9-4560-8a2e-4d0af9d7d30f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.614846 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88671fe4-3ef9-4560-8a2e-4d0af9d7d30f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.615135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88671fe4-3ef9-4560-8a2e-4d0af9d7d30f None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.616560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88671fe4-3ef9-4560-8a2e-4d0af9d7d30f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:22.616878 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88671fe4-3ef9-4560-8a2e-4d0af9d7d30f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:22.618416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88671fe4-3ef9-4560-8a2e-4d0af9d7d30f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:22.633747 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 458/917] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:22.639715 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea1674-61ad-4f8a-894e-9af195fdd72e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:22.700545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:22.710760 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0be8c8-a563-45c6-98cf-84e47ccc620c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.711191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0be8c8-a563-45c6-98cf-84e47ccc620c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.711574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0be8c8-a563-45c6-98cf-84e47ccc620c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.713419 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 459/918] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:22.719364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fe926-b51f-47e8-a11f-22eee41565ca None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.721957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fe926-b51f-47e8-a11f-22eee41565ca None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.721957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fe926-b51f-47e8-a11f-22eee41565ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.737944 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0d2fe926-b51f-47e8-a11f-22eee41565ca None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:22.739603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0d2fe926-b51f-47e8-a11f-22eee41565ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:22.760197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea1674-61ad-4f8a-894e-9af195fdd72e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.809709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de321a4f-81f2-4a0f-a1e4-6d8a8fca774d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:22.810385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de321a4f-81f2-4a0f-a1e4-6d8a8fca774d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:22.810670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de321a4f-81f2-4a0f-a1e4-6d8a8fca774d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:22.810948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de321a4f-81f2-4a0f-a1e4-6d8a8fca774d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:22.811782 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de321a4f-81f2-4a0f-a1e4-6d8a8fca774d None admin] RBAC: Adding query filter params (role.id=217a9a10dcf94e6fb5108443d1f55d92, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=63b40cb0ce3b420a918ec12672c0eccc) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:22.812332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de321a4f-81f2-4a0f-a1e4-6d8a8fca774d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:22.813777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de321a4f-81f2-4a0f-a1e4-6d8a8fca774d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:22.821174 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 460/919] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:22 2022] GET /identity/v3/role_assignments?user.id=63b40cb0ce3b420a918ec12672c0eccc&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=217a9a10dcf94e6fb5108443d1f55d92 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:22.830849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 460/920] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:22.855333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de321a4f-81f2-4a0f-a1e4-6d8a8fca774d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:22.971206 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de321a4f-81f2-4a0f-a1e4-6d8a8fca774d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:22.994298 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:23.010874 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6413ba1-b93c-431f-b272-884be9e26d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:23.011707 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6413ba1-b93c-431f-b272-884be9e26d79 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:23.012021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6413ba1-b93c-431f-b272-884be9e26d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:23.012303 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6413ba1-b93c-431f-b272-884be9e26d79 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:23.012969 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6413ba1-b93c-431f-b272-884be9e26d79 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:23.014367 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6413ba1-b93c-431f-b272-884be9e26d79 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a6413ba1-b93c-431f-b272-884be9e26d79 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:23.028563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:23.029699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:23.029699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:23.029699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:23.029699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:23.029699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:23.029699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:23.029699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:23.029699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:23.029699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:23.029699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:23.029699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:23.029699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:23.029699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:23.029699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:23.029699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:23.029699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:23.030664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:23.030664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:23.030664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:23.030664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:23.030664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:23.030664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:23.030664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:23.030664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:23.030664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:23.030664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:23.030664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:23.030664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:23.030664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:46:23.030664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:23.038511 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 461/921] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Jun 2 15:46:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:23.039658 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fe926-b51f-47e8-a11f-22eee41565ca None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:23.088654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:23.145154 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fe926-b51f-47e8-a11f-22eee41565ca None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:23.181164 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4390915-c6c8-46ad-bd09-7172f5eeee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:23.181839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4390915-c6c8-46ad-bd09-7172f5eeee6a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:23.182128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4390915-c6c8-46ad-bd09-7172f5eeee6a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:23.182407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4390915-c6c8-46ad-bd09-7172f5eeee6a None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:23.183117 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4390915-c6c8-46ad-bd09-7172f5eeee6a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:23.183433 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4390915-c6c8-46ad-bd09-7172f5eeee6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:23.184856 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4390915-c6c8-46ad-bd09-7172f5eeee6a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:23.190338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 461/922] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Jun 2 15:46:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:23.197348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6413ba1-b93c-431f-b272-884be9e26d79 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:23.314910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6413ba1-b93c-431f-b272-884be9e26d79 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:23.363934 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd2900-769a-44ec-88ab-7f5abcee0874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:23.364804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd2900-769a-44ec-88ab-7f5abcee0874 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:23.365094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd2900-769a-44ec-88ab-7f5abcee0874 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:23.365377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd2900-769a-44ec-88ab-7f5abcee0874 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:23.366721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd2900-769a-44ec-88ab-7f5abcee0874 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:23.367062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd2900-769a-44ec-88ab-7f5abcee0874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:23.368598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd2900-769a-44ec-88ab-7f5abcee0874 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:23.375575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 462/923] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Jun 2 15:46:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:23.382876 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4390915-c6c8-46ad-bd09-7172f5eeee6a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:23.487628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4390915-c6c8-46ad-bd09-7172f5eeee6a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:23.501591 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:23.530897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1737a6-192e-4ef4-8da1-2e96c9029aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:23.531567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1737a6-192e-4ef4-8da1-2e96c9029aaf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:23.531855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1737a6-192e-4ef4-8da1-2e96c9029aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:23.532172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1737a6-192e-4ef4-8da1-2e96c9029aaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:23.532966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1737a6-192e-4ef4-8da1-2e96c9029aaf None admin] RBAC: Adding query filter params (interface=public, service_id=fcbcec0d540a4f819c18281aa64dda84, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:23.533377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1737a6-192e-4ef4-8da1-2e96c9029aaf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:23.534777 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1737a6-192e-4ef4-8da1-2e96c9029aaf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:23.540676 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 462/924] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Jun 2 15:46:23 2022] GET /identity/v3/endpoints?service_id=fcbcec0d540a4f819c18281aa64dda84&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:23.549369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd2900-769a-44ec-88ab-7f5abcee0874 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:23.609996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:23.667302 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd2900-769a-44ec-88ab-7f5abcee0874 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:23.704756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b17719-88ff-4c9e-a735-440e86201793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:23.705426 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b17719-88ff-4c9e-a735-440e86201793 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:23.705712 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b17719-88ff-4c9e-a735-440e86201793 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:23.705992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b17719-88ff-4c9e-a735-440e86201793 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:23.706671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b17719-88ff-4c9e-a735-440e86201793 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:23.708071 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b17719-88ff-4c9e-a735-440e86201793 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:23.716144 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 463/925] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Jun 2 15:46:23 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 15:46:23.737276 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855f4a6-51c5-438c-894b-f2e45ba9f5d5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:23.737593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855f4a6-51c5-438c-894b-f2e45ba9f5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:23.737850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855f4a6-51c5-438c-894b-f2e45ba9f5d5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:23.739552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 463/926] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:23.745713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af021e-23e2-499a-9e90-fcfbc5dddef2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:23.746028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af021e-23e2-499a-9e90-fcfbc5dddef2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:23.746294 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af021e-23e2-499a-9e90-fcfbc5dddef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:23.769126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d2af021e-23e2-499a-9e90-fcfbc5dddef2 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:23.770395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d2af021e-23e2-499a-9e90-fcfbc5dddef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:23.854284 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 464/927] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:23.881560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855f4a6-51c5-438c-894b-f2e45ba9f5d5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:24.004810 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855f4a6-51c5-438c-894b-f2e45ba9f5d5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:24.046434 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab464a74-d604-4db3-8476-cf3cdaf6e600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:24.047254 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab464a74-d604-4db3-8476-cf3cdaf6e600 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:24.047550 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab464a74-d604-4db3-8476-cf3cdaf6e600 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:24.047823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab464a74-d604-4db3-8476-cf3cdaf6e600 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:24.048549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab464a74-d604-4db3-8476-cf3cdaf6e600 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:24.049925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab464a74-d604-4db3-8476-cf3cdaf6e600 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:24.063142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ab464a74-d604-4db3-8476-cf3cdaf6e600 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:46:24.063142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:24.063142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:24.063142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:24.063142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:24.063142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:24.063142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:24.063142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:24.063142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:46:24.063142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:24.063142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:24.063142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:24.063142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:24.063142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:24.063142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:24.063142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:24.064350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:24.064350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:24.064350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:24.064350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:24.064350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:24.064350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:24.064350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:24.064350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:24.064350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:24.064350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:24.064350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:24.064350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:24.064350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:24.064350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:24.064350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:24.064350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:24.065357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:24.065357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:24.065357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:24.065357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:24.065357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:24.065357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:24.065357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:24.065357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:24.065357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:24.065357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:24.065357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:24.065357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:24.065357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:24.065357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 15:46:24.065357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:24.065357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 464/928] 10.222.0.50 () {56 vars in 1132 bytes} [Thu Jun 2 15:46:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:24.072212 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af021e-23e2-499a-9e90-fcfbc5dddef2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:24.123372 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:24.198604 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af021e-23e2-499a-9e90-fcfbc5dddef2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:24.236730 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e301dd7-0579-4665-9c8c-eb46137865fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:24.237870 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e301dd7-0579-4665-9c8c-eb46137865fb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:24.238364 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e301dd7-0579-4665-9c8c-eb46137865fb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:24.238730 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e301dd7-0579-4665-9c8c-eb46137865fb None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:24.239604 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e301dd7-0579-4665-9c8c-eb46137865fb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:24.239918 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e301dd7-0579-4665-9c8c-eb46137865fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:24.241884 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e301dd7-0579-4665-9c8c-eb46137865fb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:24.247544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 465/929] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Jun 2 15:46:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:24.253395 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab464a74-d604-4db3-8476-cf3cdaf6e600 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:24.291300 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:24.364951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab464a74-d604-4db3-8476-cf3cdaf6e600 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:24.402578 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d951032-cb9c-43cf-8685-90d7460c88da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:24.403256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d951032-cb9c-43cf-8685-90d7460c88da None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:24.403594 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d951032-cb9c-43cf-8685-90d7460c88da None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:24.403888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d951032-cb9c-43cf-8685-90d7460c88da None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:24.404694 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d951032-cb9c-43cf-8685-90d7460c88da None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:24.405892 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d951032-cb9c-43cf-8685-90d7460c88da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:24.406389 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d951032-cb9c-43cf-8685-90d7460c88da None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:24.412009 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 465/930] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Jun 2 15:46:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:24.417993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e301dd7-0579-4665-9c8c-eb46137865fb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:24.525188 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e301dd7-0579-4665-9c8c-eb46137865fb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:24.536944 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:24.564547 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaad00f-7731-4b5b-90f5-b61259d740a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:24.565219 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaad00f-7731-4b5b-90f5-b61259d740a0 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:24.565904 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaad00f-7731-4b5b-90f5-b61259d740a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:24.565904 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaad00f-7731-4b5b-90f5-b61259d740a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:24.566519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaad00f-7731-4b5b-90f5-b61259d740a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:24.567901 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaad00f-7731-4b5b-90f5-b61259d740a0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:24.670098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 466/931] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Jun 2 15:46:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:25.126472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd46b-bec2-4beb-8894-60f65b4ff31f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.127041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd46b-bec2-4beb-8894-60f65b4ff31f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.127041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacd46b-bec2-4beb-8894-60f65b4ff31f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.128832 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 466/932] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:25.134899 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b44b33-542b-4518-94c4-f263566f2c12 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.135189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b44b33-542b-4518-94c4-f263566f2c12 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.135471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b44b33-542b-4518-94c4-f263566f2c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.152525 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-98b44b33-542b-4518-94c4-f263566f2c12 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:25.153704 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-98b44b33-542b-4518-94c4-f263566f2c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:25.236099 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 467/933] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:25.251681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacd46b-bec2-4beb-8894-60f65b4ff31f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:25.278961 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e61968-2992-4f33-99f1-4435acf568b3 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.279261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e61968-2992-4f33-99f1-4435acf568b3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.279523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e61968-2992-4f33-99f1-4435acf568b3 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.281238 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 468/934] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:25.291344 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c70a55-c7bb-4dea-88c7-ef23df94bbcb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.291769 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c70a55-c7bb-4dea-88c7-ef23df94bbcb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.292300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c70a55-c7bb-4dea-88c7-ef23df94bbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.314231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-36c70a55-c7bb-4dea-88c7-ef23df94bbcb None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:25.316092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-36c70a55-c7bb-4dea-88c7-ef23df94bbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:25.376993 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:25.381123 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacd46b-bec2-4beb-8894-60f65b4ff31f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:25.408007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 469/935] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:25.419275 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf64cb-86e0-4e32-beb8-465a907f3096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:25.420124 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf64cb-86e0-4e32-beb8-465a907f3096 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.420418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf64cb-86e0-4e32-beb8-465a907f3096 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.420702 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf64cb-86e0-4e32-beb8-465a907f3096 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.429248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c70a55-c7bb-4dea-88c7-ef23df94bbcb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:25.437291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf64cb-86e0-4e32-beb8-465a907f3096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:25.446552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a2bf64cb-86e0-4e32-beb8-465a907f3096 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:46:25.446552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:25.446552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:25.446552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:25.446552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:25.446552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:25.446552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:25.446552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:25.446552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:25.446552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:25.446552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:25.446552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:25.446552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:25.446552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:25.446552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:25.446552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:25.447519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:25.447519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:25.447519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:25.447519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:25.447519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:25.447519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:25.447519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:25.447519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:25.447519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:25.447519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:25.447519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:25.447519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:25.447519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:25.447519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:25.447519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:25.447519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:25.448414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:25.448414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:25.448414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:25.448414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:25.448414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:25.448414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:25.448414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:25.448414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:25.448414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:25.448414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:25.448414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:46:25.448414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:25.451155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 467/936] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Jun 2 15:46:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:25.452414 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:25.458553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf64cb-86e0-4e32-beb8-465a907f3096 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:25.553787 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c70a55-c7bb-4dea-88c7-ef23df94bbcb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:25.578640 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf64cb-86e0-4e32-beb8-465a907f3096 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:25.601809 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab9350-3b89-464b-a4ed-6d4e08beb2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:25.603135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab9350-3b89-464b-a4ed-6d4e08beb2c0 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.603634 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab9350-3b89-464b-a4ed-6d4e08beb2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.604329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab9350-3b89-464b-a4ed-6d4e08beb2c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.605890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab9350-3b89-464b-a4ed-6d4e08beb2c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:25.608190 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab9350-3b89-464b-a4ed-6d4e08beb2c0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:25.610300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: WARNING keystone.server.flask.common [None req-0bab9350-3b89-464b-a4ed-6d4e08beb2c0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 15:46:25.615572 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dca99-728f-495c-abc8-8ad18fc6242c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:25.616278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dca99-728f-495c-abc8-8ad18fc6242c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.616572 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dca99-728f-495c-abc8-8ad18fc6242c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.616938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dca99-728f-495c-abc8-8ad18fc6242c None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.617683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53dca99-728f-495c-abc8-8ad18fc6242c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:25.617992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53dca99-728f-495c-abc8-8ad18fc6242c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:25.619719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53dca99-728f-495c-abc8-8ad18fc6242c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:25.629790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 468/937] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Jun 2 15:46:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:25.635817 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dca99-728f-495c-abc8-8ad18fc6242c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:25.661403 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:25.667506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.sql.core [None req-0bab9350-3b89-464b-a4ed-6d4e08beb2c0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 15:46:25.667506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 15:46:25.667506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [parameters: {'id': '96442aef323d4cef86f22da35ea4fe9f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 15:46:25.667506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80315) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 15:46:25.684005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0bab9350-3b89-464b-a4ed-6d4e08beb2c0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 96442aef323d4cef86f22da35ea4fe9f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 96442aef323d4cef86f22da35ea4fe9f. Jun 02 15:46:25.684005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:25.684005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 15:46:25.684005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 15:46:25.684005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 15:46:25.684005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 15:46:25.684005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 15:46:25.684005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 15:46:25.684005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 15:46:25.684005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application conn.query(q) Jun 02 15:46:25.684005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 15:46:25.684005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 15:46:25.684005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result.read() Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 02 15:46:25.684910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application next(self.gen) Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application yield resource Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application next(self.gen) Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise self.value Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application session.commit() Jun 02 15:46:25.685948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.session.flush() Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application compat.raise_( Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 15:46:25.687458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 15:46:25.688668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 15:46:25.688668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 15:46:25.688668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 15:46:25.688668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 15:46:25.688668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 15:46:25.688668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 15:46:25.688668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 15:46:25.688668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 15:46:25.688668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 15:46:25.688668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 15:46:25.688668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 15:46:25.688668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 15:46:25.688668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 15:46:25.688668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 15:46:25.688668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application conn.query(q) Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result.read() Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 15:46:25.689469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 15:46:25.691514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 15:46:25.691514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 15:46:25.691514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 15:46:25.691514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 15:46:25.691514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 15:46:25.691514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 15:46:25.691514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 15:46:25.691514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 15:46:25.691514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [parameters: {'id': '96442aef323d4cef86f22da35ea4fe9f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 15:46:25.691514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 15:46:25.691514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:25.691514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:25.691514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:25.691514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:25.691514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:25.693387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:25.696905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:25.696905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 02 15:46:25.696905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 02 15:46:25.696905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:25.696905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:25.696905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 02 15:46:25.696905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 02 15:46:25.696905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 96442aef323d4cef86f22da35ea4fe9f. Jun 02 15:46:25.696905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:25.696905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 470/938] 10.222.0.50 () {60 vars in 1140 bytes} [Thu Jun 2 15:46:25 2022] POST /identity/v3/projects => generated 262 bytes in 257 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:25.696905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab9350-3b89-464b-a4ed-6d4e08beb2c0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:25.768005 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dca99-728f-495c-abc8-8ad18fc6242c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:25.792819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:25.804534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7ca1f-1b63-458f-8c63-70962662ad00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:25.809288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7ca1f-1b63-458f-8c63-70962662ad00 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.809288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7ca1f-1b63-458f-8c63-70962662ad00 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.809288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7ca1f-1b63-458f-8c63-70962662ad00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.817897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7ca1f-1b63-458f-8c63-70962662ad00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:25.820075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7ca1f-1b63-458f-8c63-70962662ad00 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:25.826920 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab9350-3b89-464b-a4ed-6d4e08beb2c0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:25.841481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3bc7ca1f-1b63-458f-8c63-70962662ad00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:25.841481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:25.841481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:25.841481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:25.841481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:25.841481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:25.841481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:25.841481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:25.841481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:25.841481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:25.841481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:25.841481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:25.841481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:25.841481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:25.841481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:25.844357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:25.845520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:25.845520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:25.845520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:25.845520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:25.845520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 469/939] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:25.849616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7ca1f-1b63-458f-8c63-70962662ad00 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:25.877074 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dee7f-76e8-4c70-a1f3-25319971bb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:25.878370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dee7f-76e8-4c70-a1f3-25319971bb0a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:25.878876 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dee7f-76e8-4c70-a1f3-25319971bb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:25.879352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dee7f-76e8-4c70-a1f3-25319971bb0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:25.887618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68dee7f-76e8-4c70-a1f3-25319971bb0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:25.889806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68dee7f-76e8-4c70-a1f3-25319971bb0a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:25.904893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e68dee7f-76e8-4c70-a1f3-25319971bb0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:25.904893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:25.904893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:25.904893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:25.904893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:25.904893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:25.904893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:25.904893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:25.904893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:25.904893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:25.904893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:25.904893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:25.904893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:25.904893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:25.904893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:25.905852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:25.906754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:25.906754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:25.906754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:25.906754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:25.906754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:25.906754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:25.906754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:25.906754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:25.914241 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 471/940] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:25.916415 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dee7f-76e8-4c70-a1f3-25319971bb0a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:25.937955 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:25.969709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7ca1f-1b63-458f-8c63-70962662ad00 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.009557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81478c-abbc-4646-a39a-460150ce35be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.010578 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81478c-abbc-4646-a39a-460150ce35be None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.011090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81478c-abbc-4646-a39a-460150ce35be None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.011573 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81478c-abbc-4646-a39a-460150ce35be None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.012572 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81478c-abbc-4646-a39a-460150ce35be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:26.013111 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81478c-abbc-4646-a39a-460150ce35be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.014694 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81478c-abbc-4646-a39a-460150ce35be None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.028368 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 470/941] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:26.034408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81478c-abbc-4646-a39a-460150ce35be None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.041166 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dee7f-76e8-4c70-a1f3-25319971bb0a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.078440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e3051-cbf9-44a0-b52e-57e5e9e7518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.079514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e3051-cbf9-44a0-b52e-57e5e9e7518c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.080090 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e3051-cbf9-44a0-b52e-57e5e9e7518c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.080722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e3051-cbf9-44a0-b52e-57e5e9e7518c None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.081791 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e3051-cbf9-44a0-b52e-57e5e9e7518c None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:26.082323 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e3051-cbf9-44a0-b52e-57e5e9e7518c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.084124 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e3051-cbf9-44a0-b52e-57e5e9e7518c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.086392 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:26.115241 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 472/942] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:26.143602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81478c-abbc-4646-a39a-460150ce35be None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.174575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eed6a-99a5-4817-a941-3eb61f54fde1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.174866 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eed6a-99a5-4817-a941-3eb61f54fde1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.175209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0eed6a-99a5-4817-a941-3eb61f54fde1 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.177047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 473/943] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:26.182727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e790c-12fb-4419-b2ce-06f4bb43e35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.183249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67823d-f45f-44cb-9dc8-a101851116d6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.183542 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e790c-12fb-4419-b2ce-06f4bb43e35e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.183687 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67823d-f45f-44cb-9dc8-a101851116d6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.183821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67823d-f45f-44cb-9dc8-a101851116d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.183950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e790c-12fb-4419-b2ce-06f4bb43e35e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.184142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e790c-12fb-4419-b2ce-06f4bb43e35e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.186876 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:26.195647 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e790c-12fb-4419-b2ce-06f4bb43e35e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.195647 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e790c-12fb-4419-b2ce-06f4bb43e35e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.208893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ca67823d-f45f-44cb-9dc8-a101851116d6 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:26.210882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ca67823d-f45f-44cb-9dc8-a101851116d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:26.212465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-098e790c-12fb-4419-b2ce-06f4bb43e35e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:26.212465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:26.212465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:26.212465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:26.212465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:26.212465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:26.212465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:26.212465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:26.212465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:26.212465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:26.212465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:26.212465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:26.212465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:26.212465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:26.212465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:26.212465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:26.213418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:26.214397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:26.214397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:26.214397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:26.214397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:26.214397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:26.214397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:26.214397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:26.214397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:26.214397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:26.214397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:26.218716 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 471/944] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:26.220242 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e790c-12fb-4419-b2ce-06f4bb43e35e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.302888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 474/945] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:26.328972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67823d-f45f-44cb-9dc8-a101851116d6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.344531 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e790c-12fb-4419-b2ce-06f4bb43e35e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.388753 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce225be4-3db3-406c-b188-a1a687689033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.389533 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce225be4-3db3-406c-b188-a1a687689033 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.389866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce225be4-3db3-406c-b188-a1a687689033 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.390098 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce225be4-3db3-406c-b188-a1a687689033 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.390931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce225be4-3db3-406c-b188-a1a687689033 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:26.391244 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce225be4-3db3-406c-b188-a1a687689033 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.392898 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce225be4-3db3-406c-b188-a1a687689033 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.417482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 472/946] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:26.424774 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce225be4-3db3-406c-b188-a1a687689033 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.451776 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67823d-f45f-44cb-9dc8-a101851116d6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.481430 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:26.491524 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:26.504965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa84da-8300-457a-bba9-ae4f0cb3d562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.511330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa84da-8300-457a-bba9-ae4f0cb3d562 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.511330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa84da-8300-457a-bba9-ae4f0cb3d562 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.511330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa84da-8300-457a-bba9-ae4f0cb3d562 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.511330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa84da-8300-457a-bba9-ae4f0cb3d562 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.511330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa84da-8300-457a-bba9-ae4f0cb3d562 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9daa84da-8300-457a-bba9-ae4f0cb3d562 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:26.521551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:26.522728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:26.522728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:26.522728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:26.522728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:26.522728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:26.522728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:26.522728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:26.522728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:26.522728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:26.522728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:26.522728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:26.522728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:26.522728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:26.522728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:26.522728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:26.522728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:26.523598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:26.523598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:26.523598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:26.523598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:26.523598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:26.523598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:26.523598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:26.523598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:26.523598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:26.523598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:26.523598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:26.523598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:26.523598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:46:26.523598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:26.523598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 475/947] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:26.531095 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa84da-8300-457a-bba9-ae4f0cb3d562 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.540547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce225be4-3db3-406c-b188-a1a687689033 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.578358 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb579604-1e8f-44e1-9c71-ed4bcf09a548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.579511 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb579604-1e8f-44e1-9c71-ed4bcf09a548 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.580063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb579604-1e8f-44e1-9c71-ed4bcf09a548 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.580583 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb579604-1e8f-44e1-9c71-ed4bcf09a548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.592525 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb579604-1e8f-44e1-9c71-ed4bcf09a548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.594303 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb579604-1e8f-44e1-9c71-ed4bcf09a548 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.613759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-eb579604-1e8f-44e1-9c71-ed4bcf09a548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:26.613759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:26.613759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:26.613759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:26.613759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:26.613759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:26.613759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:26.613759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:26.613759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:26.613759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:26.613759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:26.613759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:26.613759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:26.613759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:26.613759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:26.614752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:26.615752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:26.615752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:26.615752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:26.615752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:26.618079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 473/948] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:26.624101 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb579604-1e8f-44e1-9c71-ed4bcf09a548 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.641347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa84da-8300-457a-bba9-ae4f0cb3d562 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.683337 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a3ff7-276e-4f3d-b846-c16bf59a3653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.684648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a3ff7-276e-4f3d-b846-c16bf59a3653 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.685597 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a3ff7-276e-4f3d-b846-c16bf59a3653 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.686379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a3ff7-276e-4f3d-b846-c16bf59a3653 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.687319 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a3ff7-276e-4f3d-b846-c16bf59a3653 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:26.688118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a3ff7-276e-4f3d-b846-c16bf59a3653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.690138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a3ff7-276e-4f3d-b846-c16bf59a3653 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.703494 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 476/949] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:26.705136 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a3ff7-276e-4f3d-b846-c16bf59a3653 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.753811 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb579604-1e8f-44e1-9c71-ed4bcf09a548 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.756274 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:26.766009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:26.789223 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5088f-4b8c-435a-b5c0-192098ebae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.789887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5088f-4b8c-435a-b5c0-192098ebae4e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.790170 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5088f-4b8c-435a-b5c0-192098ebae4e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.790449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5088f-4b8c-435a-b5c0-192098ebae4e None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.791165 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5088f-4b8c-435a-b5c0-192098ebae4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:26.791770 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5088f-4b8c-435a-b5c0-192098ebae4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.793838 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5088f-4b8c-435a-b5c0-192098ebae4e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.810986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 474/950] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:26.812145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5088f-4b8c-435a-b5c0-192098ebae4e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.818031 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a3ff7-276e-4f3d-b846-c16bf59a3653 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.854713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec2469-ec27-45cf-9b5f-ced4eb2c6c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.855728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec2469-ec27-45cf-9b5f-ced4eb2c6c2f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.856201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec2469-ec27-45cf-9b5f-ced4eb2c6c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.856634 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec2469-ec27-45cf-9b5f-ced4eb2c6c2f None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.857885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec2469-ec27-45cf-9b5f-ced4eb2c6c2f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:26.858347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec2469-ec27-45cf-9b5f-ced4eb2c6c2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.859920 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec2469-ec27-45cf-9b5f-ced4eb2c6c2f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.870735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 477/951] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:26.871942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec2469-ec27-45cf-9b5f-ced4eb2c6c2f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:26.916695 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5088f-4b8c-435a-b5c0-192098ebae4e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.951938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa009f-ea9a-4df1-a3c8-61aef2029922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:26.952803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa009f-ea9a-4df1-a3c8-61aef2029922 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:26.953438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa009f-ea9a-4df1-a3c8-61aef2029922 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:26.953438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa009f-ea9a-4df1-a3c8-61aef2029922 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:26.961880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa009f-ea9a-4df1-a3c8-61aef2029922 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:26.963405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa009f-ea9a-4df1-a3c8-61aef2029922 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:26.978019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-64aa009f-ea9a-4df1-a3c8-61aef2029922 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:26.978019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:26.978019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:26.978019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:26.978019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:26.978019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:26.978019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:26.978019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:26.978019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:26.978019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:26.978019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:26.978019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:26.978019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:26.978019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:26.978019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:26.979067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:26.980472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:26.980472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:26.980472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:26.980472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:26.980472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:26.980472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:26.980472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:26.980472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:26.983396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec2469-ec27-45cf-9b5f-ced4eb2c6c2f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:26.984364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 475/952] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:26.985433 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa009f-ea9a-4df1-a3c8-61aef2029922 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:27.011896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:27.022832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c5a97-4e96-44ad-b9e6-43044835ac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.023773 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c5a97-4e96-44ad-b9e6-43044835ac60 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.024275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c5a97-4e96-44ad-b9e6-43044835ac60 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.024773 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c5a97-4e96-44ad-b9e6-43044835ac60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.025750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c5a97-4e96-44ad-b9e6-43044835ac60 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:27.027531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c5a97-4e96-44ad-b9e6-43044835ac60 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:27.033310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:27.091354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa009f-ea9a-4df1-a3c8-61aef2029922 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.122879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 478/953] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Jun 2 15:46:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:27.122879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab0e5c-cc2c-4179-8cf1-0cd9917082b4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.122879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab0e5c-cc2c-4179-8cf1-0cd9917082b4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.122879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab0e5c-cc2c-4179-8cf1-0cd9917082b4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.122879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 479/954] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:27.132432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7116a-c369-487b-ab37-7db37132e730 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.132793 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7116a-c369-487b-ab37-7db37132e730 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.133108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe7116a-c369-487b-ab37-7db37132e730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.142336 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a82ee1-74d1-40ee-aadf-d39d7fb62651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.143169 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a82ee1-74d1-40ee-aadf-d39d7fb62651 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.143560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a82ee1-74d1-40ee-aadf-d39d7fb62651 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.143943 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a82ee1-74d1-40ee-aadf-d39d7fb62651 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.144945 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a82ee1-74d1-40ee-aadf-d39d7fb62651 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:27.145400 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a82ee1-74d1-40ee-aadf-d39d7fb62651 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:27.146986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a82ee1-74d1-40ee-aadf-d39d7fb62651 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:27.151484 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1fe7116a-c369-487b-ab37-7db37132e730 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:27.166202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1fe7116a-c369-487b-ab37-7db37132e730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:27.166357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 476/955] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:27.167397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a82ee1-74d1-40ee-aadf-d39d7fb62651 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:27.240124 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 480/956] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:27.260143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7116a-c369-487b-ab37-7db37132e730 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:27.268702 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:27.291297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a82ee1-74d1-40ee-aadf-d39d7fb62651 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.331363 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cbf1e-6c88-4978-a19d-725d32b7c15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.332413 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cbf1e-6c88-4978-a19d-725d32b7c15f None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.332703 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cbf1e-6c88-4978-a19d-725d32b7c15f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.333028 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cbf1e-6c88-4978-a19d-725d32b7c15f None admin] PATH_INFO: `/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/63b40cb0ce3b420a918ec12672c0eccc/roles/217a9a10dcf94e6fb5108443d1f55d92` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.335464 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cbf1e-6c88-4978-a19d-725d32b7c15f None admin] RBAC: Authorizing `identity:create_grant(project_id=e2775777647e4323a554bb3a5d045fc0, user_id=63b40cb0ce3b420a918ec12672c0eccc, role_id=217a9a10dcf94e6fb5108443d1f55d92)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:27.337147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cbf1e-6c88-4978-a19d-725d32b7c15f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:27.379783 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe7116a-c369-487b-ab37-7db37132e730 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.382185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:27.415335 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e1f43-8158-43d8-aa7f-2e81a5281cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.416168 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e1f43-8158-43d8-aa7f-2e81a5281cbf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.416455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e1f43-8158-43d8-aa7f-2e81a5281cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.416733 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e1f43-8158-43d8-aa7f-2e81a5281cbf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.417378 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e1f43-8158-43d8-aa7f-2e81a5281cbf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:27.418748 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e1f43-8158-43d8-aa7f-2e81a5281cbf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-aa8e1f43-8158-43d8-aa7f-2e81a5281cbf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:27.430885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:27.432286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:27.432286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:27.432286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:27.432286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:27.432286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:27.432286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:27.432286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:27.432286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:27.432286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:27.432286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:27.432286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:27.432286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:27.432286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:27.432286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:27.432286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:27.432286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:27.433342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:27.433342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:27.433342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:27.433342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:27.433342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:27.433342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:27.433342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:27.433342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:27.433342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:27.433342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:27.433342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:27.433342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:27.433342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:46:27.433342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:27.433342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 481/957] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:27.438177 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e1f43-8158-43d8-aa7f-2e81a5281cbf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:27.450316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 477/958] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:46:27 2022] PUT /identity/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/63b40cb0ce3b420a918ec12672c0eccc/roles/217a9a10dcf94e6fb5108443d1f55d92 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 15:46:27.558481 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e1f43-8158-43d8-aa7f-2e81a5281cbf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.598634 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288d05b-ea23-4af5-af6f-8fc7e4f2c912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.599681 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288d05b-ea23-4af5-af6f-8fc7e4f2c912 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.600284 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288d05b-ea23-4af5-af6f-8fc7e4f2c912 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.600777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288d05b-ea23-4af5-af6f-8fc7e4f2c912 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.601719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288d05b-ea23-4af5-af6f-8fc7e4f2c912 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:27.602259 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288d05b-ea23-4af5-af6f-8fc7e4f2c912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:27.603877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288d05b-ea23-4af5-af6f-8fc7e4f2c912 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:27.610044 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 482/959] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:27.616172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cbf1e-6c88-4978-a19d-725d32b7c15f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:27.726628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cbf1e-6c88-4978-a19d-725d32b7c15f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:27.761848 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c917d-8d6f-4dc8-a0a3-aa1b412eb428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:27.762507 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c917d-8d6f-4dc8-a0a3-aa1b412eb428 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:27.762830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c917d-8d6f-4dc8-a0a3-aa1b412eb428 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:27.763114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c917d-8d6f-4dc8-a0a3-aa1b412eb428 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:27.763819 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c917d-8d6f-4dc8-a0a3-aa1b412eb428 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:27.764211 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c917d-8d6f-4dc8-a0a3-aa1b412eb428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:27.765584 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c917d-8d6f-4dc8-a0a3-aa1b412eb428 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:27.770454 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 478/960] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:28.533826 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66170b88-1876-41c3-90ea-90fe9d1aefda None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:28.534340 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66170b88-1876-41c3-90ea-90fe9d1aefda None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:28.534422 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66170b88-1876-41c3-90ea-90fe9d1aefda None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:28.536023 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 483/961] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:28.542019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e204cf-69f5-4af2-a319-2876c81f2457 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:28.542439 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e204cf-69f5-4af2-a319-2876c81f2457 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:28.542633 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e204cf-69f5-4af2-a319-2876c81f2457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:28.548588 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:28.559664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b8e204cf-69f5-4af2-a319-2876c81f2457 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:28.564937 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b8e204cf-69f5-4af2-a319-2876c81f2457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:28.630585 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 479/962] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:28.655093 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66170b88-1876-41c3-90ea-90fe9d1aefda None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:28.687536 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:28.760209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66170b88-1876-41c3-90ea-90fe9d1aefda None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:28.794877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb335b-5d60-44e7-ba70-8169d62f3673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:28.795558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb335b-5d60-44e7-ba70-8169d62f3673 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:28.795847 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb335b-5d60-44e7-ba70-8169d62f3673 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:28.796173 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb335b-5d60-44e7-ba70-8169d62f3673 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:28.796870 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb335b-5d60-44e7-ba70-8169d62f3673 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:28.798325 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb335b-5d60-44e7-ba70-8169d62f3673 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:28.851400 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.sql.core [None req-72cb335b-5d60-44e7-ba70-8169d62f3673 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 15:46:28.851400 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 15:46:28.851400 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [parameters: {'user_id': 'a3b349c142b84c1e915c2310d9738130', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 15:46:28.851400 dv-cinder-797608-27-smb devstack@keystone.service[80315]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80315) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 15:46:28.859504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-72cb335b-5d60-44e7-ba70-8169d62f3673 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 15:46:28.859504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:28.859504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 15:46:28.859504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 15:46:28.859504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 15:46:28.859504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 15:46:28.859504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 15:46:28.859504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 15:46:28.859504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 15:46:28.859504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application conn.query(q) Jun 02 15:46:28.859504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 15:46:28.859504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 15:46:28.859504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 15:46:28.859504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result.read() Jun 02 15:46:28.859504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 15:46:28.860446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application next(self.gen) Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application yield resource Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application next(self.gen) Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise self.value Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application session.commit() Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 15:46:28.861467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.session.flush() Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application compat.raise_( Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 15:46:28.862454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 15:46:28.863539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 15:46:28.863539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 15:46:28.863539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 02 15:46:28.863539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 02 15:46:28.863539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 15:46:28.863539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 15:46:28.863539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 15:46:28.863539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 15:46:28.863539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 15:46:28.863539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 15:46:28.863539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 15:46:28.863539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 15:46:28.863539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 15:46:28.863539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 15:46:28.863539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 15:46:28.863539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception Jun 02 15:46:28.864471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 15:46:28.864471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 15:46:28.864471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 15:46:28.864471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 15:46:28.864471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 15:46:28.864471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 15:46:28.864471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 15:46:28.864471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application conn.query(q) Jun 02 15:46:28.864471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 15:46:28.864471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 15:46:28.864471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 15:46:28.864471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result.read() Jun 02 15:46:28.864471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 15:46:28.864471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 15:46:28.864471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 15:46:28.864471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 15:46:28.865329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 15:46:28.865329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 15:46:28.865329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 15:46:28.865329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 15:46:28.865329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 15:46:28.865329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 15:46:28.865329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a3b349c142b84c1e915c2310d9738130', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 15:46:28.865329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 15:46:28.865329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:28.865329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:28.865329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:28.865329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:28.865329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:28.865329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:28.865329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 02 15:46:28.866718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 02 15:46:28.867686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 02 15:46:28.867686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 02 15:46:28.867686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 15:46:28.867686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 15:46:28.867686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 15:46:28.867686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:28.867686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 484/963] 10.222.0.50 () {60 vars in 1131 bytes} [Thu Jun 2 15:46:28 2022] POST /identity/v3/users => generated 160 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:28.872265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e204cf-69f5-4af2-a319-2876c81f2457 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:28.972807 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e204cf-69f5-4af2-a319-2876c81f2457 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:29.008736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fe68b-d8e3-46a3-b954-15c6a780bedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:29.009541 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fe68b-d8e3-46a3-b954-15c6a780bedb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.009837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fe68b-d8e3-46a3-b954-15c6a780bedb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.010117 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fe68b-d8e3-46a3-b954-15c6a780bedb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.012213 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:29.017858 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fe68b-d8e3-46a3-b954-15c6a780bedb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:29.019307 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fe68b-d8e3-46a3-b954-15c6a780bedb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:29.034476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3d7fe68b-d8e3-46a3-b954-15c6a780bedb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 15:46:29.034476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:29.034476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:29.034476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:29.034476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:29.034476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:29.034476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:29.034476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:29.034476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:29.034476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:29.034476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:29.034476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:29.034476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:29.034476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:29.034476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:29.034476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:29.035482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:29.036473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:29.036473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:29.036473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:29.036473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:29.036473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:29.036473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:29.036473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:29.036473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:29.036473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 15:46:29.036473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:29.036473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 480/964] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:29.042391 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb335b-5d60-44e7-ba70-8169d62f3673 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:29.139750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:29.148452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb335b-5d60-44e7-ba70-8169d62f3673 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:29.183032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c1abc-318e-407b-a143-d116bacf43d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:29.183915 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c1abc-318e-407b-a143-d116bacf43d7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.184289 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c1abc-318e-407b-a143-d116bacf43d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.184764 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c1abc-318e-407b-a143-d116bacf43d7 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.185990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c1abc-318e-407b-a143-d116bacf43d7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:29.186314 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c1abc-318e-407b-a143-d116bacf43d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:29.187967 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c1abc-318e-407b-a143-d116bacf43d7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:29.230953 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 485/965] 10.222.0.50 () {56 vars in 1101 bytes} [Thu Jun 2 15:46:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:29.549104 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8548e-9def-47f0-919c-0850eb8c123e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.549601 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8548e-9def-47f0-919c-0850eb8c123e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.549601 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8548e-9def-47f0-919c-0850eb8c123e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.551317 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 481/966] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:29.557530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae6bfd-c27a-40f9-afb7-76d5d50f87d4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.557972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae6bfd-c27a-40f9-afb7-76d5d50f87d4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.558173 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae6bfd-c27a-40f9-afb7-76d5d50f87d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.574973 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c6ae6bfd-c27a-40f9-afb7-76d5d50f87d4 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:29.576520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c6ae6bfd-c27a-40f9-afb7-76d5d50f87d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:29.645939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 486/967] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:29.668763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8548e-9def-47f0-919c-0850eb8c123e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:29.776946 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8548e-9def-47f0-919c-0850eb8c123e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:29.811840 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08ec26-8241-4eb3-b8c4-08aeb930d5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:29.812607 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08ec26-8241-4eb3-b8c4-08aeb930d5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.812894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08ec26-8241-4eb3-b8c4-08aeb930d5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.813173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08ec26-8241-4eb3-b8c4-08aeb930d5d6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.813826 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08ec26-8241-4eb3-b8c4-08aeb930d5d6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:29.815203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08ec26-8241-4eb3-b8c4-08aeb930d5d6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fd08ec26-8241-4eb3-b8c4-08aeb930d5d6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:29.827375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:29.828603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:29.828603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:29.828603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:29.828603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:29.828603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:29.828603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:29.828603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:29.828603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:29.828603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:29.828603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:29.828603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:29.828603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:29.828603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:29.828603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:29.828603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:29.828603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:29.829484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:29.829484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:29.829484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:29.829484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:29.829484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:29.829484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:29.829484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:29.829484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:29.829484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:29.829484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:29.829484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:29.829484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:29.829484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:46:29.829484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:29.830931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 482/968] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Jun 2 15:46:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:29.834561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae6bfd-c27a-40f9-afb7-76d5d50f87d4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:29.864549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebb913-0c1c-4bcc-8dcb-4439102bde52 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.865071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebb913-0c1c-4bcc-8dcb-4439102bde52 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.865361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebb913-0c1c-4bcc-8dcb-4439102bde52 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.867283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 483/969] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:29.873109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98752b95-0bbc-4250-b89b-a1c826989dda None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.873440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98752b95-0bbc-4250-b89b-a1c826989dda None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.873735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98752b95-0bbc-4250-b89b-a1c826989dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.890567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-98752b95-0bbc-4250-b89b-a1c826989dda None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:29.891850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-98752b95-0bbc-4250-b89b-a1c826989dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:29.925035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:29.945955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae6bfd-c27a-40f9-afb7-76d5d50f87d4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:29.949438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:29.963412 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 484/970] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:29.981197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1b5b1-a2a8-4610-9441-0c406d7c9992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:29.981875 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1b5b1-a2a8-4610-9441-0c406d7c9992 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:29.982164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1b5b1-a2a8-4610-9441-0c406d7c9992 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:29.982492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1b5b1-a2a8-4610-9441-0c406d7c9992 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:29.983210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1b5b1-a2a8-4610-9441-0c406d7c9992 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:29.983513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1b5b1-a2a8-4610-9441-0c406d7c9992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:29.984940 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1b5b1-a2a8-4610-9441-0c406d7c9992 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:29.986954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98752b95-0bbc-4250-b89b-a1c826989dda None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:29.996199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 487/971] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Jun 2 15:46:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:29.996890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1b5b1-a2a8-4610-9441-0c406d7c9992 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:30.092005 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98752b95-0bbc-4250-b89b-a1c826989dda None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:30.097535 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1b5b1-a2a8-4610-9441-0c406d7c9992 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:30.125741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b31a55-be35-4cac-a27f-154449ff907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:30.126541 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b31a55-be35-4cac-a27f-154449ff907c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:30.126823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b31a55-be35-4cac-a27f-154449ff907c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:30.127104 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b31a55-be35-4cac-a27f-154449ff907c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:30.130869 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79a089-10e9-46b5-b43a-e040048e5b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:30.131564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79a089-10e9-46b5-b43a-e040048e5b68 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:30.131854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79a089-10e9-46b5-b43a-e040048e5b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:30.132290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79a089-10e9-46b5-b43a-e040048e5b68 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:30.132993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79a089-10e9-46b5-b43a-e040048e5b68 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:30.133307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79a089-10e9-46b5-b43a-e040048e5b68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:30.134699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79a089-10e9-46b5-b43a-e040048e5b68 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:30.136978 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b31a55-be35-4cac-a27f-154449ff907c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:30.139499 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 488/972] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Jun 2 15:46:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:30.140719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c57c7-e28a-43ca-95f1-dbf7e2a9d838 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:30.141015 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c57c7-e28a-43ca-95f1-dbf7e2a9d838 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:30.141301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c57c7-e28a-43ca-95f1-dbf7e2a9d838 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:30.142712 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 489/973] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:30.145126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-21b31a55-be35-4cac-a27f-154449ff907c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:46:30.145126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:30.145126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:30.145126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:30.145126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:30.145126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:30.145126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:30.145126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:30.145126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:30.145126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:30.145126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:30.145126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:30.145126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:30.145126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:30.145126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:30.145126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:30.146685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:30.146685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:30.146685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:30.146685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:30.146685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:30.146685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:30.146685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:30.146685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:30.146685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:30.146685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:30.146685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:30.146685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:30.146685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:30.146685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:30.146685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:30.146685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:30.148436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:30.148436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:30.148436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:30.148436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:30.148436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:30.148436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:30.148436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:30.148436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:30.148436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:30.148436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:30.148436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:46:30.148436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:30.148436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 485/974] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Jun 2 15:46:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:30.149188 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c57c7-e28a-43ca-95f1-dbf7e2a9d838 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:30.149262 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189085b-d367-4152-ae10-1249feceed33 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:30.149262 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189085b-d367-4152-ae10-1249feceed33 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:30.149262 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189085b-d367-4152-ae10-1249feceed33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:30.159657 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:30.165576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e189085b-d367-4152-ae10-1249feceed33 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:30.166750 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e189085b-d367-4152-ae10-1249feceed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:30.212252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:30.235837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 486/975] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:30.236618 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189085b-d367-4152-ae10-1249feceed33 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:30.257043 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c57c7-e28a-43ca-95f1-dbf7e2a9d838 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:30.291432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3448d6-fe3a-443f-bcad-8de3b4894f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:30.292247 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3448d6-fe3a-443f-bcad-8de3b4894f96 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:30.292566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3448d6-fe3a-443f-bcad-8de3b4894f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:30.292701 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3448d6-fe3a-443f-bcad-8de3b4894f96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:30.293448 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3448d6-fe3a-443f-bcad-8de3b4894f96 None admin] RBAC: Adding query filter params (interface=admin, service_id=fcbcec0d540a4f819c18281aa64dda84, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:30.293765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3448d6-fe3a-443f-bcad-8de3b4894f96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:30.295141 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3448d6-fe3a-443f-bcad-8de3b4894f96 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:30.300116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 490/976] 10.222.0.50 () {56 vars in 1249 bytes} [Thu Jun 2 15:46:30 2022] GET /identity/v3/endpoints?service_id=fcbcec0d540a4f819c18281aa64dda84&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:30.300864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3448d6-fe3a-443f-bcad-8de3b4894f96 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:30.335896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189085b-d367-4152-ae10-1249feceed33 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:30.373214 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754e4e9-e036-4fce-ab87-0ebc0bba124a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:30.374147 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:30.374268 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754e4e9-e036-4fce-ab87-0ebc0bba124a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:30.374268 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754e4e9-e036-4fce-ab87-0ebc0bba124a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:30.374557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754e4e9-e036-4fce-ab87-0ebc0bba124a None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:30.375243 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754e4e9-e036-4fce-ab87-0ebc0bba124a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:30.375578 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754e4e9-e036-4fce-ab87-0ebc0bba124a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:30.376998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754e4e9-e036-4fce-ab87-0ebc0bba124a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:30.385131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 487/977] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Jun 2 15:46:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:30.385932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754e4e9-e036-4fce-ab87-0ebc0bba124a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:30.402257 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3448d6-fe3a-443f-bcad-8de3b4894f96 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:30.428287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:30.435606 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abb95f-7cdd-4e22-90ba-2f548d749e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:30.436301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abb95f-7cdd-4e22-90ba-2f548d749e4a None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:30.436595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abb95f-7cdd-4e22-90ba-2f548d749e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:30.436880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abb95f-7cdd-4e22-90ba-2f548d749e4a None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:30.439526 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abb95f-7cdd-4e22-90ba-2f548d749e4a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:30.439526 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abb95f-7cdd-4e22-90ba-2f548d749e4a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:30.486294 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754e4e9-e036-4fce-ab87-0ebc0bba124a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:30.515746 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 491/978] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Jun 2 15:46:30 2022] POST /identity/v3/services => generated 242 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:30.516665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abb95f-7cdd-4e22-90ba-2f548d749e4a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:30.528987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2a249-6cb2-45ae-9b49-3e9ed5372f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:30.529847 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2a249-6cb2-45ae-9b49-3e9ed5372f12 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:30.530132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2a249-6cb2-45ae-9b49-3e9ed5372f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:30.530410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2a249-6cb2-45ae-9b49-3e9ed5372f12 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:30.531250 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2a249-6cb2-45ae-9b49-3e9ed5372f12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:30.532703 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2a249-6cb2-45ae-9b49-3e9ed5372f12 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:30.552036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 488/979] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Jun 2 15:46:30 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 15:46:30.649910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abb95f-7cdd-4e22-90ba-2f548d749e4a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:30.684246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:30.690041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f861f1-6780-4fd9-b24d-654c6d16a4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:30.690868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f861f1-6780-4fd9-b24d-654c6d16a4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:30.691154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f861f1-6780-4fd9-b24d-654c6d16a4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:30.691432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f861f1-6780-4fd9-b24d-654c6d16a4d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:30.704536 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f861f1-6780-4fd9-b24d-654c6d16a4d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:30.706148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f861f1-6780-4fd9-b24d-654c6d16a4d4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:30.725975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d4f861f1-6780-4fd9-b24d-654c6d16a4d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:30.725975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:30.725975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:30.725975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:30.725975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:30.725975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:30.725975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:30.725975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:30.725975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:30.725975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:30.725975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:30.725975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:30.725975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:30.725975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:30.725975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:30.726998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:30.727950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:30.727950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:30.727950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:30.727950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:30.727950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 492/980] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:30.733325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2a249-6cb2-45ae-9b49-3e9ed5372f12 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:30.838469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:30.841758 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2a249-6cb2-45ae-9b49-3e9ed5372f12 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:30.877840 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509e58a-1587-40d5-a053-0e1a0c8bcfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:30.878505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509e58a-1587-40d5-a053-0e1a0c8bcfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:30.878790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509e58a-1587-40d5-a053-0e1a0c8bcfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:30.879069 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509e58a-1587-40d5-a053-0e1a0c8bcfa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:30.879783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509e58a-1587-40d5-a053-0e1a0c8bcfa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:30.880127 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509e58a-1587-40d5-a053-0e1a0c8bcfa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:30.882037 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d509e58a-1587-40d5-a053-0e1a0c8bcfa7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:30.898372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 489/981] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:30.899979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f861f1-6780-4fd9-b24d-654c6d16a4d4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:31.003020 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f861f1-6780-4fd9-b24d-654c6d16a4d4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:31.036610 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d80017-d69f-4329-a1dd-d26e69d1fb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:31.037974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d80017-d69f-4329-a1dd-d26e69d1fb5e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:31.038259 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d80017-d69f-4329-a1dd-d26e69d1fb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:31.038537 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d80017-d69f-4329-a1dd-d26e69d1fb5e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:31.046210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d80017-d69f-4329-a1dd-d26e69d1fb5e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:31.047663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d80017-d69f-4329-a1dd-d26e69d1fb5e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:31.062670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e2d80017-d69f-4329-a1dd-d26e69d1fb5e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:31.062670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:31.062670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:31.062670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:31.062670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:31.062670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:31.062670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:31.062670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:31.062670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:31.062670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:31.062670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:31.062670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:31.062670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:31.062670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:31.062670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:31.062670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:31.063685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:31.070042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:31.070042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:31.070042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:31.070042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:31.070042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:31.070042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:31.070042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:31.070042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:31.070042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 15:46:31.070042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:31.070042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 493/982] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Jun 2 15:46:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:31.072514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509e58a-1587-40d5-a053-0e1a0c8bcfa7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:31.173315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509e58a-1587-40d5-a053-0e1a0c8bcfa7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:31.207478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b6a06-98f3-4c84-b9d5-7802ee188998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:31.208187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b6a06-98f3-4c84-b9d5-7802ee188998 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:31.208471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b6a06-98f3-4c84-b9d5-7802ee188998 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:31.208810 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b6a06-98f3-4c84-b9d5-7802ee188998 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:31.209684 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b6a06-98f3-4c84-b9d5-7802ee188998 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:31.210044 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b6a06-98f3-4c84-b9d5-7802ee188998 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:31.211479 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b6a06-98f3-4c84-b9d5-7802ee188998 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:31.235480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 490/983] 10.222.0.50 () {56 vars in 1149 bytes} [Thu Jun 2 15:46:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:31.236767 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d80017-d69f-4329-a1dd-d26e69d1fb5e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:31.282939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:31.338112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d80017-d69f-4329-a1dd-d26e69d1fb5e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:31.377888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5427b9d-b786-4736-bde0-9c33c7daba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:31.378545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5427b9d-b786-4736-bde0-9c33c7daba91 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:31.378830 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5427b9d-b786-4736-bde0-9c33c7daba91 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:31.379108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5427b9d-b786-4736-bde0-9c33c7daba91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:31.445777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5427b9d-b786-4736-bde0-9c33c7daba91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:31.447158 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5427b9d-b786-4736-bde0-9c33c7daba91 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:31.489261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:31.549860 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 494/984] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:31 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:46:31.551189 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b6a06-98f3-4c84-b9d5-7802ee188998 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:31.570524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:31.649651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b6a06-98f3-4c84-b9d5-7802ee188998 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:31.682617 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c17678-0b78-4973-b8b9-cb3adf18a9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:31.683433 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c17678-0b78-4973-b8b9-cb3adf18a9ec None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:31.683716 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c17678-0b78-4973-b8b9-cb3adf18a9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:31.684017 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c17678-0b78-4973-b8b9-cb3adf18a9ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:31.696215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c17678-0b78-4973-b8b9-cb3adf18a9ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:31.697630 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c17678-0b78-4973-b8b9-cb3adf18a9ec None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:31.717217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-22c17678-0b78-4973-b8b9-cb3adf18a9ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:31.717217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:31.717217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:31.717217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:31.717217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:31.717217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:31.717217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:31.717217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:31.717217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:31.717217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:31.717217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:31.717217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:31.717217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:31.717217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:31.717217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:31.718175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:31.719110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:31.719110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:31.719110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:31.719110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:31.720443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 491/985] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:31.723970 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5427b9d-b786-4736-bde0-9c33c7daba91 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:31.821990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5427b9d-b786-4736-bde0-9c33c7daba91 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:31.855509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6363bd-fb9b-42fb-8b85-f99ba09d54b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:31.856205 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6363bd-fb9b-42fb-8b85-f99ba09d54b4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:31.856493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6363bd-fb9b-42fb-8b85-f99ba09d54b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:31.856771 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6363bd-fb9b-42fb-8b85-f99ba09d54b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:31.857482 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6363bd-fb9b-42fb-8b85-f99ba09d54b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:31.857788 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6363bd-fb9b-42fb-8b85-f99ba09d54b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:31.859164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6363bd-fb9b-42fb-8b85-f99ba09d54b4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:31.875870 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 495/986] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:31.877617 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c17678-0b78-4973-b8b9-cb3adf18a9ec None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:31.953128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:31.983008 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c17678-0b78-4973-b8b9-cb3adf18a9ec None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:32.017167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c7f2b-d43e-4b35-a182-4590c6889595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:32.018016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c7f2b-d43e-4b35-a182-4590c6889595 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.018302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c7f2b-d43e-4b35-a182-4590c6889595 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.018581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c7f2b-d43e-4b35-a182-4590c6889595 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.025909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c7f2b-d43e-4b35-a182-4590c6889595 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:32.027352 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c7f2b-d43e-4b35-a182-4590c6889595 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:32.040906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7a1c7f2b-d43e-4b35-a182-4590c6889595 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:32.040906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:32.040906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:32.040906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:32.040906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:32.040906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:32.040906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:32.040906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:32.040906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:32.040906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:32.040906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:32.040906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:32.040906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:32.040906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:32.040906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:32.041795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:32.042697 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:32.042697 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:32.042697 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:32.042697 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:32.042697 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:32.042697 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:32.042697 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:32.042697 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:32.044345 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 492/987] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:32.047811 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6363bd-fb9b-42fb-8b85-f99ba09d54b4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:32.051930 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:32.145785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6363bd-fb9b-42fb-8b85-f99ba09d54b4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:32.179338 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb0783-e2e0-41a1-812f-bcea0a3b4fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:32.180020 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb0783-e2e0-41a1-812f-bcea0a3b4fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.180315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb0783-e2e0-41a1-812f-bcea0a3b4fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.180594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb0783-e2e0-41a1-812f-bcea0a3b4fe0 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.181375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb0783-e2e0-41a1-812f-bcea0a3b4fe0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:32.181687 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb0783-e2e0-41a1-812f-bcea0a3b4fe0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:32.183120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb0783-e2e0-41a1-812f-bcea0a3b4fe0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:32.195263 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 496/988] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:32.201065 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c7f2b-d43e-4b35-a182-4590c6889595 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:32.307675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c7f2b-d43e-4b35-a182-4590c6889595 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:32.335952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:32.342158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b5acb-5d94-4d51-b9fc-03be5153b051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:32.342816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b5acb-5d94-4d51-b9fc-03be5153b051 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.343103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b5acb-5d94-4d51-b9fc-03be5153b051 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.343383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b5acb-5d94-4d51-b9fc-03be5153b051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.344247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b5acb-5d94-4d51-b9fc-03be5153b051 None admin] RBAC: Adding query filter params (role.id=217a9a10dcf94e6fb5108443d1f55d92, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=63b40cb0ce3b420a918ec12672c0eccc) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:32.344565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b5acb-5d94-4d51-b9fc-03be5153b051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:32.346068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b5acb-5d94-4d51-b9fc-03be5153b051 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:32.356236 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 493/989] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:32 2022] GET /identity/v3/role_assignments?user.id=63b40cb0ce3b420a918ec12672c0eccc&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=217a9a10dcf94e6fb5108443d1f55d92 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:32.845128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617ce00-9d96-4d8d-ae1b-aba162a91eb4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.845678 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617ce00-9d96-4d8d-ae1b-aba162a91eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.845678 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617ce00-9d96-4d8d-ae1b-aba162a91eb4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.847092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 497/990] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:32.852820 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1893253-ced9-4b93-81ba-c1886672ca8b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.853227 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1893253-ced9-4b93-81ba-c1886672ca8b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.853408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1893253-ced9-4b93-81ba-c1886672ca8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.870603 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec6a05-df1e-42bd-8a7f-e127375c98de None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.870903 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec6a05-df1e-42bd-8a7f-e127375c98de None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.871003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b1893253-ced9-4b93-81ba-c1886672ca8b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:32.871184 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec6a05-df1e-42bd-8a7f-e127375c98de None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.872222 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b1893253-ced9-4b93-81ba-c1886672ca8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:32.872689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 498/991] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:32.877726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480db50-d20d-4ba3-a33e-43df4a78d1d3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:32.878179 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480db50-d20d-4ba3-a33e-43df4a78d1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:32.878623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480db50-d20d-4ba3-a33e-43df4a78d1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:32.895378 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a480db50-d20d-4ba3-a33e-43df4a78d1d3 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:32.896594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a480db50-d20d-4ba3-a33e-43df4a78d1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:32.948285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 494/992] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:32.966341 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:32.970624 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1893253-ced9-4b93-81ba-c1886672ca8b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:32.980082 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 499/993] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:33.000653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480db50-d20d-4ba3-a33e-43df4a78d1d3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.080977 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1893253-ced9-4b93-81ba-c1886672ca8b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.106093 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:33.110373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480db50-d20d-4ba3-a33e-43df4a78d1d3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.117243 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925625d0-8a56-43ce-a488-170c1098c2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.118059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925625d0-8a56-43ce-a488-170c1098c2ea None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.118346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925625d0-8a56-43ce-a488-170c1098c2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.118623 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925625d0-8a56-43ce-a488-170c1098c2ea None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.119524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925625d0-8a56-43ce-a488-170c1098c2ea None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.120946 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925625d0-8a56-43ce-a488-170c1098c2ea None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-925625d0-8a56-43ce-a488-170c1098c2ea None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:33.133859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:33.135106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:33.135106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:33.135106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:33.135106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:33.135106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:33.135106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:33.135106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:33.135106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:33.135106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:33.135106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:33.135106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:33.135106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:33.135106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:33.135106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:33.135106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:33.135106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:33.136184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:33.136184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:33.136184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:33.136184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:33.136184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:33.136184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:33.136184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:33.136184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:33.136184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:33.136184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:33.136184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:33.136184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:33.136184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 15:46:33.136184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:33.139196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 495/994] 10.222.0.50 () {56 vars in 1126 bytes} [Thu Jun 2 15:46:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:33.144921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925625d0-8a56-43ce-a488-170c1098c2ea None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.151664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0ed1f-b25c-4361-af18-55e270dc36a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.152505 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0ed1f-b25c-4361-af18-55e270dc36a7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.152794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0ed1f-b25c-4361-af18-55e270dc36a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.153072 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0ed1f-b25c-4361-af18-55e270dc36a7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.153720 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0ed1f-b25c-4361-af18-55e270dc36a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.155092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0ed1f-b25c-4361-af18-55e270dc36a7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-01a0ed1f-b25c-4361-af18-55e270dc36a7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:33.167658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:33.172045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:33.172045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:33.172045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:33.172045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:33.172045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:33.172045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:33.172045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:33.172045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:33.172045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:33.172045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:33.172045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:33.172045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:33.172045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:33.172045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:33.172045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:33.172045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:33.173200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:33.173200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:33.173200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:33.173200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:33.173200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:33.173200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:33.173200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:33.173200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:33.173200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:33.173200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:33.173200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:33.173200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:33.173200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:46:33.173200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:33.173200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 500/995] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:33.174547 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0ed1f-b25c-4361-af18-55e270dc36a7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.242414 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:33.261182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925625d0-8a56-43ce-a488-170c1098c2ea None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.286845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0ed1f-b25c-4361-af18-55e270dc36a7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.295543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc293cc6-4ed0-4d1d-9806-7d06b3ed3bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.296229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc293cc6-4ed0-4d1d-9806-7d06b3ed3bee None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.296518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc293cc6-4ed0-4d1d-9806-7d06b3ed3bee None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.296799 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc293cc6-4ed0-4d1d-9806-7d06b3ed3bee None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.297488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc293cc6-4ed0-4d1d-9806-7d06b3ed3bee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:33.297797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc293cc6-4ed0-4d1d-9806-7d06b3ed3bee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.299156 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc293cc6-4ed0-4d1d-9806-7d06b3ed3bee None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.303834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 496/996] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Jun 2 15:46:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:33.309385 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc293cc6-4ed0-4d1d-9806-7d06b3ed3bee None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.323127 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ee1c-341a-4570-a312-11208795e5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.324023 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ee1c-341a-4570-a312-11208795e5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.324455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ee1c-341a-4570-a312-11208795e5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.324988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ee1c-341a-4570-a312-11208795e5e0 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.325939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5ee1c-341a-4570-a312-11208795e5e0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:33.326249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5ee1c-341a-4570-a312-11208795e5e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.327603 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5ee1c-341a-4570-a312-11208795e5e0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.332905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 501/997] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:33.338648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ee1c-341a-4570-a312-11208795e5e0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.377241 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:33.425405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc293cc6-4ed0-4d1d-9806-7d06b3ed3bee None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.440561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ee1c-341a-4570-a312-11208795e5e0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.459870 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5586d-80e0-4015-8d95-ca26c7a95a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.460758 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5586d-80e0-4015-8d95-ca26c7a95a56 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.461192 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5586d-80e0-4015-8d95-ca26c7a95a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.461636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5586d-80e0-4015-8d95-ca26c7a95a56 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.462476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5586d-80e0-4015-8d95-ca26c7a95a56 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:33.462929 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5586d-80e0-4015-8d95-ca26c7a95a56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.464498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5586d-80e0-4015-8d95-ca26c7a95a56 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.464636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:33.469923 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 497/998] 10.222.0.50 () {56 vars in 1122 bytes} [Thu Jun 2 15:46:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:33.475889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5586d-80e0-4015-8d95-ca26c7a95a56 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.476619 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ab3de-0ffc-40bf-a831-c49bdb45b6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.477382 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ab3de-0ffc-40bf-a831-c49bdb45b6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.477668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ab3de-0ffc-40bf-a831-c49bdb45b6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.477947 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ab3de-0ffc-40bf-a831-c49bdb45b6b0 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.478864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ab3de-0ffc-40bf-a831-c49bdb45b6b0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:33.479171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ab3de-0ffc-40bf-a831-c49bdb45b6b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.480575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ab3de-0ffc-40bf-a831-c49bdb45b6b0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.490390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 502/999] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:33.491577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ab3de-0ffc-40bf-a831-c49bdb45b6b0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.589070 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5586d-80e0-4015-8d95-ca26c7a95a56 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.598883 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ab3de-0ffc-40bf-a831-c49bdb45b6b0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.615190 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:33.635665 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932f5ea-1bb9-4f40-95e7-5294b06a434f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.636387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f5ea-1bb9-4f40-95e7-5294b06a434f None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.636747 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f5ea-1bb9-4f40-95e7-5294b06a434f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.637109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932f5ea-1bb9-4f40-95e7-5294b06a434f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.637971 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f5ea-1bb9-4f40-95e7-5294b06a434f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.639375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932f5ea-1bb9-4f40-95e7-5294b06a434f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.646479 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2701154-147a-4cfb-a2ae-66dcfaec3672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.647678 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2701154-147a-4cfb-a2ae-66dcfaec3672 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.647965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2701154-147a-4cfb-a2ae-66dcfaec3672 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.648277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2701154-147a-4cfb-a2ae-66dcfaec3672 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.649056 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2701154-147a-4cfb-a2ae-66dcfaec3672 None admin] RBAC: Adding query filter params (interface=public, service_id=6303c74aa3a14422aace8aa2c5d19b94, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:33.649376 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2701154-147a-4cfb-a2ae-66dcfaec3672 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.650734 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2701154-147a-4cfb-a2ae-66dcfaec3672 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.655909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 503/1000] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Jun 2 15:46:33 2022] GET /identity/v3/endpoints?service_id=6303c74aa3a14422aace8aa2c5d19b94&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:33.661225 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2701154-147a-4cfb-a2ae-66dcfaec3672 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:33.712133 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:33.718377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 498/1001] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Jun 2 15:46:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:33.770192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2701154-147a-4cfb-a2ae-66dcfaec3672 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:33.813989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80af76d-cd23-4aeb-84ec-38bfdae77926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:33.814665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af76d-cd23-4aeb-84ec-38bfdae77926 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:33.814954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af76d-cd23-4aeb-84ec-38bfdae77926 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:33.815238 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80af76d-cd23-4aeb-84ec-38bfdae77926 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:33.815922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80af76d-cd23-4aeb-84ec-38bfdae77926 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:33.817343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80af76d-cd23-4aeb-84ec-38bfdae77926 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:33.824577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 504/1002] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Jun 2 15:46:33 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 15:46:34.678202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55db25-1dc0-4b73-b3e2-b1c889933ded None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:34.678690 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55db25-1dc0-4b73-b3e2-b1c889933ded None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:34.678690 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55db25-1dc0-4b73-b3e2-b1c889933ded None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:34.680074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 499/1003] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:34.685415 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969a10a-b006-4b41-9a7a-128e2ce94090 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:34.685795 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969a10a-b006-4b41-9a7a-128e2ce94090 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:34.685974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969a10a-b006-4b41-9a7a-128e2ce94090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:34.702722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0969a10a-b006-4b41-9a7a-128e2ce94090 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:34.703907 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0969a10a-b006-4b41-9a7a-128e2ce94090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:34.770338 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 505/1004] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:34.792918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55db25-1dc0-4b73-b3e2-b1c889933ded None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:34.894437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55db25-1dc0-4b73-b3e2-b1c889933ded None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:34.927780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb5af1-bd5e-4f29-bcf8-d0f7f6778570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:34.928698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb5af1-bd5e-4f29-bcf8-d0f7f6778570 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:34.928938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb5af1-bd5e-4f29-bcf8-d0f7f6778570 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:34.929217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb5af1-bd5e-4f29-bcf8-d0f7f6778570 None admin] PATH_INFO: `/v3/services/image` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:34.929862 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb5af1-bd5e-4f29-bcf8-d0f7f6778570 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:34.931262 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb5af1-bd5e-4f29-bcf8-d0f7f6778570 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3cbb5af1-bd5e-4f29-bcf8-d0f7f6778570 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:34.944151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:34.945183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:34.945183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:34.945183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:34.945183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:34.945183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:34.945183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:34.945183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:34.945183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:34.945183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:34.945183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:34.945183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:34.945183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:34.945183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:34.945183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:34.945183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:34.945183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:34.946609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:34.946609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:34.946609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:34.946609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:34.946609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:34.946609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:34.946609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:34.946609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:34.946609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:34.946609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:34.946609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:34.946609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:34.946609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:46:34.946609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:34.946609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 500/1005] 10.222.0.50 () {56 vars in 1105 bytes} [Thu Jun 2 15:46:34 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:34.951269 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969a10a-b006-4b41-9a7a-128e2ce94090 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:34.993992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:35.052623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969a10a-b006-4b41-9a7a-128e2ce94090 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:35.087067 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b1c46-6e53-48bf-b8be-eee240efdd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:35.087743 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b1c46-6e53-48bf-b8be-eee240efdd1a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:35.088056 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b1c46-6e53-48bf-b8be-eee240efdd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:35.088339 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b1c46-6e53-48bf-b8be-eee240efdd1a None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:35.089045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b1c46-6e53-48bf-b8be-eee240efdd1a None admin] RBAC: Adding query filter params (name=image) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:35.089355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b1c46-6e53-48bf-b8be-eee240efdd1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:35.090737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b1c46-6e53-48bf-b8be-eee240efdd1a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:35.100133 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 506/1006] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:35.101689 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb5af1-bd5e-4f29-bcf8-d0f7f6778570 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:35.144740 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:35.203156 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb5af1-bd5e-4f29-bcf8-d0f7f6778570 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:35.236350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289d496-3204-4071-b753-30623c1c27ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:35.237054 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289d496-3204-4071-b753-30623c1c27ff None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:35.237346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289d496-3204-4071-b753-30623c1c27ff None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:35.237626 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289d496-3204-4071-b753-30623c1c27ff None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:35.238326 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289d496-3204-4071-b753-30623c1c27ff None admin] RBAC: Adding query filter params (type=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:35.238636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289d496-3204-4071-b753-30623c1c27ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:35.240014 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289d496-3204-4071-b753-30623c1c27ff None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:35.245456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 501/1007] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:36.029388 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04109143-562d-43e5-aaff-5b5104696cde None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.029951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04109143-562d-43e5-aaff-5b5104696cde None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.029951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04109143-562d-43e5-aaff-5b5104696cde None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.031448 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 507/1008] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:36.036718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a07fd-d6bd-4894-bebc-bd5f4d52a603 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.037106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a07fd-d6bd-4894-bebc-bd5f4d52a603 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.037280 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a07fd-d6bd-4894-bebc-bd5f4d52a603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.054823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dc6a07fd-d6bd-4894-bebc-bd5f4d52a603 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:36.056011 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dc6a07fd-d6bd-4894-bebc-bd5f4d52a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:36.125037 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 502/1009] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:36 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:36.141029 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4d2d-0855-45d6-bebe-d775d6dd1ebc None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.141328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4d2d-0855-45d6-bebe-d775d6dd1ebc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.141617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4d2d-0855-45d6-bebe-d775d6dd1ebc None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.143115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 508/1010] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:36.148021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc4d2d-0855-45d6-bebe-d775d6dd1ebc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:36.148139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edf17d-98c3-4fe0-846b-011b5e146d16 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.148455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edf17d-98c3-4fe0-846b-011b5e146d16 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.148696 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edf17d-98c3-4fe0-846b-011b5e146d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.167661 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-26edf17d-98c3-4fe0-846b-011b5e146d16 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:36.168880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-26edf17d-98c3-4fe0-846b-011b5e146d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:36.197733 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:36.246919 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 503/1011] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:36 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:36.252719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc4d2d-0855-45d6-bebe-d775d6dd1ebc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:36.255797 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:36.274087 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edf17d-98c3-4fe0-846b-011b5e146d16 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:36.295092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3ee22-060f-4a04-9ac0-71b8dda86c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:36.295822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ee22-060f-4a04-9ac0-71b8dda86c9f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.296149 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ee22-060f-4a04-9ac0-71b8dda86c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.296431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ee22-060f-4a04-9ac0-71b8dda86c9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.297605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3ee22-060f-4a04-9ac0-71b8dda86c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:36.299050 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3ee22-060f-4a04-9ac0-71b8dda86c9f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:36.304165 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 509/1012] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:36.306341 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3ee22-060f-4a04-9ac0-71b8dda86c9f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:36.388460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edf17d-98c3-4fe0-846b-011b5e146d16 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:36.415832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3ee22-060f-4a04-9ac0-71b8dda86c9f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:36.425122 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2968279-38d9-473f-8102-fa1f75a29c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:36.426117 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2968279-38d9-473f-8102-fa1f75a29c52 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.426471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2968279-38d9-473f-8102-fa1f75a29c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.426825 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2968279-38d9-473f-8102-fa1f75a29c52 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.427608 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2968279-38d9-473f-8102-fa1f75a29c52 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:36.429071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2968279-38d9-473f-8102-fa1f75a29c52 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c2968279-38d9-473f-8102-fa1f75a29c52 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:36.441981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:36.443026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:36.443026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:36.443026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:36.443026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:36.443026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:36.443026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:36.443026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:36.443026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:36.443026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:36.443026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:36.443026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:36.443026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:36.443026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:36.443026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:36.443026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:36.443026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:36.444534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:36.444534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:36.444534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:36.444534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:36.444534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:36.444534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:36.444534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:36.444534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:36.444534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:36.444534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:36.444534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:36.444534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:36.444534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 15:46:36.444534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:36.444534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 504/1013] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:36.449869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2968279-38d9-473f-8102-fa1f75a29c52 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:36.454130 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c417e9d-d3cc-4eec-a29a-b32c39262984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:36.454799 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c417e9d-d3cc-4eec-a29a-b32c39262984 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.455087 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c417e9d-d3cc-4eec-a29a-b32c39262984 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.455368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c417e9d-d3cc-4eec-a29a-b32c39262984 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.456167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c417e9d-d3cc-4eec-a29a-b32c39262984 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:36.457600 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c417e9d-d3cc-4eec-a29a-b32c39262984 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:36.479490 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:36.544577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 510/1014] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Jun 2 15:46:36 2022] POST /identity/v3/projects => generated 311 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:46:36.552047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2968279-38d9-473f-8102-fa1f75a29c52 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:36.592096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e158f0-9a11-4f4b-8451-a2037c05d613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:36.592836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e158f0-9a11-4f4b-8451-a2037c05d613 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.593115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e158f0-9a11-4f4b-8451-a2037c05d613 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.593399 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e158f0-9a11-4f4b-8451-a2037c05d613 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.594120 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e158f0-9a11-4f4b-8451-a2037c05d613 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:36.594437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e158f0-9a11-4f4b-8451-a2037c05d613 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:36.595831 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e158f0-9a11-4f4b-8451-a2037c05d613 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:36.606954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 505/1015] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:36.609370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c417e9d-d3cc-4eec-a29a-b32c39262984 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:36.638691 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:36.719766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c417e9d-d3cc-4eec-a29a-b32c39262984 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:36.757328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284c128-a3ce-471f-a3c4-594ef34cc308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:36.758339 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284c128-a3ce-471f-a3c4-594ef34cc308 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.758633 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284c128-a3ce-471f-a3c4-594ef34cc308 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.758921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284c128-a3ce-471f-a3c4-594ef34cc308 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.759629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284c128-a3ce-471f-a3c4-594ef34cc308 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:36.759942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284c128-a3ce-471f-a3c4-594ef34cc308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:36.761374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284c128-a3ce-471f-a3c4-594ef34cc308 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:36.766683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 511/1016] 10.222.0.50 () {56 vars in 1112 bytes} [Thu Jun 2 15:46:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:36.773120 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e158f0-9a11-4f4b-8451-a2037c05d613 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:36.870766 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:36.879360 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e158f0-9a11-4f4b-8451-a2037c05d613 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:36.914152 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b306aeb-6335-4631-857e-93f391cd9a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:36.914816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306aeb-6335-4631-857e-93f391cd9a4b None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:36.915105 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306aeb-6335-4631-857e-93f391cd9a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:36.915385 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306aeb-6335-4631-857e-93f391cd9a4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:36.916168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b306aeb-6335-4631-857e-93f391cd9a4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:36.917535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b306aeb-6335-4631-857e-93f391cd9a4b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:36.999717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 506/1017] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Jun 2 15:46:36 2022] POST /identity/v3/endpoints => generated 334 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:46:37.509780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb679173-ba9a-4e97-bca8-1555d6d10da7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:37.510307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb679173-ba9a-4e97-bca8-1555d6d10da7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:37.510385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb679173-ba9a-4e97-bca8-1555d6d10da7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:37.511900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 512/1018] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:37.516898 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eab3f7-7c4f-4f9a-95db-f65b7d3e942c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:37.517282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eab3f7-7c4f-4f9a-95db-f65b7d3e942c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:37.517454 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eab3f7-7c4f-4f9a-95db-f65b7d3e942c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:37.534413 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-21eab3f7-7c4f-4f9a-95db-f65b7d3e942c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:37.535588 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-21eab3f7-7c4f-4f9a-95db-f65b7d3e942c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:37.609184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 507/1019] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:37 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:37.631965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb679173-ba9a-4e97-bca8-1555d6d10da7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:37.718940 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:37.734096 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb679173-ba9a-4e97-bca8-1555d6d10da7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:37.767767 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785d1cc-8917-45a2-bbe2-2d18bfed32d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:37.768460 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785d1cc-8917-45a2-bbe2-2d18bfed32d6 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:37.768747 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785d1cc-8917-45a2-bbe2-2d18bfed32d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:37.769027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785d1cc-8917-45a2-bbe2-2d18bfed32d6 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:37.770105 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785d1cc-8917-45a2-bbe2-2d18bfed32d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:37.772505 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785d1cc-8917-45a2-bbe2-2d18bfed32d6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:37.841058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 513/1020] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Jun 2 15:46:37 2022] POST /identity/v3/services => generated 242 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:38.876765 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380aadb-bd62-4a72-813d-00115a6ff8d9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:38.877309 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380aadb-bd62-4a72-813d-00115a6ff8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:38.877309 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380aadb-bd62-4a72-813d-00115a6ff8d9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:38.878880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 508/1021] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:38.884291 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de81b4-daa3-4c1a-8b73-48de58d3f2f3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:38.884683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de81b4-daa3-4c1a-8b73-48de58d3f2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:38.884905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de81b4-daa3-4c1a-8b73-48de58d3f2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:38.902033 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-85de81b4-daa3-4c1a-8b73-48de58d3f2f3 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:38.903251 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-85de81b4-daa3-4c1a-8b73-48de58d3f2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:38.978415 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 514/1022] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:39.004107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380aadb-bd62-4a72-813d-00115a6ff8d9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:39.134570 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:39.159734 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380aadb-bd62-4a72-813d-00115a6ff8d9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:39.195652 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e2870-f5e2-4313-8c29-29fc3c7b03df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:39.196477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e2870-f5e2-4313-8c29-29fc3c7b03df None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:39.196761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e2870-f5e2-4313-8c29-29fc3c7b03df None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:39.197037 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e2870-f5e2-4313-8c29-29fc3c7b03df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:39.198232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e2870-f5e2-4313-8c29-29fc3c7b03df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:39.199656 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e2870-f5e2-4313-8c29-29fc3c7b03df None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:39.205441 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 509/1023] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:39.207530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de81b4-daa3-4c1a-8b73-48de58d3f2f3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:39.281442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:39.307411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de81b4-daa3-4c1a-8b73-48de58d3f2f3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:39.340669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387d9cc-2216-49ad-86a7-0b3a0baaafcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:39.341812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387d9cc-2216-49ad-86a7-0b3a0baaafcb None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:39.342305 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387d9cc-2216-49ad-86a7-0b3a0baaafcb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:39.342881 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387d9cc-2216-49ad-86a7-0b3a0baaafcb None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:39.343834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387d9cc-2216-49ad-86a7-0b3a0baaafcb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:39.345961 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387d9cc-2216-49ad-86a7-0b3a0baaafcb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:39.379436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495a78c-fbd0-4c4b-ad39-9ced43edee11 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:39.379802 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495a78c-fbd0-4c4b-ad39-9ced43edee11 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:39.380196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495a78c-fbd0-4c4b-ad39-9ced43edee11 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:39.382205 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 510/1024] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:39.387232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e81b9-19c3-4f8a-8c28-1cebc47b59f4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:39.387471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e81b9-19c3-4f8a-8c28-1cebc47b59f4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:39.387758 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e81b9-19c3-4f8a-8c28-1cebc47b59f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:39.405553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2f5e81b9-19c3-4f8a-8c28-1cebc47b59f4 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:39.407051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2f5e81b9-19c3-4f8a-8c28-1cebc47b59f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:39.456364 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 515/1025] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:46:39 2022] POST /identity/v3/users => generated 285 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:39.490853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 511/1026] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:39.515942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387d9cc-2216-49ad-86a7-0b3a0baaafcb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:39.626304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387d9cc-2216-49ad-86a7-0b3a0baaafcb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:39.656437 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:39.661954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b518d-3b16-4e24-9c40-3423e805a0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:39.662816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b518d-3b16-4e24-9c40-3423e805a0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:39.663107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b518d-3b16-4e24-9c40-3423e805a0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:39.663389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b518d-3b16-4e24-9c40-3423e805a0c3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:39.674318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b518d-3b16-4e24-9c40-3423e805a0c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:39.683189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a73b518d-3b16-4e24-9c40-3423e805a0c3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:46:39.683189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:39.683189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:39.683189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:39.683189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:39.683189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:39.683189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:39.683189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:39.683189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:39.683189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:39.683189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:39.683189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:39.683189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:39.683189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:39.683189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:39.683189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:39.684446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:39.684446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:39.684446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:39.684446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:39.684446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:39.684446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:39.684446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:39.684446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:39.684446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:39.684446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:39.684446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:39.684446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:39.684446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:39.684446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:39.684446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:39.684446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:39.685413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:39.685413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:39.685413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:39.685413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:39.685413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:39.685413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:39.685413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:39.685413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:39.685413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:39.685413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:39.685413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:46:39.685413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:39.685413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 516/1027] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Jun 2 15:46:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:39.693668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e81b9-19c3-4f8a-8c28-1cebc47b59f4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:39.771477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:39.804410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e81b9-19c3-4f8a-8c28-1cebc47b59f4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:39.840427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e1c0d-78ee-4fab-9def-e24731305a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:39.841102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e1c0d-78ee-4fab-9def-e24731305a31 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:39.841393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e1c0d-78ee-4fab-9def-e24731305a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:39.841676 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e1c0d-78ee-4fab-9def-e24731305a31 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:39.842424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e1c0d-78ee-4fab-9def-e24731305a31 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:39.842738 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e1c0d-78ee-4fab-9def-e24731305a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:39.844163 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e1c0d-78ee-4fab-9def-e24731305a31 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:39.856717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 512/1028] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Jun 2 15:46:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:39.858326 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b518d-3b16-4e24-9c40-3423e805a0c3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:39.960902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b518d-3b16-4e24-9c40-3423e805a0c3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:39.995587 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373511b-216b-489d-82d5-507d04ab158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:39.996416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373511b-216b-489d-82d5-507d04ab158e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:39.996703 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373511b-216b-489d-82d5-507d04ab158e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:39.996979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373511b-216b-489d-82d5-507d04ab158e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.007844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373511b-216b-489d-82d5-507d04ab158e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:40.015049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373511b-216b-489d-82d5-507d04ab158e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:40.027112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4373511b-216b-489d-82d5-507d04ab158e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:40.027112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:40.027112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:40.027112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:40.027112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:40.027112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:40.027112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:40.027112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:40.027112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:40.027112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:40.027112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:40.027112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:40.027112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:40.027112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:40.027112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:40.028058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:40.028994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:40.028994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:40.028994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:40.028994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:40.032053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 517/1029] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:40.034493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e1c0d-78ee-4fab-9def-e24731305a31 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:40.124057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952e146-5c07-4a0f-a04c-7ed0f3dc9953 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.124381 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952e146-5c07-4a0f-a04c-7ed0f3dc9953 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.124634 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952e146-5c07-4a0f-a04c-7ed0f3dc9953 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.126019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 518/1030] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:40.131176 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f67f4d-c8f0-492c-9be2-329850efc5c9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.131485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f67f4d-c8f0-492c-9be2-329850efc5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.131755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f67f4d-c8f0-492c-9be2-329850efc5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.141567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e1c0d-78ee-4fab-9def-e24731305a31 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:40.148929 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-08f67f4d-c8f0-492c-9be2-329850efc5c9 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:40.150108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-08f67f4d-c8f0-492c-9be2-329850efc5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:40.179324 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ea553-d8b1-4573-b5b6-4ec4d4ebdbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:40.180275 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ea553-d8b1-4573-b5b6-4ec4d4ebdbbc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.180765 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ea553-d8b1-4573-b5b6-4ec4d4ebdbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.181139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ea553-d8b1-4573-b5b6-4ec4d4ebdbbc None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.181765 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ea553-d8b1-4573-b5b6-4ec4d4ebdbbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:40.182082 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ea553-d8b1-4573-b5b6-4ec4d4ebdbbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:40.183460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ea553-d8b1-4573-b5b6-4ec4d4ebdbbc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:40.185227 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:40.187019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:40.196268 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 513/1031] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:40.201854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ea553-d8b1-4573-b5b6-4ec4d4ebdbbc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:40.219583 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 519/1032] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:40.242345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f67f4d-c8f0-492c-9be2-329850efc5c9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:40.307464 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ea553-d8b1-4573-b5b6-4ec4d4ebdbbc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:40.352352 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c3801-0443-4fc3-9783-b25f92244294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:40.353155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c3801-0443-4fc3-9783-b25f92244294 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.353438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c3801-0443-4fc3-9783-b25f92244294 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.353716 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c3801-0443-4fc3-9783-b25f92244294 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.358910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f67f4d-c8f0-492c-9be2-329850efc5c9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:40.361622 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c3801-0443-4fc3-9783-b25f92244294 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:40.363058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c3801-0443-4fc3-9783-b25f92244294 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:40.382172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fa6c3801-0443-4fc3-9783-b25f92244294 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:40.382172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:40.382172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:40.382172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:40.382172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:40.382172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:40.382172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:40.382172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:40.382172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:40.382172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:40.382172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:40.382172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:40.382172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:40.382172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:40.382172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:40.382172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:40.383160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:40.384216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:40.384216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:40.384216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:40.384216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:40.384216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:40.384216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:40.384216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:40.384216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:40.384216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:40.384216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:40.384216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 514/1033] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Jun 2 15:46:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:40.389127 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c3801-0443-4fc3-9783-b25f92244294 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:40.398987 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa99ec5-2412-46ce-942c-632e9e89e840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:40.399779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa99ec5-2412-46ce-942c-632e9e89e840 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.400157 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa99ec5-2412-46ce-942c-632e9e89e840 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.400437 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa99ec5-2412-46ce-942c-632e9e89e840 None admin] PATH_INFO: `/v3/services/image` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.401135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa99ec5-2412-46ce-942c-632e9e89e840 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:40.402572 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa99ec5-2412-46ce-942c-632e9e89e840 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-cfa99ec5-2412-46ce-942c-632e9e89e840 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:40.414150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:40.415196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:40.415196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:40.415196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:40.415196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:40.415196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:40.415196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:40.415196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:40.415196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:40.415196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:40.415196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:40.415196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:40.415196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:40.415196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:40.415196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:40.415196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:40.415196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:40.416185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:40.416185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:40.416185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:40.416185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:40.416185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:40.416185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:40.416185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:40.416185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:40.416185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:40.416185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:40.416185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:40.416185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:40.416185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:46:40.416185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:40.416185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 520/1034] 10.222.0.50 () {56 vars in 1105 bytes} [Thu Jun 2 15:46:40 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:40.421076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa99ec5-2412-46ce-942c-632e9e89e840 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:40.450139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:40.459699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:40.495153 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c3801-0443-4fc3-9783-b25f92244294 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:40.525956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa99ec5-2412-46ce-942c-632e9e89e840 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:40.529919 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b79192-d76a-477d-9da6-92a3c8585a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:40.530588 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79192-d76a-477d-9da6-92a3c8585a35 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.530877 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79192-d76a-477d-9da6-92a3c8585a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.531159 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b79192-d76a-477d-9da6-92a3c8585a35 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.532014 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b79192-d76a-477d-9da6-92a3c8585a35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:40.534962 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b79192-d76a-477d-9da6-92a3c8585a35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:40.536452 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b79192-d76a-477d-9da6-92a3c8585a35 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:40.554714 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 515/1035] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Jun 2 15:46:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:40.560172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b79192-d76a-477d-9da6-92a3c8585a35 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:40.562166 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8c38f-0e2f-4672-99b4-bf36a1449992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:40.562967 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8c38f-0e2f-4672-99b4-bf36a1449992 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.563256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8c38f-0e2f-4672-99b4-bf36a1449992 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.563654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8c38f-0e2f-4672-99b4-bf36a1449992 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.564419 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8c38f-0e2f-4672-99b4-bf36a1449992 None admin] RBAC: Adding query filter params (name=image) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:40.564726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8c38f-0e2f-4672-99b4-bf36a1449992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:40.566101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8c38f-0e2f-4672-99b4-bf36a1449992 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:40.575852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 521/1036] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:40.576886 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8c38f-0e2f-4672-99b4-bf36a1449992 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:40.672318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b79192-d76a-477d-9da6-92a3c8585a35 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:40.681968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:40.684827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8c38f-0e2f-4672-99b4-bf36a1449992 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:40.688287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:40.708094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80ed46-746f-4880-a3b2-9923096d10c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:40.708741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80ed46-746f-4880-a3b2-9923096d10c3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.709025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80ed46-746f-4880-a3b2-9923096d10c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.709851 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80ed46-746f-4880-a3b2-9923096d10c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.720235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a8c2a-6343-4234-a0e2-f9285aaeb7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:40.721243 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a8c2a-6343-4234-a0e2-f9285aaeb7be None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.721699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a8c2a-6343-4234-a0e2-f9285aaeb7be None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.721989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a8c2a-6343-4234-a0e2-f9285aaeb7be None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.722701 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a8c2a-6343-4234-a0e2-f9285aaeb7be None admin] RBAC: Adding query filter params (type=image) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:40.723016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a8c2a-6343-4234-a0e2-f9285aaeb7be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:40.724447 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a8c2a-6343-4234-a0e2-f9285aaeb7be None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:40.735140 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 522/1037] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:40.736364 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a8c2a-6343-4234-a0e2-f9285aaeb7be None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:40.781368 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80ed46-746f-4880-a3b2-9923096d10c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:40.782826 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80ed46-746f-4880-a3b2-9923096d10c3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:40.839362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a8c2a-6343-4234-a0e2-f9285aaeb7be None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:40.873760 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046abdd3-7962-40e4-af26-6b3dbf2ffe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:40.874430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046abdd3-7962-40e4-af26-6b3dbf2ffe4f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:40.874721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046abdd3-7962-40e4-af26-6b3dbf2ffe4f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:40.875030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046abdd3-7962-40e4-af26-6b3dbf2ffe4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:40.875820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046abdd3-7962-40e4-af26-6b3dbf2ffe4f None admin] RBAC: Adding query filter params (interface=public, service_id=333e72d443a945ab9333044bd6b4c352, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:40.876168 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046abdd3-7962-40e4-af26-6b3dbf2ffe4f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:40.877546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046abdd3-7962-40e4-af26-6b3dbf2ffe4f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:40.887807 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 523/1038] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Jun 2 15:46:40 2022] GET /identity/v3/endpoints?service_id=333e72d443a945ab9333044bd6b4c352&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:40.888816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046abdd3-7962-40e4-af26-6b3dbf2ffe4f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:40.893264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 516/1039] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 15:46:40.899095 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80ed46-746f-4880-a3b2-9923096d10c3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:40.914675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:40.918799 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:40.992502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046abdd3-7962-40e4-af26-6b3dbf2ffe4f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:41.004238 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80ed46-746f-4880-a3b2-9923096d10c3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:41.028254 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d5038-4d39-4170-bd87-7182b3a7fa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:41.028910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d5038-4d39-4170-bd87-7182b3a7fa5a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:41.029197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d5038-4d39-4170-bd87-7182b3a7fa5a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:41.029477 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d5038-4d39-4170-bd87-7182b3a7fa5a None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:41.030158 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d5038-4d39-4170-bd87-7182b3a7fa5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:41.031553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d5038-4d39-4170-bd87-7182b3a7fa5a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:41.038645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 524/1040] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Jun 2 15:46:40 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 15:46:41.039451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b74d6a-31ed-4d6e-a0c8-b51cd15870ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:41.040818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b74d6a-31ed-4d6e-a0c8-b51cd15870ff None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:41.041397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b74d6a-31ed-4d6e-a0c8-b51cd15870ff None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:41.041918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b74d6a-31ed-4d6e-a0c8-b51cd15870ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:41.054020 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b74d6a-31ed-4d6e-a0c8-b51cd15870ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:41.055890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b74d6a-31ed-4d6e-a0c8-b51cd15870ff None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:41.076498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f2b74d6a-31ed-4d6e-a0c8-b51cd15870ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:41.076498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:41.076498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:41.076498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:41.076498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:41.076498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:41.076498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:41.076498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:41.076498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:41.076498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:41.076498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:41.076498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:41.076498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:41.076498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:41.076498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:41.077606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:41.078540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:41.078540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:41.078540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:41.078540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:41.078540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 517/1041] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:41.084569 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d5038-4d39-4170-bd87-7182b3a7fa5a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:41.187735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:41.198310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d5038-4d39-4170-bd87-7182b3a7fa5a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:41.235269 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2ff64-4a1e-41d0-8307-badc141c5946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:41.236614 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2ff64-4a1e-41d0-8307-badc141c5946 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:41.236614 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2ff64-4a1e-41d0-8307-badc141c5946 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:41.236614 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2ff64-4a1e-41d0-8307-badc141c5946 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:41.237594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2ff64-4a1e-41d0-8307-badc141c5946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:41.237594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2ff64-4a1e-41d0-8307-badc141c5946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:41.239040 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2ff64-4a1e-41d0-8307-badc141c5946 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:41.251351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 525/1042] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:41.257066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b74d6a-31ed-4d6e-a0c8-b51cd15870ff None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:41.321263 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:41.363500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b74d6a-31ed-4d6e-a0c8-b51cd15870ff None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:41.401568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc40efe-5880-4641-8309-f8357deab96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:41.402363 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc40efe-5880-4641-8309-f8357deab96d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:41.402654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc40efe-5880-4641-8309-f8357deab96d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:41.402931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc40efe-5880-4641-8309-f8357deab96d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:41.409922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc40efe-5880-4641-8309-f8357deab96d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:41.411396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc40efe-5880-4641-8309-f8357deab96d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:41.425022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3dc40efe-5880-4641-8309-f8357deab96d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:41.425022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:41.425022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:41.425022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:41.425022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:41.425022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:41.425022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:41.425022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:41.425022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:41.425022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:41.425022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:41.425022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:41.425022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:41.425022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:41.425022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:41.425950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:41.426880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:41.426880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:41.426880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:41.426880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:41.426880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:41.426880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:41.426880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:41.426880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:41.426880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 518/1043] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:41.432431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2ff64-4a1e-41d0-8307-badc141c5946 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:41.537972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2ff64-4a1e-41d0-8307-badc141c5946 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:41.570999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dfd5a-72b9-4b2c-82cb-6ee03dcabd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:41.571717 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dfd5a-72b9-4b2c-82cb-6ee03dcabd42 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:41.571946 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dfd5a-72b9-4b2c-82cb-6ee03dcabd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:41.572252 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dfd5a-72b9-4b2c-82cb-6ee03dcabd42 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:41.573023 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dfd5a-72b9-4b2c-82cb-6ee03dcabd42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:41.573332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dfd5a-72b9-4b2c-82cb-6ee03dcabd42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:41.574766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dfd5a-72b9-4b2c-82cb-6ee03dcabd42 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:41.587362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 526/1044] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:41.593063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc40efe-5880-4641-8309-f8357deab96d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:41.691997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc40efe-5880-4641-8309-f8357deab96d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:41.715049 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:41.726346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f333e2-7902-482d-9b62-8e57d2a71e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:41.726996 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f333e2-7902-482d-9b62-8e57d2a71e05 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:41.727279 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f333e2-7902-482d-9b62-8e57d2a71e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:41.732717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f333e2-7902-482d-9b62-8e57d2a71e05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:41.732717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f333e2-7902-482d-9b62-8e57d2a71e05 None admin] RBAC: Adding query filter params (role.id=217a9a10dcf94e6fb5108443d1f55d92, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=2e53683ae2b34947a1550de269b74d10) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:41.732717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f333e2-7902-482d-9b62-8e57d2a71e05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:41.732717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f333e2-7902-482d-9b62-8e57d2a71e05 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:41.744022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 519/1045] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:41 2022] GET /identity/v3/role_assignments?user.id=2e53683ae2b34947a1550de269b74d10&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=217a9a10dcf94e6fb5108443d1f55d92 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:41.801802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919ecfb-ecea-4151-8743-8272cd8c2dad None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:41.802086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919ecfb-ecea-4151-8743-8272cd8c2dad None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:41.802375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919ecfb-ecea-4151-8743-8272cd8c2dad None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:41.804601 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 527/1046] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:41.810538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f06e93-fc18-44c7-8554-8f6dc6c44baa None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:41.810882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f06e93-fc18-44c7-8554-8f6dc6c44baa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:41.811114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f06e93-fc18-44c7-8554-8f6dc6c44baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:41.829107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-67f06e93-fc18-44c7-8554-8f6dc6c44baa None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:41.830249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-67f06e93-fc18-44c7-8554-8f6dc6c44baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:41.905529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 520/1047] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:41.929386 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919ecfb-ecea-4151-8743-8272cd8c2dad None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:41.944527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:42.033383 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919ecfb-ecea-4151-8743-8272cd8c2dad None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:42.067083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322182cb-7923-4f26-b02b-6cb0f79007b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:42.067881 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322182cb-7923-4f26-b02b-6cb0f79007b4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:42.068198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322182cb-7923-4f26-b02b-6cb0f79007b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:42.068483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322182cb-7923-4f26-b02b-6cb0f79007b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:42.078622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322182cb-7923-4f26-b02b-6cb0f79007b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:42.087021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-322182cb-7923-4f26-b02b-6cb0f79007b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:42.087021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:42.087021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:42.087021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:42.087021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:42.087021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:42.087021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:42.087021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:42.087021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:42.087021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:42.087021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:42.087021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:42.087021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:42.087021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:42.087021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:42.087021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:42.087966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:42.087966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:42.087966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:42.087966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:42.087966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:42.087966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:42.087966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:42.087966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:42.087966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:42.087966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:42.087966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:42.087966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:42.087966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:42.087966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:42.087966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:42.087966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:42.088894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:42.088894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:42.088894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:42.088894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:42.088894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:42.088894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:42.088894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:42.088894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:42.088894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:42.088894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:42.088894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:42.088894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:42.088894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 528/1048] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:42.095971 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f06e93-fc18-44c7-8554-8f6dc6c44baa None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:42.197051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f06e93-fc18-44c7-8554-8f6dc6c44baa None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:42.215066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:42.233713 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072ec6b-ad7f-463b-b7ad-1e8fb89dcceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:42.234392 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072ec6b-ad7f-463b-b7ad-1e8fb89dcceb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:42.234753 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072ec6b-ad7f-463b-b7ad-1e8fb89dcceb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:42.235029 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072ec6b-ad7f-463b-b7ad-1e8fb89dcceb None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:42.235772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072ec6b-ad7f-463b-b7ad-1e8fb89dcceb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:42.236117 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072ec6b-ad7f-463b-b7ad-1e8fb89dcceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:42.237488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072ec6b-ad7f-463b-b7ad-1e8fb89dcceb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:42.246498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 521/1049] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:42.253214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322182cb-7923-4f26-b02b-6cb0f79007b4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:42.326683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:42.361907 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322182cb-7923-4f26-b02b-6cb0f79007b4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:42.397671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710d8bf-db70-4018-92b5-33a5d44720c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:42.398557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710d8bf-db70-4018-92b5-33a5d44720c4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:42.398844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710d8bf-db70-4018-92b5-33a5d44720c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:42.399124 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710d8bf-db70-4018-92b5-33a5d44720c4 None admin] PATH_INFO: `/v3/users/ae9f0cdcdc0a46bbbb589832602d3bc8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:42.413360 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710d8bf-db70-4018-92b5-33a5d44720c4 None admin] RBAC: Authorizing `identity:get_user(user_id=ae9f0cdcdc0a46bbbb589832602d3bc8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:42.414808 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710d8bf-db70-4018-92b5-33a5d44720c4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:42.416681 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 529/1050] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:46:42 2022] GET /identity/v3/users/ae9f0cdcdc0a46bbbb589832602d3bc8 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:42.422199 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072ec6b-ad7f-463b-b7ad-1e8fb89dcceb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:42.523406 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072ec6b-ad7f-463b-b7ad-1e8fb89dcceb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:42.558766 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fd507-c973-41b6-a9f1-5e9dd90b06b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:42.559418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fd507-c973-41b6-a9f1-5e9dd90b06b5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:42.559706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fd507-c973-41b6-a9f1-5e9dd90b06b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:42.559998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fd507-c973-41b6-a9f1-5e9dd90b06b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:42.607959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:42.628196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fd507-c973-41b6-a9f1-5e9dd90b06b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:42.629585 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fd507-c973-41b6-a9f1-5e9dd90b06b5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:42.726886 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 522/1051] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:42 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:46:42.732494 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710d8bf-db70-4018-92b5-33a5d44720c4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:42.831278 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710d8bf-db70-4018-92b5-33a5d44720c4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:42.861842 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:42.868797 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcc3bf-ed47-4d5a-9586-a6eafaee84dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:42.869980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcc3bf-ed47-4d5a-9586-a6eafaee84dd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:42.870270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcc3bf-ed47-4d5a-9586-a6eafaee84dd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:42.870552 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcc3bf-ed47-4d5a-9586-a6eafaee84dd None admin] PATH_INFO: `/v3/projects/9dedd2f8fb5c4b458dade8dab4a7fe12` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:42.871745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcc3bf-ed47-4d5a-9586-a6eafaee84dd None admin] RBAC: Authorizing `identity:get_project(project_id=9dedd2f8fb5c4b458dade8dab4a7fe12)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:42.873230 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcc3bf-ed47-4d5a-9586-a6eafaee84dd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:42.875453 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 530/1052] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:42 2022] GET /identity/v3/projects/9dedd2f8fb5c4b458dade8dab4a7fe12 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:42.881120 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fd507-c973-41b6-a9f1-5e9dd90b06b5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:42.963412 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:42.982627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fd507-c973-41b6-a9f1-5e9dd90b06b5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:43.023231 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add24700-66f4-4c4d-963a-0093bc7a1464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:43.023900 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add24700-66f4-4c4d-963a-0093bc7a1464 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.024231 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add24700-66f4-4c4d-963a-0093bc7a1464 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.024517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add24700-66f4-4c4d-963a-0093bc7a1464 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:43.025384 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add24700-66f4-4c4d-963a-0093bc7a1464 None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=9dedd2f8fb5c4b458dade8dab4a7fe12, user.id=ae9f0cdcdc0a46bbbb589832602d3bc8) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:43.025702 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add24700-66f4-4c4d-963a-0093bc7a1464 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:43.027520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add24700-66f4-4c4d-963a-0093bc7a1464 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:43.037869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 523/1053] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:42 2022] GET /identity/v3/role_assignments?user.id=ae9f0cdcdc0a46bbbb589832602d3bc8&scope.project.id=9dedd2f8fb5c4b458dade8dab4a7fe12&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:43.337404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e4407-71d9-48cf-b795-46500685437c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.337947 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e4407-71d9-48cf-b795-46500685437c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.337947 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e4407-71d9-48cf-b795-46500685437c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:43.339503 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 531/1054] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:43.344721 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991aa5ad-633b-4b35-b0f4-67ba51000bed None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.345122 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991aa5ad-633b-4b35-b0f4-67ba51000bed None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.345287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991aa5ad-633b-4b35-b0f4-67ba51000bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:43.368236 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-991aa5ad-633b-4b35-b0f4-67ba51000bed None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:43.369698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-991aa5ad-633b-4b35-b0f4-67ba51000bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:43.439364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 524/1055] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:43.462857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e4407-71d9-48cf-b795-46500685437c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:43.564248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e4407-71d9-48cf-b795-46500685437c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:43.598200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fac11a-d725-4092-8159-2e3284e30df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:43.598997 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fac11a-d725-4092-8159-2e3284e30df9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.599200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fac11a-d725-4092-8159-2e3284e30df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.599485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fac11a-d725-4092-8159-2e3284e30df9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:43.600229 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fac11a-d725-4092-8159-2e3284e30df9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:43.601639 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fac11a-d725-4092-8159-2e3284e30df9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-23fac11a-d725-4092-8159-2e3284e30df9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:43.613076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:43.614148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:43.614148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:43.614148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:43.614148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:43.614148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:43.614148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:43.614148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:46:43.614148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:46:43.614148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:46:43.614148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:46:43.614148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:43.614148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:43.614148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:43.614148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:43.614148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:43.614148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:43.615027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:43.615027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:43.615027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:43.615027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:43.615027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:43.615027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:43.615027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:43.615027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:43.615027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:43.615027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:43.615027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:46:43.615027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:46:43.615027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 15:46:43.615027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:43.619973 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 532/1056] 10.222.0.50 () {56 vars in 1105 bytes} [Thu Jun 2 15:46:43 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:43.621260 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991aa5ad-633b-4b35-b0f4-67ba51000bed None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:43.699503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:43.723812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991aa5ad-633b-4b35-b0f4-67ba51000bed None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:43.758774 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a93264-b63f-4873-a791-2c836144a222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:43.759451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a93264-b63f-4873-a791-2c836144a222 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.759741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a93264-b63f-4873-a791-2c836144a222 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.760046 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a93264-b63f-4873-a791-2c836144a222 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:43.760762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a93264-b63f-4873-a791-2c836144a222 None admin] RBAC: Adding query filter params (name=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:43.761077 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a93264-b63f-4873-a791-2c836144a222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:43.762451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a93264-b63f-4873-a791-2c836144a222 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:43.767504 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 525/1057] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:43.773156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fac11a-d725-4092-8159-2e3284e30df9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:43.834741 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:43.876178 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fac11a-d725-4092-8159-2e3284e30df9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:43.909534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba9de4-7d01-483a-aec9-cde2dc7e82ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:43.910202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba9de4-7d01-483a-aec9-cde2dc7e82ad None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.910494 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba9de4-7d01-483a-aec9-cde2dc7e82ad None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.910778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba9de4-7d01-483a-aec9-cde2dc7e82ad None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:43.911477 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba9de4-7d01-483a-aec9-cde2dc7e82ad None admin] RBAC: Adding query filter params (type=image) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:43.911791 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba9de4-7d01-483a-aec9-cde2dc7e82ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:43.913729 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba9de4-7d01-483a-aec9-cde2dc7e82ad None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:43.918820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 533/1058] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:43.924570 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a93264-b63f-4873-a791-2c836144a222 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:43.987231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21013309-99ff-49b8-a62a-30d6a3206a61 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.987520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21013309-99ff-49b8-a62a-30d6a3206a61 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.987793 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21013309-99ff-49b8-a62a-30d6a3206a61 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:43.989323 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 534/1059] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:43.994081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fcbc9-fc95-47f1-a3b5-0e338b843439 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:43.994366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fcbc9-fc95-47f1-a3b5-0e338b843439 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:43.994902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fcbc9-fc95-47f1-a3b5-0e338b843439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.012138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cc4fcbc9-fc95-47f1-a3b5-0e338b843439 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:44.013333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cc4fcbc9-fc95-47f1-a3b5-0e338b843439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:44.027613 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a93264-b63f-4873-a791-2c836144a222 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:44.064180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139168e1-fe13-456b-9759-f8bf5d9dfb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:44.064838 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139168e1-fe13-456b-9759-f8bf5d9dfb2e None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.065126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139168e1-fe13-456b-9759-f8bf5d9dfb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.065402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139168e1-fe13-456b-9759-f8bf5d9dfb2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.066148 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139168e1-fe13-456b-9759-f8bf5d9dfb2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:44.067517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139168e1-fe13-456b-9759-f8bf5d9dfb2e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:44.075698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:44.081759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 535/1060] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:44.104877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fcbc9-fc95-47f1-a3b5-0e338b843439 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:44.144726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 526/1061] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Jun 2 15:46:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:44.166226 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:44.215779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fcbc9-fc95-47f1-a3b5-0e338b843439 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:44.260461 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c0ced-2d20-4e46-a971-8304755abe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:44.261290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c0ced-2d20-4e46-a971-8304755abe0f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.261577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c0ced-2d20-4e46-a971-8304755abe0f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.261854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c0ced-2d20-4e46-a971-8304755abe0f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.274020 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c0ced-2d20-4e46-a971-8304755abe0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:44.282492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-450c0ced-2d20-4e46-a971-8304755abe0f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:46:44.282492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:44.282492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:44.282492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:44.282492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:44.282492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:44.282492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:44.282492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:44.282492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:44.282492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:44.282492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:44.282492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:44.282492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:44.282492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:44.282492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:44.282492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:44.283586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:44.283586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:44.283586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:44.283586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:44.283586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:44.283586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:44.283586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:44.283586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:44.283586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:44.283586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:44.283586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:44.283586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:44.283586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:44.283586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:44.283586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:44.283586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:44.284487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:44.284487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:44.284487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:44.284487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:44.284487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:44.284487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:44.284487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:44.284487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:44.284487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:44.284487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:44.284487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:46:44.284487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:44.289520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 536/1062] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Jun 2 15:46:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:44.290868 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139168e1-fe13-456b-9759-f8bf5d9dfb2e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:44.404099 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139168e1-fe13-456b-9759-f8bf5d9dfb2e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:44.440242 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f44548-0c86-419e-b489-a5885093dfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:44.440898 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f44548-0c86-419e-b489-a5885093dfa9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.441233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f44548-0c86-419e-b489-a5885093dfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.441517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f44548-0c86-419e-b489-a5885093dfa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.442256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f44548-0c86-419e-b489-a5885093dfa9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:44.442568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f44548-0c86-419e-b489-a5885093dfa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:44.443972 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f44548-0c86-419e-b489-a5885093dfa9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:44.452379 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 527/1063] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Jun 2 15:46:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:44.458125 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c0ced-2d20-4e46-a971-8304755abe0f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:44.559515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c0ced-2d20-4e46-a971-8304755abe0f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:44.573045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:44.594340 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be488b-9d34-42d6-bde8-53c65719d6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:44.595133 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be488b-9d34-42d6-bde8-53c65719d6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.595420 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be488b-9d34-42d6-bde8-53c65719d6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.595698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be488b-9d34-42d6-bde8-53c65719d6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.606623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be488b-9d34-42d6-bde8-53c65719d6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:44.608228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be488b-9d34-42d6-bde8-53c65719d6d1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:44.625642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e3be488b-9d34-42d6-bde8-53c65719d6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:44.625642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:44.625642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:44.625642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:44.625642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:44.625642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:44.625642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:44.625642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:44.625642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:44.625642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:44.625642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:44.625642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:44.625642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:44.625642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:44.625642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:44.626581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:44.627548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:44.627548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:44.627548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:44.627548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:44.628426 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 537/1064] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:44.633213 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f44548-0c86-419e-b489-a5885093dfa9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:44.696535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:44.741077 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f44548-0c86-419e-b489-a5885093dfa9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:44.776255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cba5c-b480-4db7-b08f-0d9cc63c1443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:44.776942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cba5c-b480-4db7-b08f-0d9cc63c1443 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.777230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cba5c-b480-4db7-b08f-0d9cc63c1443 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.777505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cba5c-b480-4db7-b08f-0d9cc63c1443 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.778220 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cba5c-b480-4db7-b08f-0d9cc63c1443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:44.778526 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cba5c-b480-4db7-b08f-0d9cc63c1443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:44.779894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cba5c-b480-4db7-b08f-0d9cc63c1443 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:44.796983 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 528/1065] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:44.798597 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be488b-9d34-42d6-bde8-53c65719d6d1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:44.901118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be488b-9d34-42d6-bde8-53c65719d6d1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:44.934542 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2a070-665a-4bd9-8ae5-9daa33954326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:44.935338 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2a070-665a-4bd9-8ae5-9daa33954326 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:44.935687 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2a070-665a-4bd9-8ae5-9daa33954326 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:44.935978 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2a070-665a-4bd9-8ae5-9daa33954326 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:44.943704 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f2a070-665a-4bd9-8ae5-9daa33954326 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:44.945210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f2a070-665a-4bd9-8ae5-9daa33954326 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:44.960432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c3f2a070-665a-4bd9-8ae5-9daa33954326 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:44.960432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:44.960432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:44.960432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:44.960432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:44.960432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:44.960432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:44.960432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:44.960432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:44.960432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:44.960432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:44.960432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:44.960432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:44.960432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:44.960432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:44.960432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:44.961468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:44.962538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:44.962538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:44.962538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:44.962538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:44.962538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:44.962538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:44.962538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:44.962538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:44.962538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:44.962538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:44.964111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 538/1066] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Jun 2 15:46:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:44.968267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cba5c-b480-4db7-b08f-0d9cc63c1443 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.076586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cba5c-b480-4db7-b08f-0d9cc63c1443 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.093714 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:45.111463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ff974-ff19-4507-8d52-78f8543dc328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.112202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ff974-ff19-4507-8d52-78f8543dc328 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.112456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ff974-ff19-4507-8d52-78f8543dc328 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.112739 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ff974-ff19-4507-8d52-78f8543dc328 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.113567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ff974-ff19-4507-8d52-78f8543dc328 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:45.113881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ff974-ff19-4507-8d52-78f8543dc328 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:45.115868 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ff974-ff19-4507-8d52-78f8543dc328 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:45.138408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 529/1067] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Jun 2 15:46:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:45.139728 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2a070-665a-4bd9-8ae5-9daa33954326 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.166107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:45.240321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2a070-665a-4bd9-8ae5-9daa33954326 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.274483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12284f1-8a4d-4013-a035-024da9b7d965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.275629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12284f1-8a4d-4013-a035-024da9b7d965 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.276160 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12284f1-8a4d-4013-a035-024da9b7d965 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.276647 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12284f1-8a4d-4013-a035-024da9b7d965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.286959 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12284f1-8a4d-4013-a035-024da9b7d965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:45.289315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12284f1-8a4d-4013-a035-024da9b7d965 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:45.306122 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f27f7a-682e-4227-a67d-4ca520ae2f6c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.306468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f27f7a-682e-4227-a67d-4ca520ae2f6c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.306700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f27f7a-682e-4227-a67d-4ca520ae2f6c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.308306 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 530/1068] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:45.308626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d12284f1-8a4d-4013-a035-024da9b7d965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:45.308626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:45.308626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:45.308626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:45.308626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:45.308626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:45.308626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:45.308626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:45.308626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:45.308626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:45.308626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:45.308626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:45.308626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:45.308626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:45.308626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:45.309522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:45.315285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:45.315285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:45.315285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:45.315285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:45.315285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 539/1069] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:45.315574 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12284f1-8a4d-4013-a035-024da9b7d965 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.315922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006b466-465c-418c-965a-47b6fa488c9b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.316065 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006b466-465c-418c-965a-47b6fa488c9b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.316356 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3006b466-465c-418c-965a-47b6fa488c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.332842 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3006b466-465c-418c-965a-47b6fa488c9b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:45.334029 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3006b466-465c-418c-965a-47b6fa488c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:45.408149 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:45.424825 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 531/1070] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:45.431816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12284f1-8a4d-4013-a035-024da9b7d965 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.447907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006b466-465c-418c-965a-47b6fa488c9b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.469486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c1b9f-e2c4-4f4f-ae9b-caab6454d71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.470156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c1b9f-e2c4-4f4f-ae9b-caab6454d71d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.470445 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c1b9f-e2c4-4f4f-ae9b-caab6454d71d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.470731 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c1b9f-e2c4-4f4f-ae9b-caab6454d71d None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.471511 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c1b9f-e2c4-4f4f-ae9b-caab6454d71d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:45.471894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c1b9f-e2c4-4f4f-ae9b-caab6454d71d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:45.473313 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c1b9f-e2c4-4f4f-ae9b-caab6454d71d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:45.490151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 540/1071] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:45.491843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c1b9f-e2c4-4f4f-ae9b-caab6454d71d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.560876 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3006b466-465c-418c-965a-47b6fa488c9b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.564094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:45.596577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c1b9f-e2c4-4f4f-ae9b-caab6454d71d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.596950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab8c6c-5fe7-47f7-b36d-de420cdcd373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.598093 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab8c6c-5fe7-47f7-b36d-de420cdcd373 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.598822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab8c6c-5fe7-47f7-b36d-de420cdcd373 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.599111 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab8c6c-5fe7-47f7-b36d-de420cdcd373 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.610763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab8c6c-5fe7-47f7-b36d-de420cdcd373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:45.618529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-feab8c6c-5fe7-47f7-b36d-de420cdcd373 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:45.618529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:45.618529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:45.618529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:45.618529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:45.618529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:45.618529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:45.618529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:45.618529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:45.618529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:45.618529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:45.618529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:45.618529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:45.618529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:45.618529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:45.618529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:45.619921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:45.619921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:45.619921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:45.619921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:45.619921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:45.619921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:45.619921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:45.619921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:45.619921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:45.619921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:45.619921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:45.619921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:45.619921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:45.619921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:45.619921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:45.619921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:45.620882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:45.620882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:45.620882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:45.620882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:45.620882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:45.620882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:45.620882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:45.620882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:45.620882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:45.620882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:45.620882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:45.620882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:45.620882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 532/1072] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:45.626411 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab8c6c-5fe7-47f7-b36d-de420cdcd373 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.635261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb28de-84f0-4a69-92a1-9fdc10748db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.636174 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb28de-84f0-4a69-92a1-9fdc10748db5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.636463 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb28de-84f0-4a69-92a1-9fdc10748db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.636741 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb28de-84f0-4a69-92a1-9fdc10748db5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.640094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:45.646411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb28de-84f0-4a69-92a1-9fdc10748db5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:45.648492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb28de-84f0-4a69-92a1-9fdc10748db5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:45.669645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-63cb28de-84f0-4a69-92a1-9fdc10748db5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:45.669645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:45.669645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:45.669645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:45.669645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:45.669645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:45.669645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:45.669645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:45.669645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:45.669645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:45.669645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:45.669645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:45.669645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:45.669645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:45.669645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:45.676990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:45.678933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:45.678933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:45.678933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:45.678933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:45.678933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:45.678933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:45.678933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:45.678933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:45.678933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 541/1073] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:45.681415 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb28de-84f0-4a69-92a1-9fdc10748db5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.739032 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab8c6c-5fe7-47f7-b36d-de420cdcd373 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.774650 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbea583-cc72-44ca-b626-f0d82d48be65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.775240 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbea583-cc72-44ca-b626-f0d82d48be65 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.775579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbea583-cc72-44ca-b626-f0d82d48be65 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.775871 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbea583-cc72-44ca-b626-f0d82d48be65 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.776681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbea583-cc72-44ca-b626-f0d82d48be65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:45.776997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbea583-cc72-44ca-b626-f0d82d48be65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:45.778363 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbea583-cc72-44ca-b626-f0d82d48be65 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:45.786865 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 533/1074] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:45.789271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb28de-84f0-4a69-92a1-9fdc10748db5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.792487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbea583-cc72-44ca-b626-f0d82d48be65 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.822994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:45.825323 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2da4f-b66a-40ee-b009-ce2b07a741c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.825996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2da4f-b66a-40ee-b009-ce2b07a741c2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.826298 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2da4f-b66a-40ee-b009-ce2b07a741c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.826563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2da4f-b66a-40ee-b009-ce2b07a741c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.827350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2da4f-b66a-40ee-b009-ce2b07a741c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:45.827673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2da4f-b66a-40ee-b009-ce2b07a741c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:45.829154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2da4f-b66a-40ee-b009-ce2b07a741c2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:45.841626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 542/1075] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:45.847404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2da4f-b66a-40ee-b009-ce2b07a741c2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.906478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbea583-cc72-44ca-b626-f0d82d48be65 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.907366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:45.945146 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d527645-a660-44df-8bc9-fb66fe4f2d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.946035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d527645-a660-44df-8bc9-fb66fe4f2d04 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.946395 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d527645-a660-44df-8bc9-fb66fe4f2d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.946602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d527645-a660-44df-8bc9-fb66fe4f2d04 None admin] PATH_INFO: `/v3/users/ae9f0cdcdc0a46bbbb589832602d3bc8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.947812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d527645-a660-44df-8bc9-fb66fe4f2d04 None admin] RBAC: Authorizing `identity:get_user(user_id=ae9f0cdcdc0a46bbbb589832602d3bc8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:45.949282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d527645-a660-44df-8bc9-fb66fe4f2d04 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:45.950927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 534/1076] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:46:45 2022] GET /identity/v3/users/ae9f0cdcdc0a46bbbb589832602d3bc8 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:45.952354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2da4f-b66a-40ee-b009-ce2b07a741c2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:45.956373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d527645-a660-44df-8bc9-fb66fe4f2d04 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:45.991593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c79647-5975-47a6-88b8-ac5b87238d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:45.991593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c79647-5975-47a6-88b8-ac5b87238d53 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:45.991924 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c79647-5975-47a6-88b8-ac5b87238d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:45.992293 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c79647-5975-47a6-88b8-ac5b87238d53 None admin] PATH_INFO: `/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/2e53683ae2b34947a1550de269b74d10/roles/217a9a10dcf94e6fb5108443d1f55d92` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:45.995306 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c79647-5975-47a6-88b8-ac5b87238d53 None admin] RBAC: Authorizing `identity:create_grant(project_id=e2775777647e4323a554bb3a5d045fc0, user_id=2e53683ae2b34947a1550de269b74d10, role_id=217a9a10dcf94e6fb5108443d1f55d92)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:45.996799 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c79647-5975-47a6-88b8-ac5b87238d53 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:46.052514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:46.057042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 543/1077] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:46:45 2022] PUT /identity/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/2e53683ae2b34947a1550de269b74d10/roles/217a9a10dcf94e6fb5108443d1f55d92 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:46:46.059553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d527645-a660-44df-8bc9-fb66fe4f2d04 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:46.097360 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248560a-64aa-4c8e-b310-8908cff0a694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:46.098252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248560a-64aa-4c8e-b310-8908cff0a694 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:46.098538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248560a-64aa-4c8e-b310-8908cff0a694 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:46.098815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248560a-64aa-4c8e-b310-8908cff0a694 None admin] PATH_INFO: `/v3/projects/9dedd2f8fb5c4b458dade8dab4a7fe12` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:46.100685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248560a-64aa-4c8e-b310-8908cff0a694 None admin] RBAC: Authorizing `identity:get_project(project_id=9dedd2f8fb5c4b458dade8dab4a7fe12)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:46.102187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248560a-64aa-4c8e-b310-8908cff0a694 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:46.104345 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 535/1078] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:45 2022] GET /identity/v3/projects/9dedd2f8fb5c4b458dade8dab4a7fe12 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:46.110357 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c79647-5975-47a6-88b8-ac5b87238d53 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:46.220999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c79647-5975-47a6-88b8-ac5b87238d53 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:46.238789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:46.261838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06da92-0f6f-44df-9980-26aca9448121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:46.262750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06da92-0f6f-44df-9980-26aca9448121 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:46.263035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06da92-0f6f-44df-9980-26aca9448121 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:46.263317 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06da92-0f6f-44df-9980-26aca9448121 None admin] PATH_INFO: `/v3/projects/9dedd2f8fb5c4b458dade8dab4a7fe12/users/ae9f0cdcdc0a46bbbb589832602d3bc8/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:46.265355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06da92-0f6f-44df-9980-26aca9448121 None admin] RBAC: Authorizing `identity:create_grant(project_id=9dedd2f8fb5c4b458dade8dab4a7fe12, user_id=ae9f0cdcdc0a46bbbb589832602d3bc8, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:46.266809 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06da92-0f6f-44df-9980-26aca9448121 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:46.375147 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 544/1079] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:46:46 2022] PUT /identity/v3/projects/9dedd2f8fb5c4b458dade8dab4a7fe12/users/ae9f0cdcdc0a46bbbb589832602d3bc8/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:46:46.462210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c474c-aef3-4bf8-a5cc-870c1e83ba91 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:46.462791 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c474c-aef3-4bf8-a5cc-870c1e83ba91 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:46.462791 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c474c-aef3-4bf8-a5cc-870c1e83ba91 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:46.464358 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 536/1080] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:46.469972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc8e20-de0c-44f8-b998-5cf3fec55e95 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:46.470510 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc8e20-de0c-44f8-b998-5cf3fec55e95 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:46.470611 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc8e20-de0c-44f8-b998-5cf3fec55e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:46.489133 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-25cc8e20-de0c-44f8-b998-5cf3fec55e95 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:46.490396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-25cc8e20-de0c-44f8-b998-5cf3fec55e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:46.563576 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 545/1081] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:46.586467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c474c-aef3-4bf8-a5cc-870c1e83ba91 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:46.690510 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c474c-aef3-4bf8-a5cc-870c1e83ba91 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:46.724346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7206c-0e86-468e-9cfe-7533ed060653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:46.725544 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7206c-0e86-468e-9cfe-7533ed060653 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:46.725829 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7206c-0e86-468e-9cfe-7533ed060653 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:46.726106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7206c-0e86-468e-9cfe-7533ed060653 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:46.755851 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:46.794866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7206c-0e86-468e-9cfe-7533ed060653 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:46.796452 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7206c-0e86-468e-9cfe-7533ed060653 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:46.894884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 537/1082] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:46:46.900545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc8e20-de0c-44f8-b998-5cf3fec55e95 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:46.999432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc8e20-de0c-44f8-b998-5cf3fec55e95 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:47.006830 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:47.034892 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a13a0-40ce-4f96-bbb4-75b8b93c21dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:47.036445 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a13a0-40ce-4f96-bbb4-75b8b93c21dc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:47.037043 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a13a0-40ce-4f96-bbb4-75b8b93c21dc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:47.038142 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a13a0-40ce-4f96-bbb4-75b8b93c21dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:47.050332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a13a0-40ce-4f96-bbb4-75b8b93c21dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:47.052733 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a13a0-40ce-4f96-bbb4-75b8b93c21dc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:47.072992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9f9a13a0-40ce-4f96-bbb4-75b8b93c21dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:47.072992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:47.072992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:47.072992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:47.072992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:47.072992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:47.072992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:47.072992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:47.072992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:47.072992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:47.072992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:47.072992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:47.072992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:47.072992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:47.072992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:47.075077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:47.076209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:47.076209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:47.076209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:47.076209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:47.076209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 546/1083] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:47.080307 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7206c-0e86-468e-9cfe-7533ed060653 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:47.143740 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:47.182478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7206c-0e86-468e-9cfe-7533ed060653 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:47.216868 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30b992-c64c-4f58-83dc-33c299d95e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:47.217559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30b992-c64c-4f58-83dc-33c299d95e0b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:47.217846 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30b992-c64c-4f58-83dc-33c299d95e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:47.218126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30b992-c64c-4f58-83dc-33c299d95e0b None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:47.218872 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30b992-c64c-4f58-83dc-33c299d95e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:47.219187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30b992-c64c-4f58-83dc-33c299d95e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:47.220657 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30b992-c64c-4f58-83dc-33c299d95e0b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:47.233727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 538/1084] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:48.360446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15e9aa-8921-45c6-bbd0-a2cd779cc219 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.361001 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15e9aa-8921-45c6-bbd0-a2cd779cc219 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.361001 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15e9aa-8921-45c6-bbd0-a2cd779cc219 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.362388 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 547/1085] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:48.368155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877acbb8-27c1-404d-b665-a1624c00d94d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.368554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877acbb8-27c1-404d-b665-a1624c00d94d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.368723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877acbb8-27c1-404d-b665-a1624c00d94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.385994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-877acbb8-27c1-404d-b665-a1624c00d94d None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:48.387182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-877acbb8-27c1-404d-b665-a1624c00d94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:48.459859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 539/1086] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:48.483772 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15e9aa-8921-45c6-bbd0-a2cd779cc219 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:48.584062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15e9aa-8921-45c6-bbd0-a2cd779cc219 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:48.617925 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758853d7-e4f7-4d8d-8fd1-e5b3dc61276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:48.618658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758853d7-e4f7-4d8d-8fd1-e5b3dc61276c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.618942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758853d7-e4f7-4d8d-8fd1-e5b3dc61276c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.619214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758853d7-e4f7-4d8d-8fd1-e5b3dc61276c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.629347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758853d7-e4f7-4d8d-8fd1-e5b3dc61276c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:48.637455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-758853d7-e4f7-4d8d-8fd1-e5b3dc61276c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:46:48.637455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:48.637455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:48.637455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:48.637455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:48.637455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:48.637455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:48.637455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:48.637455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:48.637455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:48.637455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:48.637455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:48.637455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:48.637455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:48.637455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:48.637455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:48.638589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:48.638589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:48.638589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:48.638589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:48.638589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:48.638589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:48.638589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:48.638589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:48.638589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:48.638589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:48.638589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:48.638589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:48.638589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:48.638589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:48.638589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:48.638589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:48.639504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:48.639504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:48.639504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:48.639504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:48.639504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:48.639504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:48.639504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:48.639504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:48.639504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:48.639504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:48.639504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 15:46:48.639504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:48.639504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 548/1087] 10.222.0.50 () {56 vars in 1120 bytes} [Thu Jun 2 15:46:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:46:48.644870 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877acbb8-27c1-404d-b665-a1624c00d94d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:48.650867 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d8276-77a5-4227-b032-4917277829fd None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.651162 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d8276-77a5-4227-b032-4917277829fd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.651444 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d8276-77a5-4227-b032-4917277829fd None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.652806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 549/1088] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:46:48.657895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa14ef6-2657-4297-911b-7b369f4224cf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.658346 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa14ef6-2657-4297-911b-7b369f4224cf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.658630 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa14ef6-2657-4297-911b-7b369f4224cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.676100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6aa14ef6-2657-4297-911b-7b369f4224cf None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:48.677252 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6aa14ef6-2657-4297-911b-7b369f4224cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:48.690038 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:48.697317 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:48.744100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 550/1089] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:46:48.748759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877acbb8-27c1-404d-b665-a1624c00d94d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:48.770874 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa14ef6-2657-4297-911b-7b369f4224cf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:48.783611 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f945188-74dc-48bd-8820-a0131a2b1190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:48.784309 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f945188-74dc-48bd-8820-a0131a2b1190 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.784597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f945188-74dc-48bd-8820-a0131a2b1190 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.784875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f945188-74dc-48bd-8820-a0131a2b1190 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.785625 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f945188-74dc-48bd-8820-a0131a2b1190 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:48.785933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f945188-74dc-48bd-8820-a0131a2b1190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:48.787338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f945188-74dc-48bd-8820-a0131a2b1190 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:48.795363 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 540/1090] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Jun 2 15:46:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:48.800971 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f945188-74dc-48bd-8820-a0131a2b1190 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:48.873307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa14ef6-2657-4297-911b-7b369f4224cf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:48.898915 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f945188-74dc-48bd-8820-a0131a2b1190 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:48.906984 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf0665-5333-4276-aa2b-dc8bbe3a17bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:48.907776 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf0665-5333-4276-aa2b-dc8bbe3a17bf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.908086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf0665-5333-4276-aa2b-dc8bbe3a17bf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.908369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf0665-5333-4276-aa2b-dc8bbe3a17bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.911883 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:48.918414 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf0665-5333-4276-aa2b-dc8bbe3a17bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:46:48.926032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-98cf0665-5333-4276-aa2b-dc8bbe3a17bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:48.926032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:48.926032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:48.926032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:48.926032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:48.926032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:48.926032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:48.926032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:48.926032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:48.926032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:48.926032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:48.926032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:48.926032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:46:48.926032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:46:48.926032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:46:48.926032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:46:48.933706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:46:48.933706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:46:48.933706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:46:48.933706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:46:48.933706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:48.933706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:48.933706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:48.933706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:48.933706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:48.933706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:48.933706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:48.933706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:48.933706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:48.933706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:48.933706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:48.933706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:48.934836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:48.934836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:48.934836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:48.934836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:48.934836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:46:48.934836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:46:48.934836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:46:48.934836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:46:48.934836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:46:48.934836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:46:48.934836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:46:48.934836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:46:48.934836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 551/1091] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:46:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:48.935738 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5542574-f393-4ee5-b22e-fd8d8f80a1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:48.935738 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5542574-f393-4ee5-b22e-fd8d8f80a1fd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:48.935738 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5542574-f393-4ee5-b22e-fd8d8f80a1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:48.935738 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5542574-f393-4ee5-b22e-fd8d8f80a1fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:48.936123 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf0665-5333-4276-aa2b-dc8bbe3a17bf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:48.946879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5542574-f393-4ee5-b22e-fd8d8f80a1fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:48.947301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:48.948383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5542574-f393-4ee5-b22e-fd8d8f80a1fd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:48.966349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f5542574-f393-4ee5-b22e-fd8d8f80a1fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:48.966349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:48.966349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:48.966349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:48.966349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:48.966349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:48.966349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:48.966349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:48.966349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:48.966349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:48.966349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:48.966349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:48.966349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:48.966349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:48.966349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:48.967364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:48.968354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:48.968354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:48.968354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:48.968354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:48.968354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 541/1092] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:48.973250 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5542574-f393-4ee5-b22e-fd8d8f80a1fd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.035941 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf0665-5333-4276-aa2b-dc8bbe3a17bf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.069568 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8c202-1dc8-403a-bffa-1ce565969224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.070224 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8c202-1dc8-403a-bffa-1ce565969224 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.070508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8c202-1dc8-403a-bffa-1ce565969224 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.070839 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8c202-1dc8-403a-bffa-1ce565969224 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.071113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5542574-f393-4ee5-b22e-fd8d8f80a1fd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.071579 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8c202-1dc8-403a-bffa-1ce565969224 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:49.071885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8c202-1dc8-403a-bffa-1ce565969224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.073307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8c202-1dc8-403a-bffa-1ce565969224 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.081314 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 552/1093] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:46:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:49.087474 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8c202-1dc8-403a-bffa-1ce565969224 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.109717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05759056-3f7c-48b2-894c-1fa29effe1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.110393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05759056-3f7c-48b2-894c-1fa29effe1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.110686 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05759056-3f7c-48b2-894c-1fa29effe1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.110966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05759056-3f7c-48b2-894c-1fa29effe1c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.111728 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05759056-3f7c-48b2-894c-1fa29effe1c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:49.112335 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05759056-3f7c-48b2-894c-1fa29effe1c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.114492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05759056-3f7c-48b2-894c-1fa29effe1c6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.127506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 542/1094] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:49.133503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05759056-3f7c-48b2-894c-1fa29effe1c6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.158087 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:49.161939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:49.187250 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8c202-1dc8-403a-bffa-1ce565969224 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.220658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5db0ac-89aa-4d00-8f62-a632ff890703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.221519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5db0ac-89aa-4d00-8f62-a632ff890703 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.221803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5db0ac-89aa-4d00-8f62-a632ff890703 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.222079 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5db0ac-89aa-4d00-8f62-a632ff890703 None admin] PATH_INFO: `/v3/users/ae9f0cdcdc0a46bbbb589832602d3bc8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.223391 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5db0ac-89aa-4d00-8f62-a632ff890703 None admin] RBAC: Authorizing `identity:get_user(user_id=ae9f0cdcdc0a46bbbb589832602d3bc8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.224893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5db0ac-89aa-4d00-8f62-a632ff890703 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.226511 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 553/1095] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/users/ae9f0cdcdc0a46bbbb589832602d3bc8 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:49.232117 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5db0ac-89aa-4d00-8f62-a632ff890703 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.232258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05759056-3f7c-48b2-894c-1fa29effe1c6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.266278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3d69d-3fad-4be7-b0f7-95794ce79967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.267056 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3d69d-3fad-4be7-b0f7-95794ce79967 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.267342 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3d69d-3fad-4be7-b0f7-95794ce79967 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.267623 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3d69d-3fad-4be7-b0f7-95794ce79967 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.274767 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3d69d-3fad-4be7-b0f7-95794ce79967 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.276425 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3d69d-3fad-4be7-b0f7-95794ce79967 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c4e3d69d-3fad-4be7-b0f7-95794ce79967 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:49.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:49.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:49.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:49.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:49.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:49.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:49.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:49.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:49.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:49.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:49.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:49.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:46:49.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:46:49.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:46:49.290890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:49.291903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:49.292987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:49.292987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:49.292987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:46:49.292987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:46:49.292987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:46:49.292987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:46:49.292987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:46:49.292987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:46:49.292987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 15:46:49.292987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:49.292987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 543/1096] 10.222.0.50 () {56 vars in 1093 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:49.297673 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3d69d-3fad-4be7-b0f7-95794ce79967 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.329813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5db0ac-89aa-4d00-8f62-a632ff890703 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.362894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ecc9b-30e1-4305-b3f2-3e4ca5630e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.363555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ecc9b-30e1-4305-b3f2-3e4ca5630e78 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.363890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ecc9b-30e1-4305-b3f2-3e4ca5630e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.364204 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ecc9b-30e1-4305-b3f2-3e4ca5630e78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.373121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:49.386254 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:49.397991 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3d69d-3fad-4be7-b0f7-95794ce79967 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.431875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0d35a-7414-409c-8c67-3b55af461723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.432614 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d35a-7414-409c-8c67-3b55af461723 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.432731 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ecc9b-30e1-4305-b3f2-3e4ca5630e78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.432900 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d35a-7414-409c-8c67-3b55af461723 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.433180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d35a-7414-409c-8c67-3b55af461723 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.434141 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ecc9b-30e1-4305-b3f2-3e4ca5630e78 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.434630 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0d35a-7414-409c-8c67-3b55af461723 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:49.434783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0d35a-7414-409c-8c67-3b55af461723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.436407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0d35a-7414-409c-8c67-3b55af461723 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.457610 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 544/1097] 10.222.0.50 () {56 vars in 1133 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:49.464057 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0d35a-7414-409c-8c67-3b55af461723 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.537072 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 554/1098] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 15:46:49.542992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ecc9b-30e1-4305-b3f2-3e4ca5630e78 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.571463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0d35a-7414-409c-8c67-3b55af461723 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.580644 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:49.604547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13013355-c3ce-4bef-b492-39f4c259f668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.605194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013355-c3ce-4bef-b492-39f4c259f668 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.605476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013355-c3ce-4bef-b492-39f4c259f668 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.605752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013355-c3ce-4bef-b492-39f4c259f668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.621137 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:49.639060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ecc9b-30e1-4305-b3f2-3e4ca5630e78 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.672058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610cbb8-2b11-4869-92c5-e9a91e7c2118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.672914 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610cbb8-2b11-4869-92c5-e9a91e7c2118 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.673038 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13013355-c3ce-4bef-b492-39f4c259f668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.673203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610cbb8-2b11-4869-92c5-e9a91e7c2118 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.673474 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610cbb8-2b11-4869-92c5-e9a91e7c2118 None admin] PATH_INFO: `/v3/projects/9dedd2f8fb5c4b458dade8dab4a7fe12` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.674428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13013355-c3ce-4bef-b492-39f4c259f668 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.674638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610cbb8-2b11-4869-92c5-e9a91e7c2118 None admin] RBAC: Authorizing `identity:get_project(project_id=9dedd2f8fb5c4b458dade8dab4a7fe12)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.676091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610cbb8-2b11-4869-92c5-e9a91e7c2118 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.678315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 555/1099] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/projects/9dedd2f8fb5c4b458dade8dab4a7fe12 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:49.684256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610cbb8-2b11-4869-92c5-e9a91e7c2118 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.770921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 545/1100] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 15:46:49.780115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13013355-c3ce-4bef-b492-39f4c259f668 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:49.781818 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610cbb8-2b11-4869-92c5-e9a91e7c2118 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.789554 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:49.815575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493e928-0569-4752-832c-f36d94ab2153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.816262 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493e928-0569-4752-832c-f36d94ab2153 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.816551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493e928-0569-4752-832c-f36d94ab2153 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.816831 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493e928-0569-4752-832c-f36d94ab2153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.817664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493e928-0569-4752-832c-f36d94ab2153 None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=9dedd2f8fb5c4b458dade8dab4a7fe12, user.id=ae9f0cdcdc0a46bbbb589832602d3bc8) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:49.817981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493e928-0569-4752-832c-f36d94ab2153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.819942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493e928-0569-4752-832c-f36d94ab2153 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.826451 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 556/1101] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/role_assignments?user.id=ae9f0cdcdc0a46bbbb589832602d3bc8&scope.project.id=9dedd2f8fb5c4b458dade8dab4a7fe12&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:46:49.831398 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:49.889558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13013355-c3ce-4bef-b492-39f4c259f668 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:49.925616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42952d54-3487-4652-8ad5-3525d27b7e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:49.926427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42952d54-3487-4652-8ad5-3525d27b7e75 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:49.926715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42952d54-3487-4652-8ad5-3525d27b7e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:49.926994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42952d54-3487-4652-8ad5-3525d27b7e75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:49.938114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42952d54-3487-4652-8ad5-3525d27b7e75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:49.939582 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42952d54-3487-4652-8ad5-3525d27b7e75 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:49.958560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-42952d54-3487-4652-8ad5-3525d27b7e75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:49.958560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:49.958560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:49.958560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:49.958560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:49.958560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:49.958560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:49.958560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:49.958560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:49.958560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:49.958560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:49.958560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:49.958560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:46:49.958560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:46:49.958560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:49.960230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:49.961167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:46:49.961167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:46:49.961167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:46:49.961167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:49.961167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 546/1102] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:49.966416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493e928-0569-4752-832c-f36d94ab2153 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:50.069888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493e928-0569-4752-832c-f36d94ab2153 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:50.102395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1be7c-5925-41a0-913e-efb90f84cc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:50.103068 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1be7c-5925-41a0-913e-efb90f84cc6c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:50.103354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1be7c-5925-41a0-913e-efb90f84cc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:50.103633 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1be7c-5925-41a0-913e-efb90f84cc6c None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:50.104387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1be7c-5925-41a0-913e-efb90f84cc6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:50.104698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1be7c-5925-41a0-913e-efb90f84cc6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:50.106063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1be7c-5925-41a0-913e-efb90f84cc6c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:50.118424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 557/1103] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:50.125008 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42952d54-3487-4652-8ad5-3525d27b7e75 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:50.218282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:50.223915 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42952d54-3487-4652-8ad5-3525d27b7e75 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:50.257519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21568d-b2b4-47d2-a049-f2b5740f6052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:50.258340 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21568d-b2b4-47d2-a049-f2b5740f6052 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:50.258629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21568d-b2b4-47d2-a049-f2b5740f6052 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:50.258907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21568d-b2b4-47d2-a049-f2b5740f6052 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:50.265629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21568d-b2b4-47d2-a049-f2b5740f6052 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:50.267070 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21568d-b2b4-47d2-a049-f2b5740f6052 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:50.281041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fd21568d-b2b4-47d2-a049-f2b5740f6052 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:50.281041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:46:50.281041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:46:50.281041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:46:50.281041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:46:50.281041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:46:50.281041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:46:50.281041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:46:50.281041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:46:50.281041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:46:50.281041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:46:50.281041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:46:50.281041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:46:50.281041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:46:50.281041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:46:50.281918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:46:50.282839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:46:50.282839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:46:50.282839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:46:50.282839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:46:50.282839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:46:50.282839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:46:50.282839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:46:50.282839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:46:50.282839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 547/1104] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:46:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:46:50.288536 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1be7c-5925-41a0-913e-efb90f84cc6c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:50.317490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:50.389676 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1be7c-5925-41a0-913e-efb90f84cc6c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:50.423335 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ff1b5-4be1-4c98-bc68-81ce82a960f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:50.424020 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ff1b5-4be1-4c98-bc68-81ce82a960f8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:50.424311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ff1b5-4be1-4c98-bc68-81ce82a960f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:50.424592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ff1b5-4be1-4c98-bc68-81ce82a960f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:50.425372 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ff1b5-4be1-4c98-bc68-81ce82a960f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:50.425685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ff1b5-4be1-4c98-bc68-81ce82a960f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:50.427120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ff1b5-4be1-4c98-bc68-81ce82a960f8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:50.438397 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 558/1105] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:46:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:50.444363 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21568d-b2b4-47d2-a049-f2b5740f6052 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:50.549221 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21568d-b2b4-47d2-a049-f2b5740f6052 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:50.582187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbf39f-bb73-4148-8407-5df4c485489e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:50.582835 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbf39f-bb73-4148-8407-5df4c485489e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:50.583132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbf39f-bb73-4148-8407-5df4c485489e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:50.583417 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbf39f-bb73-4148-8407-5df4c485489e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:50.584300 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbf39f-bb73-4148-8407-5df4c485489e None admin] RBAC: Adding query filter params (role.id=217a9a10dcf94e6fb5108443d1f55d92, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=2e53683ae2b34947a1550de269b74d10) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:50.584625 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbf39f-bb73-4148-8407-5df4c485489e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:50.586054 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbf39f-bb73-4148-8407-5df4c485489e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:50.591927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 548/1106] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:50 2022] GET /identity/v3/role_assignments?user.id=2e53683ae2b34947a1550de269b74d10&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=217a9a10dcf94e6fb5108443d1f55d92 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:52.107599 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97c431-5713-4b48-8bac-9b72efbbf802 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:52.108164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97c431-5713-4b48-8bac-9b72efbbf802 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:52.108254 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97c431-5713-4b48-8bac-9b72efbbf802 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:52.109580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 559/1107] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:52.114716 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6ede2-cffd-4948-ba9f-72def0d2c505 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:52.115109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6ede2-cffd-4948-ba9f-72def0d2c505 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:52.115319 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6ede2-cffd-4948-ba9f-72def0d2c505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:52.133186 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-90d6ede2-cffd-4948-ba9f-72def0d2c505 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:52.134368 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-90d6ede2-cffd-4948-ba9f-72def0d2c505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:52.148329 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:52.198063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 549/1108] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:52.222734 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97c431-5713-4b48-8bac-9b72efbbf802 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:52.310221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:52.319796 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97c431-5713-4b48-8bac-9b72efbbf802 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:52.352202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc47f8-a639-411c-a9fc-d6e0f2ac2673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:52.352990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc47f8-a639-411c-a9fc-d6e0f2ac2673 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:52.353283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc47f8-a639-411c-a9fc-d6e0f2ac2673 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:52.353564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc47f8-a639-411c-a9fc-d6e0f2ac2673 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:52.354734 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc47f8-a639-411c-a9fc-d6e0f2ac2673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:52.356218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc47f8-a639-411c-a9fc-d6e0f2ac2673 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:52.357871 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 560/1109] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:46:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:52.363356 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6ede2-cffd-4948-ba9f-72def0d2c505 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:52.457933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6ede2-cffd-4948-ba9f-72def0d2c505 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:52.499277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc93a9-ce6c-4903-bd0a-f8e5dfb107e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:52.499941 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc93a9-ce6c-4903-bd0a-f8e5dfb107e4 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:52.500257 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc93a9-ce6c-4903-bd0a-f8e5dfb107e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:52.500535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc93a9-ce6c-4903-bd0a-f8e5dfb107e4 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:52.501254 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc93a9-ce6c-4903-bd0a-f8e5dfb107e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:52.502679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc93a9-ce6c-4903-bd0a-f8e5dfb107e4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:52.595153 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 550/1110] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:46:52 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:46:54.830067 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f4707-66cd-42a4-a9cb-9149ffbedbe1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:54.830577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f4707-66cd-42a4-a9cb-9149ffbedbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:54.830671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f4707-66cd-42a4-a9cb-9149ffbedbe1 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:54.832034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 561/1111] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:54.837783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700cc66-f2a0-4f4c-af7d-bd18dfb5107e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:54.838171 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700cc66-f2a0-4f4c-af7d-bd18dfb5107e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:54.838343 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700cc66-f2a0-4f4c-af7d-bd18dfb5107e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:54.849718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:54.855465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a700cc66-f2a0-4f4c-af7d-bd18dfb5107e None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:54.856690 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a700cc66-f2a0-4f4c-af7d-bd18dfb5107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:54.920361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 551/1112] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:54.943580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f4707-66cd-42a4-a9cb-9149ffbedbe1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:55.041404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f4707-66cd-42a4-a9cb-9149ffbedbe1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:55.073566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92ee21-4005-4f62-86c5-32d02e3dce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:55.074395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92ee21-4005-4f62-86c5-32d02e3dce46 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.074676 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92ee21-4005-4f62-86c5-32d02e3dce46 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.074951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92ee21-4005-4f62-86c5-32d02e3dce46 None admin] PATH_INFO: `/v3/roles/f9b113934dbd49218d427f6cacaabf8f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.076411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92ee21-4005-4f62-86c5-32d02e3dce46 None admin] RBAC: Authorizing `identity:get_role(role_id=f9b113934dbd49218d427f6cacaabf8f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:55.077789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92ee21-4005-4f62-86c5-32d02e3dce46 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:55.079127 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 562/1113] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:46:54 2022] GET /identity/v3/roles/f9b113934dbd49218d427f6cacaabf8f => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:55.085555 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700cc66-f2a0-4f4c-af7d-bd18dfb5107e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:55.179099 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700cc66-f2a0-4f4c-af7d-bd18dfb5107e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:55.211941 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7db47-5975-486a-9682-ed6e1fd0e267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:55.212822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7db47-5975-486a-9682-ed6e1fd0e267 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.213108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7db47-5975-486a-9682-ed6e1fd0e267 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.213388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7db47-5975-486a-9682-ed6e1fd0e267 None admin] PATH_INFO: `/v3/users/ebc54ad9df10417b86f34f816d0b1d0a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.216358 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:55.230572 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7db47-5975-486a-9682-ed6e1fd0e267 None admin] RBAC: Authorizing `identity:get_user(user_id=ebc54ad9df10417b86f34f816d0b1d0a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:55.232221 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7db47-5975-486a-9682-ed6e1fd0e267 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:55.233945 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 552/1114] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:46:55 2022] GET /identity/v3/users/ebc54ad9df10417b86f34f816d0b1d0a => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:55.239837 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92ee21-4005-4f62-86c5-32d02e3dce46 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:55.268164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:55.336561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92ee21-4005-4f62-86c5-32d02e3dce46 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:55.369305 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c80270-0a4c-4711-9568-0ff414f4258b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:55.370213 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c80270-0a4c-4711-9568-0ff414f4258b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.370496 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c80270-0a4c-4711-9568-0ff414f4258b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.370770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c80270-0a4c-4711-9568-0ff414f4258b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.433845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c80270-0a4c-4711-9568-0ff414f4258b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:55.435291 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c80270-0a4c-4711-9568-0ff414f4258b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:55.459592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:55.528266 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 563/1115] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:46:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:46:55.534218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7db47-5975-486a-9682-ed6e1fd0e267 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:55.629613 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7db47-5975-486a-9682-ed6e1fd0e267 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:55.662169 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26730a21-875d-4e78-b020-f3f9502aea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:55.663524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26730a21-875d-4e78-b020-f3f9502aea99 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.663808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26730a21-875d-4e78-b020-f3f9502aea99 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.664112 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26730a21-875d-4e78-b020-f3f9502aea99 None admin] PATH_INFO: `/v3/projects/9dedd2f8fb5c4b458dade8dab4a7fe12` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.665285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26730a21-875d-4e78-b020-f3f9502aea99 None admin] RBAC: Authorizing `identity:get_project(project_id=9dedd2f8fb5c4b458dade8dab4a7fe12)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:55.666714 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26730a21-875d-4e78-b020-f3f9502aea99 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:55.668420 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 553/1116] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:55 2022] GET /identity/v3/projects/9dedd2f8fb5c4b458dade8dab4a7fe12 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:55.674587 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c80270-0a4c-4711-9568-0ff414f4258b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:55.770017 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c80270-0a4c-4711-9568-0ff414f4258b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:55.794173 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:55.802448 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fb3ca-d93d-4078-b5ae-8a04d24e0e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:55.813135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fb3ca-d93d-4078-b5ae-8a04d24e0e36 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:55.813135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fb3ca-d93d-4078-b5ae-8a04d24e0e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:55.813135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fb3ca-d93d-4078-b5ae-8a04d24e0e36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:55.813135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fb3ca-d93d-4078-b5ae-8a04d24e0e36 None admin] RBAC: Adding query filter params (role.id=f9b113934dbd49218d427f6cacaabf8f, scope.project.id=9dedd2f8fb5c4b458dade8dab4a7fe12, user.id=ebc54ad9df10417b86f34f816d0b1d0a) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:46:55.813135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fb3ca-d93d-4078-b5ae-8a04d24e0e36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:55.813135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fb3ca-d93d-4078-b5ae-8a04d24e0e36 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:55.813577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 564/1117] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:46:55 2022] GET /identity/v3/role_assignments?user.id=ebc54ad9df10417b86f34f816d0b1d0a&scope.project.id=9dedd2f8fb5c4b458dade8dab4a7fe12&role.id=f9b113934dbd49218d427f6cacaabf8f => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:57.980708 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc531c-3efb-4da2-b8f8-f7e26f70152e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:57.981252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc531c-3efb-4da2-b8f8-f7e26f70152e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:57.981252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc531c-3efb-4da2-b8f8-f7e26f70152e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:57.982629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 554/1118] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:46:57.987712 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391371-1184-453c-a58c-31c446b7d66b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:57.988092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391371-1184-453c-a58c-31c446b7d66b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:57.988312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff391371-1184-453c-a58c-31c446b7d66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:58.004784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ff391371-1184-453c-a58c-31c446b7d66b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:46:58.006503 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ff391371-1184-453c-a58c-31c446b7d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:46:58.069463 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 565/1119] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:46:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:46:58.091896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc531c-3efb-4da2-b8f8-f7e26f70152e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:58.152706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:58.189835 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc531c-3efb-4da2-b8f8-f7e26f70152e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:58.223459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f464641-0eb0-4537-b6cb-60a0e74f5f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:58.224394 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f464641-0eb0-4537-b6cb-60a0e74f5f3a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:58.225203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f464641-0eb0-4537-b6cb-60a0e74f5f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:58.225481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f464641-0eb0-4537-b6cb-60a0e74f5f3a None admin] PATH_INFO: `/v3/roles/f9b113934dbd49218d427f6cacaabf8f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:58.226944 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f464641-0eb0-4537-b6cb-60a0e74f5f3a None admin] RBAC: Authorizing `identity:get_role(role_id=f9b113934dbd49218d427f6cacaabf8f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:58.228338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f464641-0eb0-4537-b6cb-60a0e74f5f3a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:58.229686 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 555/1120] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:46:58 2022] GET /identity/v3/roles/f9b113934dbd49218d427f6cacaabf8f => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:58.235376 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff391371-1184-453c-a58c-31c446b7d66b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:58.330593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff391371-1184-453c-a58c-31c446b7d66b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:58.351651 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:58.363181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e3bc0-3639-42e4-8a62-1a7870db2140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:58.364108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e3bc0-3639-42e4-8a62-1a7870db2140 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:58.364398 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e3bc0-3639-42e4-8a62-1a7870db2140 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:58.364679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e3bc0-3639-42e4-8a62-1a7870db2140 None admin] PATH_INFO: `/v3/users/ebc54ad9df10417b86f34f816d0b1d0a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:58.366375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e3bc0-3639-42e4-8a62-1a7870db2140 None admin] RBAC: Authorizing `identity:get_user(user_id=ebc54ad9df10417b86f34f816d0b1d0a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:58.367827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e3bc0-3639-42e4-8a62-1a7870db2140 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:58.369480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 566/1121] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:46:58 2022] GET /identity/v3/users/ebc54ad9df10417b86f34f816d0b1d0a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:58.375525 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f464641-0eb0-4537-b6cb-60a0e74f5f3a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:58.470035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f464641-0eb0-4537-b6cb-60a0e74f5f3a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:58.497669 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:46:58.503141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbe207-eec2-42a6-9baf-a741fff1a886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:58.503997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe207-eec2-42a6-9baf-a741fff1a886 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:58.504295 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe207-eec2-42a6-9baf-a741fff1a886 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:58.504570 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe207-eec2-42a6-9baf-a741fff1a886 None admin] PATH_INFO: `/v3/projects/9dedd2f8fb5c4b458dade8dab4a7fe12` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:58.505880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbe207-eec2-42a6-9baf-a741fff1a886 None admin] RBAC: Authorizing `identity:get_project(project_id=9dedd2f8fb5c4b458dade8dab4a7fe12)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:58.507299 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbe207-eec2-42a6-9baf-a741fff1a886 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:58.508983 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 556/1122] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:46:58 2022] GET /identity/v3/projects/9dedd2f8fb5c4b458dade8dab4a7fe12 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:46:58.514863 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e3bc0-3639-42e4-8a62-1a7870db2140 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:46:58.614668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e3bc0-3639-42e4-8a62-1a7870db2140 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:46:58.647162 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2659f-ff5c-4be2-b821-d27543518c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:46:58.648060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2659f-ff5c-4be2-b821-d27543518c9a None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:46:58.648345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2659f-ff5c-4be2-b821-d27543518c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:46:58.648622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2659f-ff5c-4be2-b821-d27543518c9a None admin] PATH_INFO: `/v3/projects/9dedd2f8fb5c4b458dade8dab4a7fe12/users/ebc54ad9df10417b86f34f816d0b1d0a/roles/f9b113934dbd49218d427f6cacaabf8f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:46:58.650765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2659f-ff5c-4be2-b821-d27543518c9a None admin] RBAC: Authorizing `identity:create_grant(project_id=9dedd2f8fb5c4b458dade8dab4a7fe12, user_id=ebc54ad9df10417b86f34f816d0b1d0a, role_id=f9b113934dbd49218d427f6cacaabf8f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:46:58.652205 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2659f-ff5c-4be2-b821-d27543518c9a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:46:58.709811 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 567/1123] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:46:58 2022] PUT /identity/v3/projects/9dedd2f8fb5c4b458dade8dab4a7fe12/users/ebc54ad9df10417b86f34f816d0b1d0a/roles/f9b113934dbd49218d427f6cacaabf8f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:47:00.932166 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717df51-dfb6-47ab-bc45-fdb33a169b35 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:00.932715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717df51-dfb6-47ab-bc45-fdb33a169b35 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:00.932715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717df51-dfb6-47ab-bc45-fdb33a169b35 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:00.934073 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 557/1124] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:00.939424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56c302-2dec-4b14-90ab-a82c7cd3e88e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:00.939825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56c302-2dec-4b14-90ab-a82c7cd3e88e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:00.940010 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56c302-2dec-4b14-90ab-a82c7cd3e88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:00.956814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ab56c302-2dec-4b14-90ab-a82c7cd3e88e None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:00.958004 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ab56c302-2dec-4b14-90ab-a82c7cd3e88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:01.000158 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:01.021876 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 568/1125] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:01.045566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717df51-dfb6-47ab-bc45-fdb33a169b35 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:01.143235 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717df51-dfb6-47ab-bc45-fdb33a169b35 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:01.175589 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852fa33-3fd3-4e69-8fd1-f3c582ac47b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:01.176449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852fa33-3fd3-4e69-8fd1-f3c582ac47b4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:01.176735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852fa33-3fd3-4e69-8fd1-f3c582ac47b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:01.177011 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852fa33-3fd3-4e69-8fd1-f3c582ac47b4 None admin] PATH_INFO: `/v3/roles/f9b113934dbd49218d427f6cacaabf8f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:01.178500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852fa33-3fd3-4e69-8fd1-f3c582ac47b4 None admin] RBAC: Authorizing `identity:get_role(role_id=f9b113934dbd49218d427f6cacaabf8f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:01.179867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852fa33-3fd3-4e69-8fd1-f3c582ac47b4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:01.181223 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 558/1126] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:01 2022] GET /identity/v3/roles/f9b113934dbd49218d427f6cacaabf8f => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:01.186896 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56c302-2dec-4b14-90ab-a82c7cd3e88e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:01.281025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56c302-2dec-4b14-90ab-a82c7cd3e88e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:01.312518 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d455b-d494-47b4-b1cb-7280e4d580ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:01.313371 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d455b-d494-47b4-b1cb-7280e4d580ea None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:01.313658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d455b-d494-47b4-b1cb-7280e4d580ea None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:01.313938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d455b-d494-47b4-b1cb-7280e4d580ea None admin] PATH_INFO: `/v3/users/ebc54ad9df10417b86f34f816d0b1d0a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:01.315101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d455b-d494-47b4-b1cb-7280e4d580ea None admin] RBAC: Authorizing `identity:get_user(user_id=ebc54ad9df10417b86f34f816d0b1d0a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:01.316560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d455b-d494-47b4-b1cb-7280e4d580ea None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:01.318150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 569/1127] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:01 2022] GET /identity/v3/users/ebc54ad9df10417b86f34f816d0b1d0a => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:01.324136 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852fa33-3fd3-4e69-8fd1-f3c582ac47b4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:01.389208 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:01.421992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852fa33-3fd3-4e69-8fd1-f3c582ac47b4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:01.454494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b27302-3e3a-4bbc-b748-81485e7a010a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:01.455077 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b27302-3e3a-4bbc-b748-81485e7a010a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:01.455365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b27302-3e3a-4bbc-b748-81485e7a010a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:01.455649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b27302-3e3a-4bbc-b748-81485e7a010a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:01.520619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b27302-3e3a-4bbc-b748-81485e7a010a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:01.522051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b27302-3e3a-4bbc-b748-81485e7a010a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:01.581647 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:01.616031 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 559/1128] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:47:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:47:01.621927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d455b-d494-47b4-b1cb-7280e4d580ea None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:01.666429 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:01.717193 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d455b-d494-47b4-b1cb-7280e4d580ea None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:01.749848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597cc79-d17f-451c-8048-4f32a9bf97d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:01.750688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597cc79-d17f-451c-8048-4f32a9bf97d6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:01.750977 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597cc79-d17f-451c-8048-4f32a9bf97d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:01.751256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597cc79-d17f-451c-8048-4f32a9bf97d6 None admin] PATH_INFO: `/v3/projects/9dedd2f8fb5c4b458dade8dab4a7fe12` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:01.752438 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597cc79-d17f-451c-8048-4f32a9bf97d6 None admin] RBAC: Authorizing `identity:get_project(project_id=9dedd2f8fb5c4b458dade8dab4a7fe12)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:01.753862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597cc79-d17f-451c-8048-4f32a9bf97d6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:01.755509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 570/1129] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:47:01 2022] GET /identity/v3/projects/9dedd2f8fb5c4b458dade8dab4a7fe12 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:01.762066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b27302-3e3a-4bbc-b748-81485e7a010a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:01.856097 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b27302-3e3a-4bbc-b748-81485e7a010a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:01.889866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b679b9d-ade2-46cf-9c7a-a30635e3277d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:01.890507 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b679b9d-ade2-46cf-9c7a-a30635e3277d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:01.890796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b679b9d-ade2-46cf-9c7a-a30635e3277d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:01.891080 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b679b9d-ade2-46cf-9c7a-a30635e3277d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:01.891904 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b679b9d-ade2-46cf-9c7a-a30635e3277d None admin] RBAC: Adding query filter params (role.id=f9b113934dbd49218d427f6cacaabf8f, scope.project.id=9dedd2f8fb5c4b458dade8dab4a7fe12, user.id=ebc54ad9df10417b86f34f816d0b1d0a) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:01.892243 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b679b9d-ade2-46cf-9c7a-a30635e3277d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:01.893667 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b679b9d-ade2-46cf-9c7a-a30635e3277d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:01.900067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 560/1130] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:47:01 2022] GET /identity/v3/role_assignments?user.id=ebc54ad9df10417b86f34f816d0b1d0a&scope.project.id=9dedd2f8fb5c4b458dade8dab4a7fe12&role.id=f9b113934dbd49218d427f6cacaabf8f => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:04.136254 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0252be4-826c-485c-b2e5-fc8187d2341c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:04.136787 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0252be4-826c-485c-b2e5-fc8187d2341c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:04.136907 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0252be4-826c-485c-b2e5-fc8187d2341c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:04.138182 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 571/1131] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:04.143286 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6508a47-e83f-4fda-9b2c-d58aac05595c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:04.143678 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6508a47-e83f-4fda-9b2c-d58aac05595c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:04.143849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6508a47-e83f-4fda-9b2c-d58aac05595c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:04.161374 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e6508a47-e83f-4fda-9b2c-d58aac05595c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:04.162576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e6508a47-e83f-4fda-9b2c-d58aac05595c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:04.185547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:04.241264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 561/1132] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:04.265238 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0252be4-826c-485c-b2e5-fc8187d2341c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:04.361754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0252be4-826c-485c-b2e5-fc8187d2341c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:04.376037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:04.395369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9c6e6-5e49-407c-bde4-bbdc4b6234e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:04.396120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9c6e6-5e49-407c-bde4-bbdc4b6234e0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:04.396445 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9c6e6-5e49-407c-bde4-bbdc4b6234e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:04.396729 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9c6e6-5e49-407c-bde4-bbdc4b6234e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:04.397886 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9c6e6-5e49-407c-bde4-bbdc4b6234e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:04.399329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9c6e6-5e49-407c-bde4-bbdc4b6234e0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:04.400972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 572/1133] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:04.406922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6508a47-e83f-4fda-9b2c-d58aac05595c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:04.502500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6508a47-e83f-4fda-9b2c-d58aac05595c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:04.535283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dcc6f-e152-41b2-b787-ffade7e86d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:04.535918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dcc6f-e152-41b2-b787-ffade7e86d42 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:04.536236 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dcc6f-e152-41b2-b787-ffade7e86d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:04.536518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dcc6f-e152-41b2-b787-ffade7e86d42 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:04.537392 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0dcc6f-e152-41b2-b787-ffade7e86d42 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:04.538835 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0dcc6f-e152-41b2-b787-ffade7e86d42 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:04.653067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 562/1134] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Jun 2 15:47:04 2022] POST /identity/v3/projects => generated 311 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:47:06.917493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb19b6a-6341-441d-a7a1-b896e500c7d8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:06.918044 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb19b6a-6341-441d-a7a1-b896e500c7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:06.918044 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb19b6a-6341-441d-a7a1-b896e500c7d8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:06.919431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 573/1135] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:06.924755 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a98a-fe43-42fd-8065-91aa16ca7c5a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:06.925172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a98a-fe43-42fd-8065-91aa16ca7c5a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:06.925320 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a98a-fe43-42fd-8065-91aa16ca7c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:06.942145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9aa1a98a-fe43-42fd-8065-91aa16ca7c5a None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:06.943884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9aa1a98a-fe43-42fd-8065-91aa16ca7c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:06.950870 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:07.008283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 563/1136] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:07.032147 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb19b6a-6341-441d-a7a1-b896e500c7d8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:07.129012 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb19b6a-6341-441d-a7a1-b896e500c7d8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:07.160527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df378564-1ec7-483c-9762-67e0a13894cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:07.161299 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df378564-1ec7-483c-9762-67e0a13894cc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:07.161585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df378564-1ec7-483c-9762-67e0a13894cc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:07.161862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df378564-1ec7-483c-9762-67e0a13894cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:07.163558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df378564-1ec7-483c-9762-67e0a13894cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:07.165026 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df378564-1ec7-483c-9762-67e0a13894cc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:07.166612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 574/1137] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:47:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:07.172238 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1a98a-fe43-42fd-8065-91aa16ca7c5a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:07.265418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1a98a-fe43-42fd-8065-91aa16ca7c5a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:07.297388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f09e5-4232-4736-bfe5-a6681da8ccaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:07.298036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f09e5-4232-4736-bfe5-a6681da8ccaf None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:07.298320 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f09e5-4232-4736-bfe5-a6681da8ccaf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:07.298604 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f09e5-4232-4736-bfe5-a6681da8ccaf None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:07.299296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f09e5-4232-4736-bfe5-a6681da8ccaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:07.300735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f09e5-4232-4736-bfe5-a6681da8ccaf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:07.397155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:07.402749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 564/1138] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:47:07 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:47:09.669409 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ade0b-411b-4479-b14b-a6b781b08acc None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:09.669906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ade0b-411b-4479-b14b-a6b781b08acc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:09.669906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ade0b-411b-4479-b14b-a6b781b08acc None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:09.671276 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 575/1139] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:09.676508 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5902b-7bd6-4911-a973-49f386a55dab None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:09.676905 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5902b-7bd6-4911-a973-49f386a55dab None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:09.677079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5902b-7bd6-4911-a973-49f386a55dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:09.694409 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-45c5902b-7bd6-4911-a973-49f386a55dab None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:09.695577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-45c5902b-7bd6-4911-a973-49f386a55dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:09.759595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 565/1140] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:09.782628 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ade0b-411b-4479-b14b-a6b781b08acc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:09.832893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:09.880519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ade0b-411b-4479-b14b-a6b781b08acc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:09.913580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3a8b9-1cde-459e-96a1-a0a1f70e76c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:09.914377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3a8b9-1cde-459e-96a1-a0a1f70e76c5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:09.914660 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3a8b9-1cde-459e-96a1-a0a1f70e76c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:09.914935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3a8b9-1cde-459e-96a1-a0a1f70e76c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:09.924628 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3a8b9-1cde-459e-96a1-a0a1f70e76c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:09.932586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-afa3a8b9-1cde-459e-96a1-a0a1f70e76c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:09.932586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:09.932586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:09.932586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:09.932586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:09.932586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:09.932586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:09.932586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:09.932586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:09.932586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:09.932586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:09.932586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:09.932586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:09.932586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:09.932586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:09.932586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:09.933727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:09.933727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:09.933727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:09.933727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:09.933727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:09.933727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:09.933727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:09.933727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:09.933727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:09.933727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:09.933727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:09.933727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:09.933727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:09.933727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:09.933727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:09.933727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:09.935003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:09.935003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:09.935003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:09.935003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:09.935003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:09.935003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:09.935003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:09.935003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:09.935003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:09.935003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:09.935003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:09.935003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:47:09.935003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 576/1141] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:47:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:09.939631 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5902b-7bd6-4911-a973-49f386a55dab None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:10.034483 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5902b-7bd6-4911-a973-49f386a55dab None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:10.101835 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:10.109226 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d08f1-f530-48ec-b17c-09bab14157db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:10.109882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d08f1-f530-48ec-b17c-09bab14157db None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:10.110169 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d08f1-f530-48ec-b17c-09bab14157db None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:10.110448 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d08f1-f530-48ec-b17c-09bab14157db None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:10.111182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d08f1-f530-48ec-b17c-09bab14157db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:10.112228 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d08f1-f530-48ec-b17c-09bab14157db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:10.112894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d08f1-f530-48ec-b17c-09bab14157db None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:10.121447 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 566/1142] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:47:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:47:10.127277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3a8b9-1cde-459e-96a1-a0a1f70e76c5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:10.227204 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3a8b9-1cde-459e-96a1-a0a1f70e76c5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:10.236849 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:10.259490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3df0b-ea82-46e5-8cda-9f7bf1e627e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:10.260368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3df0b-ea82-46e5-8cda-9f7bf1e627e7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:10.260716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3df0b-ea82-46e5-8cda-9f7bf1e627e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:10.261034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3df0b-ea82-46e5-8cda-9f7bf1e627e7 None admin] PATH_INFO: `/v3/users/ecce276fcb0f4ce79705d7d5223c7398` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:10.274056 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3df0b-ea82-46e5-8cda-9f7bf1e627e7 None admin] RBAC: Authorizing `identity:get_user(user_id=ecce276fcb0f4ce79705d7d5223c7398)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:10.275514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3df0b-ea82-46e5-8cda-9f7bf1e627e7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:10.277167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 577/1143] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:10 2022] GET /identity/v3/users/ecce276fcb0f4ce79705d7d5223c7398 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:10.282926 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d08f1-f530-48ec-b17c-09bab14157db None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:10.408368 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d08f1-f530-48ec-b17c-09bab14157db None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:10.440540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3c68f-eb0f-4782-b900-46554011952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:10.441176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3c68f-eb0f-4782-b900-46554011952b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:10.441460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3c68f-eb0f-4782-b900-46554011952b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:10.441738 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3c68f-eb0f-4782-b900-46554011952b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:10.496124 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:10.505459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3c68f-eb0f-4782-b900-46554011952b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:10.507056 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3c68f-eb0f-4782-b900-46554011952b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:10.600388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 567/1144] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:47:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:47:10.606402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3df0b-ea82-46e5-8cda-9f7bf1e627e7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:10.704296 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3df0b-ea82-46e5-8cda-9f7bf1e627e7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:10.737522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f884c-36b3-4eb3-ae60-05a2d17122df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:10.738366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f884c-36b3-4eb3-ae60-05a2d17122df None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:10.738655 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f884c-36b3-4eb3-ae60-05a2d17122df None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:10.738927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f884c-36b3-4eb3-ae60-05a2d17122df None admin] PATH_INFO: `/v3/projects/ff91e90036ce42aea6b592450f95f039` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:10.740170 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f884c-36b3-4eb3-ae60-05a2d17122df None admin] RBAC: Authorizing `identity:get_project(project_id=ff91e90036ce42aea6b592450f95f039)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:10.741609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f884c-36b3-4eb3-ae60-05a2d17122df None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:10.743320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 578/1145] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:47:10 2022] GET /identity/v3/projects/ff91e90036ce42aea6b592450f95f039 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:10.749705 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3c68f-eb0f-4782-b900-46554011952b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:10.837288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:10.846540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3c68f-eb0f-4782-b900-46554011952b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:10.879928 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538fc51-5c6a-4a91-87c0-92f63df0b06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:10.880595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538fc51-5c6a-4a91-87c0-92f63df0b06b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:10.880908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538fc51-5c6a-4a91-87c0-92f63df0b06b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:10.881193 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538fc51-5c6a-4a91-87c0-92f63df0b06b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:10.882016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538fc51-5c6a-4a91-87c0-92f63df0b06b None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=ff91e90036ce42aea6b592450f95f039, user.id=ecce276fcb0f4ce79705d7d5223c7398) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:10.882333 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538fc51-5c6a-4a91-87c0-92f63df0b06b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:10.883756 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538fc51-5c6a-4a91-87c0-92f63df0b06b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:10.889031 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 568/1146] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:47:10 2022] GET /identity/v3/role_assignments?user.id=ecce276fcb0f4ce79705d7d5223c7398&scope.project.id=ff91e90036ce42aea6b592450f95f039&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:13.082063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd969aa-ac22-4378-93b7-b0a298992568 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.082593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd969aa-ac22-4378-93b7-b0a298992568 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.082593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd969aa-ac22-4378-93b7-b0a298992568 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.084650 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 579/1147] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:13.089875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952caee2-2fa7-43ff-8ade-c411bbaa1f5a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.090271 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952caee2-2fa7-43ff-8ade-c411bbaa1f5a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.090442 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952caee2-2fa7-43ff-8ade-c411bbaa1f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.106858 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-952caee2-2fa7-43ff-8ade-c411bbaa1f5a None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:13.108077 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-952caee2-2fa7-43ff-8ade-c411bbaa1f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:13.172430 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 569/1148] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:13.195556 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd969aa-ac22-4378-93b7-b0a298992568 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:13.229859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:13.294248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd969aa-ac22-4378-93b7-b0a298992568 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:13.326527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ca306-9aec-4fa6-9e04-533a3ed3ad56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:13.327305 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca306-9aec-4fa6-9e04-533a3ed3ad56 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.327595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca306-9aec-4fa6-9e04-533a3ed3ad56 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.327879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca306-9aec-4fa6-9e04-533a3ed3ad56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.337885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ca306-9aec-4fa6-9e04-533a3ed3ad56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:13.345462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1a3ca306-9aec-4fa6-9e04-533a3ed3ad56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:13.345462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:13.345462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:13.345462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:13.345462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:13.345462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:13.345462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:13.345462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:13.345462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:13.345462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:13.345462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:13.345462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:13.345462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:13.345462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:13.345462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:13.345462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:13.346591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:13.346591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:13.346591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:13.346591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:13.346591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:13.346591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:13.346591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:13.346591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:13.346591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:13.346591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:13.346591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:13.346591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:13.346591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:13.346591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:13.346591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:13.346591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:13.347652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:13.347652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:13.347652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:13.347652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:13.347652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:13.347652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:13.347652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:13.347652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:13.347652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:13.347652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:13.347652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:13.347652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:47:13.347652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 580/1149] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:47:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:13.353299 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952caee2-2fa7-43ff-8ade-c411bbaa1f5a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:13.433874 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:13.448768 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952caee2-2fa7-43ff-8ade-c411bbaa1f5a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:13.482215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda8d1c-22ee-42de-b98e-c87f4470322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:13.482874 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda8d1c-22ee-42de-b98e-c87f4470322e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.483165 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda8d1c-22ee-42de-b98e-c87f4470322e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.483449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda8d1c-22ee-42de-b98e-c87f4470322e None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.484214 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda8d1c-22ee-42de-b98e-c87f4470322e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:13.484530 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda8d1c-22ee-42de-b98e-c87f4470322e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:13.485903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda8d1c-22ee-42de-b98e-c87f4470322e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:13.493741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 570/1150] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:47:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:13.499817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ca306-9aec-4fa6-9e04-533a3ed3ad56 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:13.589858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:13.595325 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ca306-9aec-4fa6-9e04-533a3ed3ad56 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:13.628142 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255bf53-aa95-4842-b1ad-0dfd26b8386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:13.628993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255bf53-aa95-4842-b1ad-0dfd26b8386e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.629279 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255bf53-aa95-4842-b1ad-0dfd26b8386e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.629560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255bf53-aa95-4842-b1ad-0dfd26b8386e None admin] PATH_INFO: `/v3/users/ecce276fcb0f4ce79705d7d5223c7398` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.630763 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255bf53-aa95-4842-b1ad-0dfd26b8386e None admin] RBAC: Authorizing `identity:get_user(user_id=ecce276fcb0f4ce79705d7d5223c7398)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:13.632214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255bf53-aa95-4842-b1ad-0dfd26b8386e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:13.633833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 581/1151] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:13 2022] GET /identity/v3/users/ecce276fcb0f4ce79705d7d5223c7398 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:13.639423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda8d1c-22ee-42de-b98e-c87f4470322e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:13.736291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda8d1c-22ee-42de-b98e-c87f4470322e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:13.768474 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4462adc8-fdc8-4876-aaa8-654ae637ee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:13.769318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462adc8-fdc8-4876-aaa8-654ae637ee65 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.769603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462adc8-fdc8-4876-aaa8-654ae637ee65 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.769879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462adc8-fdc8-4876-aaa8-654ae637ee65 None admin] PATH_INFO: `/v3/projects/ff91e90036ce42aea6b592450f95f039` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.771032 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462adc8-fdc8-4876-aaa8-654ae637ee65 None admin] RBAC: Authorizing `identity:get_project(project_id=ff91e90036ce42aea6b592450f95f039)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:13.772523 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4462adc8-fdc8-4876-aaa8-654ae637ee65 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:13.774181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 571/1152] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:47:13 2022] GET /identity/v3/projects/ff91e90036ce42aea6b592450f95f039 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:13.780064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255bf53-aa95-4842-b1ad-0dfd26b8386e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:13.875828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255bf53-aa95-4842-b1ad-0dfd26b8386e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:13.907909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc477e-b341-4c73-abb1-913d235fa368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:13.908794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc477e-b341-4c73-abb1-913d235fa368 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:13.909083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc477e-b341-4c73-abb1-913d235fa368 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:13.909366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc477e-b341-4c73-abb1-913d235fa368 None admin] PATH_INFO: `/v3/projects/ff91e90036ce42aea6b592450f95f039/users/ecce276fcb0f4ce79705d7d5223c7398/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:13.911292 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc477e-b341-4c73-abb1-913d235fa368 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff91e90036ce42aea6b592450f95f039, user_id=ecce276fcb0f4ce79705d7d5223c7398, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:13.913251 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc477e-b341-4c73-abb1-913d235fa368 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:14.011271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 582/1153] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:47:13 2022] PUT /identity/v3/projects/ff91e90036ce42aea6b592450f95f039/users/ecce276fcb0f4ce79705d7d5223c7398/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:47:16.192248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a5f52-19fc-44fa-a50e-224faa8dc75e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.192777 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a5f52-19fc-44fa-a50e-224faa8dc75e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.192872 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a5f52-19fc-44fa-a50e-224faa8dc75e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.194717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 572/1154] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:16.199839 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9c1c0-a5f9-47f6-b65c-24beeaff3bf2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.200284 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9c1c0-a5f9-47f6-b65c-24beeaff3bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.200498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9c1c0-a5f9-47f6-b65c-24beeaff3bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.217373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-97c9c1c0-a5f9-47f6-b65c-24beeaff3bf2 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:16.218563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-97c9c1c0-a5f9-47f6-b65c-24beeaff3bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:16.235282 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:16.282132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 583/1155] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:16.305140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a5f52-19fc-44fa-a50e-224faa8dc75e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:16.321450 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:16.406076 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a5f52-19fc-44fa-a50e-224faa8dc75e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:16.438123 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be061d-f042-4d24-9887-92c40e24eb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:16.438911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be061d-f042-4d24-9887-92c40e24eb17 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.439197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be061d-f042-4d24-9887-92c40e24eb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.439478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be061d-f042-4d24-9887-92c40e24eb17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.450274 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be061d-f042-4d24-9887-92c40e24eb17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:16.457816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c4be061d-f042-4d24-9887-92c40e24eb17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:16.457816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:16.457816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:16.457816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:16.457816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:16.457816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:16.457816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:16.457816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:16.457816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:16.457816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:16.457816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:16.457816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:16.457816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:16.457816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:16.457816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:16.457816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:16.459094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:16.459094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:16.459094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:16.459094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:16.459094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:16.459094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:16.459094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:16.459094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:16.459094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:16.459094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:16.459094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:16.459094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:16.459094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:16.459094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:16.459094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:16.459094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:16.460068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:16.460068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:16.460068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:16.460068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:16.460068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:16.460068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:16.460068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:16.460068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:16.460068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:16.460068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:16.460068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:16.460068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:47:16.460068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 573/1156] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:47:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:16.465136 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9c1c0-a5f9-47f6-b65c-24beeaff3bf2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:16.559221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9c1c0-a5f9-47f6-b65c-24beeaff3bf2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:16.591470 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48307c-a227-45ef-81e4-8b8c01f69576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:16.592151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48307c-a227-45ef-81e4-8b8c01f69576 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.592442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48307c-a227-45ef-81e4-8b8c01f69576 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.592724 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48307c-a227-45ef-81e4-8b8c01f69576 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.593455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48307c-a227-45ef-81e4-8b8c01f69576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:16.593764 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48307c-a227-45ef-81e4-8b8c01f69576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:16.595123 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48307c-a227-45ef-81e4-8b8c01f69576 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:16.602825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 584/1157] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:47:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:16.608398 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be061d-f042-4d24-9887-92c40e24eb17 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:16.680256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:16.708007 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be061d-f042-4d24-9887-92c40e24eb17 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:16.742418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7c9ab-6502-4a11-91f1-863b57ae14e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:16.743276 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7c9ab-6502-4a11-91f1-863b57ae14e1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.743562 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7c9ab-6502-4a11-91f1-863b57ae14e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.743842 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7c9ab-6502-4a11-91f1-863b57ae14e1 None admin] PATH_INFO: `/v3/users/ecce276fcb0f4ce79705d7d5223c7398` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.745049 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7c9ab-6502-4a11-91f1-863b57ae14e1 None admin] RBAC: Authorizing `identity:get_user(user_id=ecce276fcb0f4ce79705d7d5223c7398)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:16.746731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7c9ab-6502-4a11-91f1-863b57ae14e1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:16.748369 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 574/1158] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:16 2022] GET /identity/v3/users/ecce276fcb0f4ce79705d7d5223c7398 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:16.754131 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48307c-a227-45ef-81e4-8b8c01f69576 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:16.772091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:16.851215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48307c-a227-45ef-81e4-8b8c01f69576 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:16.883859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa50b5-b974-46c6-a896-a5041a056514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:16.884523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa50b5-b974-46c6-a896-a5041a056514 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:16.884815 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa50b5-b974-46c6-a896-a5041a056514 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:16.885101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa50b5-b974-46c6-a896-a5041a056514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:16.948862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa50b5-b974-46c6-a896-a5041a056514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:16.950308 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa50b5-b974-46c6-a896-a5041a056514 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:16.966189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:17.044614 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 585/1159] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:47:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:47:17.050534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7c9ab-6502-4a11-91f1-863b57ae14e1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:17.146010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7c9ab-6502-4a11-91f1-863b57ae14e1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:17.178893 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a4e6b-042c-4cb0-b48b-1f5230417ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:17.179735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a4e6b-042c-4cb0-b48b-1f5230417ced None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:17.180052 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a4e6b-042c-4cb0-b48b-1f5230417ced None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:17.180337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a4e6b-042c-4cb0-b48b-1f5230417ced None admin] PATH_INFO: `/v3/projects/ff91e90036ce42aea6b592450f95f039` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:17.181500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a4e6b-042c-4cb0-b48b-1f5230417ced None admin] RBAC: Authorizing `identity:get_project(project_id=ff91e90036ce42aea6b592450f95f039)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:17.182926 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a4e6b-042c-4cb0-b48b-1f5230417ced None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:17.184606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 575/1160] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:47:17 2022] GET /identity/v3/projects/ff91e90036ce42aea6b592450f95f039 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:17.190531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa50b5-b974-46c6-a896-a5041a056514 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:17.415346 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa50b5-b974-46c6-a896-a5041a056514 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:17.430943 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:17.447583 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7249054-cb8b-483f-a258-7312bd915595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:17.448249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7249054-cb8b-483f-a258-7312bd915595 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:17.448539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7249054-cb8b-483f-a258-7312bd915595 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:17.448818 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7249054-cb8b-483f-a258-7312bd915595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:17.449643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7249054-cb8b-483f-a258-7312bd915595 None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=ff91e90036ce42aea6b592450f95f039, user.id=ecce276fcb0f4ce79705d7d5223c7398) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:17.449961 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7249054-cb8b-483f-a258-7312bd915595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:17.451390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7249054-cb8b-483f-a258-7312bd915595 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:17.456999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 586/1161] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:47:17 2022] GET /identity/v3/role_assignments?user.id=ecce276fcb0f4ce79705d7d5223c7398&scope.project.id=ff91e90036ce42aea6b592450f95f039&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:19.718146 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993656e-0dff-4e61-aecb-afcc70b8cd54 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:19.718658 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993656e-0dff-4e61-aecb-afcc70b8cd54 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:19.718658 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993656e-0dff-4e61-aecb-afcc70b8cd54 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:19.719994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 576/1162] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:19.725691 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83678cb2-1ebe-4e1c-b3c8-888bc46598f8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:19.726082 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83678cb2-1ebe-4e1c-b3c8-888bc46598f8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:19.726258 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83678cb2-1ebe-4e1c-b3c8-888bc46598f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:19.743028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-83678cb2-1ebe-4e1c-b3c8-888bc46598f8 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:19.744243 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-83678cb2-1ebe-4e1c-b3c8-888bc46598f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:19.807905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 587/1163] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:19.829971 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993656e-0dff-4e61-aecb-afcc70b8cd54 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:19.841978 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:19.927999 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993656e-0dff-4e61-aecb-afcc70b8cd54 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:19.960794 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd5f38-145f-4c1a-93cd-389931de394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:19.961426 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd5f38-145f-4c1a-93cd-389931de394f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:19.961711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd5f38-145f-4c1a-93cd-389931de394f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:19.961991 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd5f38-145f-4c1a-93cd-389931de394f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:20.026579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd5f38-145f-4c1a-93cd-389931de394f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:20.027940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd5f38-145f-4c1a-93cd-389931de394f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:20.039066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:20.125239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 577/1164] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:47:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:47:20.131823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83678cb2-1ebe-4e1c-b3c8-888bc46598f8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:20.223485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83678cb2-1ebe-4e1c-b3c8-888bc46598f8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:20.233595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:20.257030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753d8d3-9357-4a50-b8ac-a9e78dba7601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:20.257869 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753d8d3-9357-4a50-b8ac-a9e78dba7601 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:20.258133 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753d8d3-9357-4a50-b8ac-a9e78dba7601 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:20.258410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753d8d3-9357-4a50-b8ac-a9e78dba7601 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:20.264891 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753d8d3-9357-4a50-b8ac-a9e78dba7601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:20.266324 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753d8d3-9357-4a50-b8ac-a9e78dba7601 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4753d8d3-9357-4a50-b8ac-a9e78dba7601 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:20.280567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:20.281779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:20.281779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:20.281779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:20.281779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:20.281779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:20.281779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:20.281779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:47:20.281779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:47:20.281779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:47:20.281779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:47:20.281779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:20.281779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:20.281779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:20.281779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:20.281779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:20.281779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:20.282766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:20.282766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:20.282766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:20.282766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:20.282766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:20.282766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:20.282766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:20.282766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:20.282766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:20.282766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:20.282766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 02 15:47:20.282766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:47:20.282766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 15:47:20.282766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:47:20.282766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 588/1165] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Jun 2 15:47:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:20.287454 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd5f38-145f-4c1a-93cd-389931de394f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:20.387047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd5f38-145f-4c1a-93cd-389931de394f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:20.397504 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:20.419510 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181a940-3d27-477a-a911-22224fcd9688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:20.420195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181a940-3d27-477a-a911-22224fcd9688 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:20.420485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181a940-3d27-477a-a911-22224fcd9688 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:20.420772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181a940-3d27-477a-a911-22224fcd9688 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:20.421480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181a940-3d27-477a-a911-22224fcd9688 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:20.421788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181a940-3d27-477a-a911-22224fcd9688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:20.423260 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181a940-3d27-477a-a911-22224fcd9688 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:20.430927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 578/1166] 10.222.0.50 () {56 vars in 1115 bytes} [Thu Jun 2 15:47:20 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:22.620625 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fbaca-a9ce-459c-bb8a-94e37e8dcc91 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:22.621412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fbaca-a9ce-459c-bb8a-94e37e8dcc91 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:22.621412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fbaca-a9ce-459c-bb8a-94e37e8dcc91 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:22.622741 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 589/1167] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:22.628181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab18d5-d604-4e36-a04a-e2c0caabf938 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:22.628563 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab18d5-d604-4e36-a04a-e2c0caabf938 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:22.628761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab18d5-d604-4e36-a04a-e2c0caabf938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:22.645085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f1ab18d5-d604-4e36-a04a-e2c0caabf938 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:22.646812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f1ab18d5-d604-4e36-a04a-e2c0caabf938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:22.710321 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 579/1168] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:22.733003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fbaca-a9ce-459c-bb8a-94e37e8dcc91 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:22.840490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fbaca-a9ce-459c-bb8a-94e37e8dcc91 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:22.873593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc88d8-fc5b-4ace-9c1b-550338fb510f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:22.874191 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc88d8-fc5b-4ace-9c1b-550338fb510f None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:22.874478 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc88d8-fc5b-4ace-9c1b-550338fb510f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:22.874758 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc88d8-fc5b-4ace-9c1b-550338fb510f None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:22.875502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc88d8-fc5b-4ace-9c1b-550338fb510f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:22.876894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc88d8-fc5b-4ace-9c1b-550338fb510f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:22.979632 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 590/1169] 10.222.0.50 () {60 vars in 1138 bytes} [Thu Jun 2 15:47:22 2022] POST /identity/v3/domains => generated 267 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:47:25.312102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589dfca-09aa-4314-9f83-0bff65155e3d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:25.312660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589dfca-09aa-4314-9f83-0bff65155e3d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:25.312660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589dfca-09aa-4314-9f83-0bff65155e3d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:25.314008 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 580/1170] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:25.319545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095227e-36cf-4e4c-b72a-0121251fdf32 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:25.319932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095227e-36cf-4e4c-b72a-0121251fdf32 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:25.320144 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095227e-36cf-4e4c-b72a-0121251fdf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:25.336486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1095227e-36cf-4e4c-b72a-0121251fdf32 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:25.337671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1095227e-36cf-4e4c-b72a-0121251fdf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:25.361586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:25.403918 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 591/1171] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:25.428701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589dfca-09aa-4314-9f83-0bff65155e3d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:25.526735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589dfca-09aa-4314-9f83-0bff65155e3d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:25.528977 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:25.559628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bebb7-8030-46d1-94f9-a1f45f4d954e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:25.560510 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bebb7-8030-46d1-94f9-a1f45f4d954e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:25.560800 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bebb7-8030-46d1-94f9-a1f45f4d954e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:25.561079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bebb7-8030-46d1-94f9-a1f45f4d954e None admin] PATH_INFO: `/v3/domains/10239bcb80d44fdb80fddcadd7d01107` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:25.571366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bebb7-8030-46d1-94f9-a1f45f4d954e None admin] RBAC: Authorizing `identity:get_domain(domain_id=10239bcb80d44fdb80fddcadd7d01107)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:25.572846 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bebb7-8030-46d1-94f9-a1f45f4d954e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:25.574462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 581/1172] 10.222.0.50 () {56 vars in 1183 bytes} [Thu Jun 2 15:47:25 2022] GET /identity/v3/domains/10239bcb80d44fdb80fddcadd7d01107 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:25.580336 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095227e-36cf-4e4c-b72a-0121251fdf32 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:25.673702 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095227e-36cf-4e4c-b72a-0121251fdf32 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:25.706185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d297cd-52c4-4636-a183-8a47234c2797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:25.706851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d297cd-52c4-4636-a183-8a47234c2797 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:25.707135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d297cd-52c4-4636-a183-8a47234c2797 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:25.707414 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d297cd-52c4-4636-a183-8a47234c2797 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:25.708149 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d297cd-52c4-4636-a183-8a47234c2797 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:25.709612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d297cd-52c4-4636-a183-8a47234c2797 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:25.796737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 592/1173] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Jun 2 15:47:25 2022] POST /identity/v3/projects => generated 361 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:47:28.029668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5a9ad-0916-4595-9102-aab6d9a1fa9a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:28.030220 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5a9ad-0916-4595-9102-aab6d9a1fa9a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:28.030220 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5a9ad-0916-4595-9102-aab6d9a1fa9a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:28.031582 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 582/1174] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:28.036745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18697c68-4e12-4139-b666-103f0cb14418 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:28.037142 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18697c68-4e12-4139-b666-103f0cb14418 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:28.037308 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18697c68-4e12-4139-b666-103f0cb14418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:28.053421 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-18697c68-4e12-4139-b666-103f0cb14418 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:28.054585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-18697c68-4e12-4139-b666-103f0cb14418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:28.061566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:28.117854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 593/1175] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 15:47:28.142881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5a9ad-0916-4595-9102-aab6d9a1fa9a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:28.239739 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5a9ad-0916-4595-9102-aab6d9a1fa9a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:28.272919 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7958d5-3b0c-48e0-9cc7-6638b3fcccb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:28.273770 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7958d5-3b0c-48e0-9cc7-6638b3fcccb1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:28.274055 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7958d5-3b0c-48e0-9cc7-6638b3fcccb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:28.274334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7958d5-3b0c-48e0-9cc7-6638b3fcccb1 None admin] PATH_INFO: `/v3/domains/10239bcb80d44fdb80fddcadd7d01107` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:28.275482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7958d5-3b0c-48e0-9cc7-6638b3fcccb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=10239bcb80d44fdb80fddcadd7d01107)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:28.276929 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7958d5-3b0c-48e0-9cc7-6638b3fcccb1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:28.278521 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 583/1176] 10.222.0.50 () {56 vars in 1183 bytes} [Thu Jun 2 15:47:28 2022] GET /identity/v3/domains/10239bcb80d44fdb80fddcadd7d01107 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:28.284343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18697c68-4e12-4139-b666-103f0cb14418 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:28.378514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18697c68-4e12-4139-b666-103f0cb14418 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:28.411298 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254887f-d64f-449a-82f4-0aafeea41ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:28.412010 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254887f-d64f-449a-82f4-0aafeea41ca7 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:28.412293 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254887f-d64f-449a-82f4-0aafeea41ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:28.412573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254887f-d64f-449a-82f4-0aafeea41ca7 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:28.413282 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254887f-d64f-449a-82f4-0aafeea41ca7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:28.414699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254887f-d64f-449a-82f4-0aafeea41ca7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:28.497249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:28.503000 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 594/1177] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:47:28 2022] POST /identity/v3/users => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:47:30.751706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca7697-d913-42ff-b575-7fc001dd63a4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:30.752257 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca7697-d913-42ff-b575-7fc001dd63a4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:30.752257 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca7697-d913-42ff-b575-7fc001dd63a4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:30.753559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 584/1178] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:30.758697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e230d4-241b-4e18-9aa1-ff9fa6eea981 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:30.759130 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e230d4-241b-4e18-9aa1-ff9fa6eea981 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:30.759274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e230d4-241b-4e18-9aa1-ff9fa6eea981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:30.776316 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-21e230d4-241b-4e18-9aa1-ff9fa6eea981 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:30.777491 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-21e230d4-241b-4e18-9aa1-ff9fa6eea981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:30.844248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 595/1179] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:30.869076 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca7697-d913-42ff-b575-7fc001dd63a4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:30.899758 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:30.966828 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca7697-d913-42ff-b575-7fc001dd63a4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:30.998710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8e114-911a-45ab-b7aa-73f3b7e02c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:30.999476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8e114-911a-45ab-b7aa-73f3b7e02c84 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:30.999761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8e114-911a-45ab-b7aa-73f3b7e02c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:31.000063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8e114-911a-45ab-b7aa-73f3b7e02c84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:31.010692 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8e114-911a-45ab-b7aa-73f3b7e02c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:31.018289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-dda8e114-911a-45ab-b7aa-73f3b7e02c84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:31.018289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:31.018289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:31.018289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:31.018289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:31.018289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:31.018289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:31.018289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:31.018289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:31.018289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:31.018289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:31.018289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:31.018289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:31.018289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:31.018289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:31.018289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:31.019498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:31.019498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:31.019498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:31.019498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:31.019498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:31.019498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:31.019498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:31.019498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:31.019498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:31.019498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:31.019498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:31.019498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:31.019498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:31.019498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:31.019498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:31.019498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:31.020609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:31.020609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:31.020609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:31.020609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:31.020609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:31.020609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:31.020609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:31.020609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:31.020609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:31.020609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:31.020609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:31.020609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:47:31.020609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 585/1180] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:47:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:31.025540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e230d4-241b-4e18-9aa1-ff9fa6eea981 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:31.121600 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e230d4-241b-4e18-9aa1-ff9fa6eea981 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:31.146345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:31.153769 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad8a6d-e826-44e6-b400-dbf7cc81c5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:31.154424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad8a6d-e826-44e6-b400-dbf7cc81c5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:31.154714 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad8a6d-e826-44e6-b400-dbf7cc81c5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:31.154996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad8a6d-e826-44e6-b400-dbf7cc81c5d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:31.155732 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad8a6d-e826-44e6-b400-dbf7cc81c5d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:31.156069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad8a6d-e826-44e6-b400-dbf7cc81c5d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:31.157443 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad8a6d-e826-44e6-b400-dbf7cc81c5d2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:31.165755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 596/1181] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:47:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:31.171485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8e114-911a-45ab-b7aa-73f3b7e02c84 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:31.258902 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:31.267071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8e114-911a-45ab-b7aa-73f3b7e02c84 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:31.299369 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5be5f7-546f-4894-9bf4-656c56f25353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:31.300239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5be5f7-546f-4894-9bf4-656c56f25353 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:31.300523 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5be5f7-546f-4894-9bf4-656c56f25353 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:31.300799 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5be5f7-546f-4894-9bf4-656c56f25353 None admin] PATH_INFO: `/v3/users/4a1af3e158924e5fbc8eb202e928a842` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:31.313301 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5be5f7-546f-4894-9bf4-656c56f25353 None admin] RBAC: Authorizing `identity:get_user(user_id=4a1af3e158924e5fbc8eb202e928a842)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:31.314736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5be5f7-546f-4894-9bf4-656c56f25353 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:31.316355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 586/1182] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:31 2022] GET /identity/v3/users/4a1af3e158924e5fbc8eb202e928a842 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:31.322019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad8a6d-e826-44e6-b400-dbf7cc81c5d2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:31.420543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad8a6d-e826-44e6-b400-dbf7cc81c5d2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:31.452267 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861207a-232d-45ff-bc33-d2473a8d2b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:31.452905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861207a-232d-45ff-bc33-d2473a8d2b5f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:31.453187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861207a-232d-45ff-bc33-d2473a8d2b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:31.453462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861207a-232d-45ff-bc33-d2473a8d2b5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:31.508328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:31.529222 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861207a-232d-45ff-bc33-d2473a8d2b5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:31.529222 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861207a-232d-45ff-bc33-d2473a8d2b5f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:31.611446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 597/1183] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:47:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:47:31.617856 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5be5f7-546f-4894-9bf4-656c56f25353 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:31.713578 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5be5f7-546f-4894-9bf4-656c56f25353 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:31.745572 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f188e8f-59c2-406f-a9f1-010dccd5252c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:31.746666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f188e8f-59c2-406f-a9f1-010dccd5252c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:31.746947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f188e8f-59c2-406f-a9f1-010dccd5252c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:31.747224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f188e8f-59c2-406f-a9f1-010dccd5252c None admin] PATH_INFO: `/v3/projects/4f3dd47d14be4dc59d6f8f9a256efe48` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:31.748421 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f188e8f-59c2-406f-a9f1-010dccd5252c None admin] RBAC: Authorizing `identity:get_project(project_id=4f3dd47d14be4dc59d6f8f9a256efe48)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:31.749852 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f188e8f-59c2-406f-a9f1-010dccd5252c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:31.751508 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 587/1184] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:47:31 2022] GET /identity/v3/projects/4f3dd47d14be4dc59d6f8f9a256efe48 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:31.757840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861207a-232d-45ff-bc33-d2473a8d2b5f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:31.842627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:31.852117 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861207a-232d-45ff-bc33-d2473a8d2b5f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:31.884840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d78e2-c4b7-4149-8d91-1f6929997212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:31.885477 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d78e2-c4b7-4149-8d91-1f6929997212 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:31.885765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d78e2-c4b7-4149-8d91-1f6929997212 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:31.886045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d78e2-c4b7-4149-8d91-1f6929997212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:31.886865 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d78e2-c4b7-4149-8d91-1f6929997212 None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=4f3dd47d14be4dc59d6f8f9a256efe48, user.id=4a1af3e158924e5fbc8eb202e928a842) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:31.887181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d78e2-c4b7-4149-8d91-1f6929997212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:31.888637 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d78e2-c4b7-4149-8d91-1f6929997212 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:31.893910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 598/1185] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:47:31 2022] GET /identity/v3/role_assignments?user.id=4a1af3e158924e5fbc8eb202e928a842&scope.project.id=4f3dd47d14be4dc59d6f8f9a256efe48&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:34.120851 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a95c50-7c53-462b-8614-dcd60a03136c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:34.121631 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a95c50-7c53-462b-8614-dcd60a03136c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:34.121747 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a95c50-7c53-462b-8614-dcd60a03136c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:34.123030 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 588/1186] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:34.128380 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27f553-3b8d-4775-9880-d9fd8a9aa76c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:34.128806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27f553-3b8d-4775-9880-d9fd8a9aa76c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:34.128945 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27f553-3b8d-4775-9880-d9fd8a9aa76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:34.145207 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ac27f553-3b8d-4775-9880-d9fd8a9aa76c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:34.146406 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ac27f553-3b8d-4775-9880-d9fd8a9aa76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:34.210189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 599/1187] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:34.232881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a95c50-7c53-462b-8614-dcd60a03136c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:34.252618 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:34.331781 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a95c50-7c53-462b-8614-dcd60a03136c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:34.363787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec33cb7-b3dd-47ea-91a4-24bab799f0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:34.364598 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec33cb7-b3dd-47ea-91a4-24bab799f0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:34.364920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec33cb7-b3dd-47ea-91a4-24bab799f0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:34.365702 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec33cb7-b3dd-47ea-91a4-24bab799f0f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:34.375957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec33cb7-b3dd-47ea-91a4-24bab799f0f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:34.383834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2ec33cb7-b3dd-47ea-91a4-24bab799f0f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:34.383834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:34.383834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:34.383834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:34.383834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:34.383834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:34.383834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:34.383834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:34.383834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:34.383834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:34.383834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:34.383834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:34.383834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:34.383834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:34.383834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:34.383834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:34.384989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:34.384989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:34.384989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:34.384989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:34.384989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:34.384989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:34.384989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:34.384989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:34.384989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:34.384989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:34.384989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:34.384989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:34.384989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:34.384989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:34.384989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:34.384989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:34.386088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:34.386088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:34.386088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:34.386088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:34.386088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:34.386088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:34.386088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:34.386088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:34.386088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:34.386088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:34.386088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:34.386088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:47:34.386088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 589/1188] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:47:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:34.390971 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27f553-3b8d-4775-9880-d9fd8a9aa76c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:34.469882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:34.485006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27f553-3b8d-4775-9880-d9fd8a9aa76c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:34.517416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ca470-dcb4-4eed-be49-29cece8d7c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:34.518084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ca470-dcb4-4eed-be49-29cece8d7c02 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:34.518375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ca470-dcb4-4eed-be49-29cece8d7c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:34.518661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ca470-dcb4-4eed-be49-29cece8d7c02 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:34.519402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ca470-dcb4-4eed-be49-29cece8d7c02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:34.519721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ca470-dcb4-4eed-be49-29cece8d7c02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:34.521685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ca470-dcb4-4eed-be49-29cece8d7c02 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:34.529487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 600/1189] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:47:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:34.535287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec33cb7-b3dd-47ea-91a4-24bab799f0f6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:34.611046 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:34.631578 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec33cb7-b3dd-47ea-91a4-24bab799f0f6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:34.664491 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3811978-5163-4b62-b733-31fe9b456fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:34.665361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3811978-5163-4b62-b733-31fe9b456fbb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:34.665650 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3811978-5163-4b62-b733-31fe9b456fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:34.665933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3811978-5163-4b62-b733-31fe9b456fbb None admin] PATH_INFO: `/v3/users/4a1af3e158924e5fbc8eb202e928a842` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:34.667113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3811978-5163-4b62-b733-31fe9b456fbb None admin] RBAC: Authorizing `identity:get_user(user_id=4a1af3e158924e5fbc8eb202e928a842)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:34.668571 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3811978-5163-4b62-b733-31fe9b456fbb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:34.670169 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 590/1190] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:34 2022] GET /identity/v3/users/4a1af3e158924e5fbc8eb202e928a842 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:34.675710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ca470-dcb4-4eed-be49-29cece8d7c02 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:34.771819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ca470-dcb4-4eed-be49-29cece8d7c02 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:34.806339 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18e3e4-fc0e-473c-b621-6e44ef01e6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:34.807189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18e3e4-fc0e-473c-b621-6e44ef01e6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:34.807477 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18e3e4-fc0e-473c-b621-6e44ef01e6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:34.807757 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18e3e4-fc0e-473c-b621-6e44ef01e6b5 None admin] PATH_INFO: `/v3/projects/4f3dd47d14be4dc59d6f8f9a256efe48` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:34.808955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18e3e4-fc0e-473c-b621-6e44ef01e6b5 None admin] RBAC: Authorizing `identity:get_project(project_id=4f3dd47d14be4dc59d6f8f9a256efe48)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:34.810391 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18e3e4-fc0e-473c-b621-6e44ef01e6b5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:34.812097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 601/1191] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:47:34 2022] GET /identity/v3/projects/4f3dd47d14be4dc59d6f8f9a256efe48 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:34.817911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3811978-5163-4b62-b733-31fe9b456fbb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:34.918297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3811978-5163-4b62-b733-31fe9b456fbb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:34.950264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9817600-0ed2-4aa2-a1b5-3fcc4c5e183d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:34.951142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9817600-0ed2-4aa2-a1b5-3fcc4c5e183d None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:34.951428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9817600-0ed2-4aa2-a1b5-3fcc4c5e183d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:34.951707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9817600-0ed2-4aa2-a1b5-3fcc4c5e183d None admin] PATH_INFO: `/v3/projects/4f3dd47d14be4dc59d6f8f9a256efe48/users/4a1af3e158924e5fbc8eb202e928a842/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:34.953664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9817600-0ed2-4aa2-a1b5-3fcc4c5e183d None admin] RBAC: Authorizing `identity:create_grant(project_id=4f3dd47d14be4dc59d6f8f9a256efe48, user_id=4a1af3e158924e5fbc8eb202e928a842, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:34.955089 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9817600-0ed2-4aa2-a1b5-3fcc4c5e183d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:35.030065 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 591/1192] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:47:34 2022] PUT /identity/v3/projects/4f3dd47d14be4dc59d6f8f9a256efe48/users/4a1af3e158924e5fbc8eb202e928a842/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:47:37.245469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7aa8d-b23d-4808-a708-bd538e5e8fad None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:37.246027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7aa8d-b23d-4808-a708-bd538e5e8fad None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:37.246027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7aa8d-b23d-4808-a708-bd538e5e8fad None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:37.247659 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 602/1193] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:47:37.253147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef83ea-99cc-4d87-a7ba-d94f22984dea None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:37.253563 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef83ea-99cc-4d87-a7ba-d94f22984dea None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:37.253713 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef83ea-99cc-4d87-a7ba-d94f22984dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:37.265525 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:37.270807 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5bef83ea-99cc-4d87-a7ba-d94f22984dea None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:47:37.272185 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5bef83ea-99cc-4d87-a7ba-d94f22984dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:47:37.334492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 592/1194] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:47:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:47:37.358315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7aa8d-b23d-4808-a708-bd538e5e8fad None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:37.375287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:37.455684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7aa8d-b23d-4808-a708-bd538e5e8fad None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:37.487902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5417b-ff53-4557-8aec-5a922df08aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:37.488698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5417b-ff53-4557-8aec-5a922df08aab None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:37.488978 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5417b-ff53-4557-8aec-5a922df08aab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:37.489253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5417b-ff53-4557-8aec-5a922df08aab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:37.499175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5417b-ff53-4557-8aec-5a922df08aab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:47:37.506812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7ae5417b-ff53-4557-8aec-5a922df08aab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:37.506812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:47:37.506812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:47:37.506812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:47:37.506812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:47:37.506812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:47:37.506812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:47:37.506812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:47:37.506812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:47:37.506812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:47:37.506812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:47:37.506812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:47:37.506812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:47:37.506812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:47:37.506812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:47:37.506812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:47:37.507954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:47:37.507954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:47:37.507954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:47:37.507954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:47:37.507954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:47:37.507954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:47:37.507954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:47:37.507954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:47:37.507954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:47:37.507954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:47:37.507954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:47:37.507954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:47:37.507954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:47:37.507954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:47:37.507954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:47:37.507954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:47:37.509209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:47:37.509209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:47:37.509209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:47:37.509209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:47:37.509209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:47:37.509209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:47:37.509209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:47:37.509209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:47:37.509209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:47:37.509209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:47:37.509209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:47:37.509209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:47:37.509209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 603/1195] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:47:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:47:37.513929 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef83ea-99cc-4d87-a7ba-d94f22984dea None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:37.609256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef83ea-99cc-4d87-a7ba-d94f22984dea None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:37.641154 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6257e6-2383-4a8b-afc4-91db7998bc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:37.641803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6257e6-2383-4a8b-afc4-91db7998bc1f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:37.642086 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6257e6-2383-4a8b-afc4-91db7998bc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:37.642362 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6257e6-2383-4a8b-afc4-91db7998bc1f None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:37.643088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6257e6-2383-4a8b-afc4-91db7998bc1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:37.643395 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6257e6-2383-4a8b-afc4-91db7998bc1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:37.644792 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6257e6-2383-4a8b-afc4-91db7998bc1f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:37.647407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:37.653442 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 593/1196] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:47:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:37.659135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5417b-ff53-4557-8aec-5a922df08aab None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:37.732094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:37.756319 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5417b-ff53-4557-8aec-5a922df08aab None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:37.788962 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6daa6-48dc-4213-a6b8-a8312a49d377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:37.789817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6daa6-48dc-4213-a6b8-a8312a49d377 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:37.790104 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6daa6-48dc-4213-a6b8-a8312a49d377 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:37.790383 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6daa6-48dc-4213-a6b8-a8312a49d377 None admin] PATH_INFO: `/v3/users/4a1af3e158924e5fbc8eb202e928a842` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:37.791545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6daa6-48dc-4213-a6b8-a8312a49d377 None admin] RBAC: Authorizing `identity:get_user(user_id=4a1af3e158924e5fbc8eb202e928a842)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:37.792992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6daa6-48dc-4213-a6b8-a8312a49d377 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:37.794580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 604/1197] 10.222.0.50 () {56 vars in 1177 bytes} [Thu Jun 2 15:47:37 2022] GET /identity/v3/users/4a1af3e158924e5fbc8eb202e928a842 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:37.800163 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6257e6-2383-4a8b-afc4-91db7998bc1f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:37.894714 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6257e6-2383-4a8b-afc4-91db7998bc1f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:37.926384 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866fb32-5ef5-41ff-952c-c49b9173e099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:37.927011 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866fb32-5ef5-41ff-952c-c49b9173e099 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:37.927366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866fb32-5ef5-41ff-952c-c49b9173e099 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:37.927649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866fb32-5ef5-41ff-952c-c49b9173e099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:37.988154 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:37.991436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866fb32-5ef5-41ff-952c-c49b9173e099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:37.992887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866fb32-5ef5-41ff-952c-c49b9173e099 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:38.086279 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 594/1198] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:47:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:47:38.091973 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6daa6-48dc-4213-a6b8-a8312a49d377 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:38.187745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6daa6-48dc-4213-a6b8-a8312a49d377 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:38.219805 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3b372-321e-4d41-9158-806579d76a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:38.220681 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3b372-321e-4d41-9158-806579d76a97 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:38.220972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3b372-321e-4d41-9158-806579d76a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:38.221254 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3b372-321e-4d41-9158-806579d76a97 None admin] PATH_INFO: `/v3/projects/4f3dd47d14be4dc59d6f8f9a256efe48` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:38.222418 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3b372-321e-4d41-9158-806579d76a97 None admin] RBAC: Authorizing `identity:get_project(project_id=4f3dd47d14be4dc59d6f8f9a256efe48)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:38.223850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3b372-321e-4d41-9158-806579d76a97 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:38.225577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 605/1199] 10.222.0.50 () {56 vars in 1186 bytes} [Thu Jun 2 15:47:38 2022] GET /identity/v3/projects/4f3dd47d14be4dc59d6f8f9a256efe48 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:38.231277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866fb32-5ef5-41ff-952c-c49b9173e099 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:47:38.322629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:38.326234 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866fb32-5ef5-41ff-952c-c49b9173e099 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:47:38.358577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1965bb6-daa0-428a-8417-8619d2c9614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:47:38.359158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1965bb6-daa0-428a-8417-8619d2c9614a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:47:38.359442 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1965bb6-daa0-428a-8417-8619d2c9614a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:47:38.359716 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1965bb6-daa0-428a-8417-8619d2c9614a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:47:38.360572 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1965bb6-daa0-428a-8417-8619d2c9614a None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=4f3dd47d14be4dc59d6f8f9a256efe48, user.id=4a1af3e158924e5fbc8eb202e928a842) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:47:38.360886 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1965bb6-daa0-428a-8417-8619d2c9614a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:47:38.362295 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1965bb6-daa0-428a-8417-8619d2c9614a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:47:38.368510 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 595/1200] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:47:38 2022] GET /identity/v3/role_assignments?user.id=4a1af3e158924e5fbc8eb202e928a842&scope.project.id=4f3dd47d14be4dc59d6f8f9a256efe48&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:47:48.215797 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:47:48.365874 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=19 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:00.133560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd255f-7d73-4552-9af8-2c906a8ccab4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:00.134177 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd255f-7d73-4552-9af8-2c906a8ccab4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:00.134177 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd255f-7d73-4552-9af8-2c906a8ccab4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:00.135487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 606/1201] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:49:00.140907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfc5e0-58d9-44e7-a383-4174d9fb94c3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:00.148484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfc5e0-58d9-44e7-a383-4174d9fb94c3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:00.148484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfc5e0-58d9-44e7-a383-4174d9fb94c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:00.158864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1fcfc5e0-58d9-44e7-a383-4174d9fb94c3 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:49:00.160678 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1fcfc5e0-58d9-44e7-a383-4174d9fb94c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:49:00.225207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 596/1202] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:49:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:49:00.249709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd255f-7d73-4552-9af8-2c906a8ccab4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:00.348830 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd255f-7d73-4552-9af8-2c906a8ccab4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:00.382479 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb58b57-aa3e-4396-b745-d7106f9834a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:00.383271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb58b57-aa3e-4396-b745-d7106f9834a3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:00.383557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb58b57-aa3e-4396-b745-d7106f9834a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:00.383889 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb58b57-aa3e-4396-b745-d7106f9834a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:00.394348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb58b57-aa3e-4396-b745-d7106f9834a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:00.395724 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb58b57-aa3e-4396-b745-d7106f9834a3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:00.412738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-aeb58b57-aa3e-4396-b745-d7106f9834a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:00.412738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:00.412738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:00.412738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:00.412738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:00.412738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:00.412738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:00.412738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:00.412738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:00.412738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:00.412738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:00.412738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:00.412738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:00.412738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:00.412738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:00.413794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:00.414787 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:00.414787 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:00.414787 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:00.414787 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:49:00.414787 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 607/1203] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:00.420070 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfc5e0-58d9-44e7-a383-4174d9fb94c3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:00.514706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfc5e0-58d9-44e7-a383-4174d9fb94c3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:00.543132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:00.548829 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f26e31-f974-4d08-a6e6-8ad6a5f07ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:00.549489 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f26e31-f974-4d08-a6e6-8ad6a5f07ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:00.549809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f26e31-f974-4d08-a6e6-8ad6a5f07ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:00.550085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f26e31-f974-4d08-a6e6-8ad6a5f07ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:00.550844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f26e31-f974-4d08-a6e6-8ad6a5f07ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:00.551153 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f26e31-f974-4d08-a6e6-8ad6a5f07ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:00.552579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f26e31-f974-4d08-a6e6-8ad6a5f07ba0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:00.563281 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 597/1204] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:00.569522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb58b57-aa3e-4396-b745-d7106f9834a3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:00.621724 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:00.666793 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb58b57-aa3e-4396-b745-d7106f9834a3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:00.699954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397cfdd-eaa7-48c5-9a2d-a336fd06bfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:00.700638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397cfdd-eaa7-48c5-9a2d-a336fd06bfa7 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:00.700920 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397cfdd-eaa7-48c5-9a2d-a336fd06bfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:00.701194 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397cfdd-eaa7-48c5-9a2d-a336fd06bfa7 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:00.701890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397cfdd-eaa7-48c5-9a2d-a336fd06bfa7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:00.703420 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397cfdd-eaa7-48c5-9a2d-a336fd06bfa7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:00.833675 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 608/1205] 10.222.0.50 () {60 vars in 1132 bytes} [Thu Jun 2 15:49:00 2022] POST /identity/v3/users => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:49:03.101077 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779e664-8eb8-4fc4-9178-db1cfe7bda38 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:03.101644 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779e664-8eb8-4fc4-9178-db1cfe7bda38 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:03.101644 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779e664-8eb8-4fc4-9178-db1cfe7bda38 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:03.103038 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 598/1206] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:49:03.108332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc046d9-1dad-40fb-87b8-df22398b3d4e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:03.108715 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc046d9-1dad-40fb-87b8-df22398b3d4e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:03.108951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc046d9-1dad-40fb-87b8-df22398b3d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:03.125548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dbc046d9-1dad-40fb-87b8-df22398b3d4e None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:49:03.129045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dbc046d9-1dad-40fb-87b8-df22398b3d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:49:03.191877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 609/1207] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:49:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:49:03.216160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779e664-8eb8-4fc4-9178-db1cfe7bda38 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:03.313978 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779e664-8eb8-4fc4-9178-db1cfe7bda38 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:03.347357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21297e18-6d1b-4181-828e-2dbddb1112cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:03.348191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21297e18-6d1b-4181-828e-2dbddb1112cb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:03.348480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21297e18-6d1b-4181-828e-2dbddb1112cb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:03.348759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21297e18-6d1b-4181-828e-2dbddb1112cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:03.364007 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21297e18-6d1b-4181-828e-2dbddb1112cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:49:03.367058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-21297e18-6d1b-4181-828e-2dbddb1112cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:49:03.367058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:03.367058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:03.367058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:03.367058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:03.367058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:03.367058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:03.367058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:03.367058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:03.367058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:03.367058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:03.367058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:03.367058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:49:03.367058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:49:03.367058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:49:03.367058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:49:03.368125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:49:03.368125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:49:03.368125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:49:03.368125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:49:03.368125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:03.368125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:03.368125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:03.368125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:03.368125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:03.368125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:03.368125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:03.368125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:03.368125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:03.368125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:03.368125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:03.368125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:03.369804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:03.369804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:03.369804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:03.369804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:03.369804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:49:03.369804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:49:03.369804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:49:03.369804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:49:03.369804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:49:03.369804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:49:03.369804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:49:03.369804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:03.369804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 599/1208] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:49:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:03.374539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc046d9-1dad-40fb-87b8-df22398b3d4e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:03.413184 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:03.469488 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc046d9-1dad-40fb-87b8-df22398b3d4e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:03.501086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf57b2-a72a-4d8b-ad6c-0b5ee4e01743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:03.501747 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf57b2-a72a-4d8b-ad6c-0b5ee4e01743 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:03.502032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf57b2-a72a-4d8b-ad6c-0b5ee4e01743 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:03.502308 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf57b2-a72a-4d8b-ad6c-0b5ee4e01743 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:03.503594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf57b2-a72a-4d8b-ad6c-0b5ee4e01743 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:03.504132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf57b2-a72a-4d8b-ad6c-0b5ee4e01743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:03.510693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf57b2-a72a-4d8b-ad6c-0b5ee4e01743 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:03.513700 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 610/1209] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:49:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:03.519886 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21297e18-6d1b-4181-828e-2dbddb1112cb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:03.568403 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:03.615279 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21297e18-6d1b-4181-828e-2dbddb1112cb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:03.648196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac9f80-8044-4ad1-97f1-cc4156933bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:03.649021 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac9f80-8044-4ad1-97f1-cc4156933bde None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:03.649307 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac9f80-8044-4ad1-97f1-cc4156933bde None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:03.649586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac9f80-8044-4ad1-97f1-cc4156933bde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:03.659247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac9f80-8044-4ad1-97f1-cc4156933bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:03.660729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac9f80-8044-4ad1-97f1-cc4156933bde None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:03.678191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-54ac9f80-8044-4ad1-97f1-cc4156933bde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:03.678191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:03.678191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:03.678191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:03.678191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:03.678191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:03.678191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:03.678191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:03.678191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:03.678191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:03.678191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:03.678191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:03.678191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:03.678191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:03.678191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:03.679293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:03.680402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:03.680402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:03.680402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:03.680402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:03.680402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 600/1210] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:03.685147 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf57b2-a72a-4d8b-ad6c-0b5ee4e01743 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:03.779615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:03.782414 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf57b2-a72a-4d8b-ad6c-0b5ee4e01743 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:03.815828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc76f2e-36ab-4ab0-9c9b-c393eb32d710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:03.816521 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76f2e-36ab-4ab0-9c9b-c393eb32d710 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:03.816806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76f2e-36ab-4ab0-9c9b-c393eb32d710 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:03.817089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76f2e-36ab-4ab0-9c9b-c393eb32d710 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:03.817804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc76f2e-36ab-4ab0-9c9b-c393eb32d710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:03.818117 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc76f2e-36ab-4ab0-9c9b-c393eb32d710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:03.819497 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc76f2e-36ab-4ab0-9c9b-c393eb32d710 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:03.830801 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 611/1211] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:49:03.836424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac9f80-8044-4ad1-97f1-cc4156933bde None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:03.938883 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac9f80-8044-4ad1-97f1-cc4156933bde None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:03.940862 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:03.972212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d1aef-bcb0-4849-8130-033f2cb3c548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:03.973002 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d1aef-bcb0-4849-8130-033f2cb3c548 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:03.973364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d1aef-bcb0-4849-8130-033f2cb3c548 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:03.973650 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d1aef-bcb0-4849-8130-033f2cb3c548 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:03.980366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d1aef-bcb0-4849-8130-033f2cb3c548 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:03.981798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d1aef-bcb0-4849-8130-033f2cb3c548 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:03.996592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8d5d1aef-bcb0-4849-8130-033f2cb3c548 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:03.996592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:03.996592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:03.996592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:03.996592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:03.996592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:03.996592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:03.996592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:03.996592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:03.996592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:03.996592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:03.996592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:03.996592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:49:03.996592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:49:03.996592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:49:03.996592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:03.997654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:03.998907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:03.998907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:03.998907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:49:03.998907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:49:03.998907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:49:03.998907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:49:03.998907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:49:03.998907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:49:03.998907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:03.998907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:03.998907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 601/1212] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:04.003918 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc76f2e-36ab-4ab0-9c9b-c393eb32d710 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:04.101605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc76f2e-36ab-4ab0-9c9b-c393eb32d710 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:04.134322 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c839b7-9494-4e63-ab8b-68ba1211b76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:04.134990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c839b7-9494-4e63-ab8b-68ba1211b76e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:04.135277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c839b7-9494-4e63-ab8b-68ba1211b76e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:04.135559 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c839b7-9494-4e63-ab8b-68ba1211b76e None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:04.136489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c839b7-9494-4e63-ab8b-68ba1211b76e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:04.136797 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c839b7-9494-4e63-ab8b-68ba1211b76e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:04.138225 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c839b7-9494-4e63-ab8b-68ba1211b76e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:04.154939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 612/1213] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Jun 2 15:49:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:04.161309 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d1aef-bcb0-4849-8130-033f2cb3c548 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:04.257127 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d1aef-bcb0-4849-8130-033f2cb3c548 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:04.289726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edfba8-cc03-48e4-b6bb-ad2842c55887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:04.290359 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edfba8-cc03-48e4-b6bb-ad2842c55887 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:04.290647 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edfba8-cc03-48e4-b6bb-ad2842c55887 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:04.290928 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edfba8-cc03-48e4-b6bb-ad2842c55887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:04.321396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:04.358317 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edfba8-cc03-48e4-b6bb-ad2842c55887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:04.359776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edfba8-cc03-48e4-b6bb-ad2842c55887 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:04.454559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 602/1214] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:49:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:49:04.460912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c839b7-9494-4e63-ab8b-68ba1211b76e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:04.479626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:04.556740 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c839b7-9494-4e63-ab8b-68ba1211b76e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:04.590055 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c50f39-1d76-44c5-b403-305be45a83fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:04.590843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c50f39-1d76-44c5-b403-305be45a83fd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:04.591127 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c50f39-1d76-44c5-b403-305be45a83fd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:04.591405 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c50f39-1d76-44c5-b403-305be45a83fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:04.601431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c50f39-1d76-44c5-b403-305be45a83fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:04.602873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c50f39-1d76-44c5-b403-305be45a83fd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:04.620395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-68c50f39-1d76-44c5-b403-305be45a83fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:04.620395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:04.620395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:04.620395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:04.620395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:04.620395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:04.620395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:04.620395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:04.620395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:04.620395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:04.620395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:04.620395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:04.620395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:04.620395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:04.620395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:04.621450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:04.622996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:04.622996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:04.622996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:04.622996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:49:04.622996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 613/1215] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:04.628159 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edfba8-cc03-48e4-b6bb-ad2842c55887 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:04.686348 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:04.723387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edfba8-cc03-48e4-b6bb-ad2842c55887 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:04.757049 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7552453-399a-4c10-8dda-d3b1c2d43559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:04.757706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7552453-399a-4c10-8dda-d3b1c2d43559 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:04.757997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7552453-399a-4c10-8dda-d3b1c2d43559 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:04.758274 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7552453-399a-4c10-8dda-d3b1c2d43559 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:04.758981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7552453-399a-4c10-8dda-d3b1c2d43559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:04.759289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7552453-399a-4c10-8dda-d3b1c2d43559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:04.760681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7552453-399a-4c10-8dda-d3b1c2d43559 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:04.772365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 603/1216] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:04.778047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c50f39-1d76-44c5-b403-305be45a83fd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:04.845289 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:04.874786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c50f39-1d76-44c5-b403-305be45a83fd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:04.907595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb72415-eecf-4ec5-92f0-ce716da67a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:04.908411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb72415-eecf-4ec5-92f0-ce716da67a2b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:04.908708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb72415-eecf-4ec5-92f0-ce716da67a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:04.908973 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb72415-eecf-4ec5-92f0-ce716da67a2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:04.915466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb72415-eecf-4ec5-92f0-ce716da67a2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:04.916938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb72415-eecf-4ec5-92f0-ce716da67a2b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:04.931355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-aeb72415-eecf-4ec5-92f0-ce716da67a2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:04.931355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:04.931355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:04.931355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:04.931355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:04.931355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:04.931355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:04.931355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:04.931355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:04.931355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:04.931355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:04.931355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:04.931355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:49:04.931355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:49:04.931355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:04.932501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:04.933653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:49:04.933653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:49:04.933653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:49:04.933653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:49:04.933653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:49:04.933653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:49:04.933653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:04.933653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:49:04.933653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 614/1217] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:49:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:04.938615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7552453-399a-4c10-8dda-d3b1c2d43559 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:05.037310 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7552453-399a-4c10-8dda-d3b1c2d43559 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:05.058450 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:05.069926 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1422b-4f6a-4b5c-9840-79513ff66a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:05.070578 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1422b-4f6a-4b5c-9840-79513ff66a49 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:05.070862 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1422b-4f6a-4b5c-9840-79513ff66a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:05.071137 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1422b-4f6a-4b5c-9840-79513ff66a49 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:05.071908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1422b-4f6a-4b5c-9840-79513ff66a49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:05.072249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1422b-4f6a-4b5c-9840-79513ff66a49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:05.073661 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1422b-4f6a-4b5c-9840-79513ff66a49 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:05.085209 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 604/1218] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:49:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:05.091358 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb72415-eecf-4ec5-92f0-ce716da67a2b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:05.190965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb72415-eecf-4ec5-92f0-ce716da67a2b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:05.219116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:05.225502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bf0cb-f6e2-4224-a6af-6e750ad68dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:05.226185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bf0cb-f6e2-4224-a6af-6e750ad68dec None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:05.226495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bf0cb-f6e2-4224-a6af-6e750ad68dec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:05.226777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bf0cb-f6e2-4224-a6af-6e750ad68dec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:05.227598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bf0cb-f6e2-4224-a6af-6e750ad68dec None admin] RBAC: Adding query filter params (role.id=740fa9b1529f4a558de5b8987dba5ba3, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=8d60a2abffc04ba59b65d5fca5e318a6) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:05.227915 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bf0cb-f6e2-4224-a6af-6e750ad68dec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:05.229426 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bf0cb-f6e2-4224-a6af-6e750ad68dec None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:05.234690 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 615/1219] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:49:05 2022] GET /identity/v3/role_assignments?user.id=8d60a2abffc04ba59b65d5fca5e318a6&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=740fa9b1529f4a558de5b8987dba5ba3 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:07.432121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc155bb-bd00-4f6d-be36-5cbb2a7f3648 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:07.432681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc155bb-bd00-4f6d-be36-5cbb2a7f3648 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:07.432681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc155bb-bd00-4f6d-be36-5cbb2a7f3648 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:07.434047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 605/1220] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:49:07.439330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d3752-b542-48d3-b4b1-9d0c9805f769 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:07.439788 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d3752-b542-48d3-b4b1-9d0c9805f769 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:07.440015 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d3752-b542-48d3-b4b1-9d0c9805f769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:07.456722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-232d3752-b542-48d3-b4b1-9d0c9805f769 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:49:07.457894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-232d3752-b542-48d3-b4b1-9d0c9805f769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:49:07.521062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 616/1221] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:49:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:49:07.543456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc155bb-bd00-4f6d-be36-5cbb2a7f3648 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:07.642449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc155bb-bd00-4f6d-be36-5cbb2a7f3648 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:07.675544 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33390307-1afe-4442-8291-733d51dc3ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:07.676354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33390307-1afe-4442-8291-733d51dc3ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:07.676637 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33390307-1afe-4442-8291-733d51dc3ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:07.676910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33390307-1afe-4442-8291-733d51dc3ef1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:07.686893 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33390307-1afe-4442-8291-733d51dc3ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:49:07.694485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-33390307-1afe-4442-8291-733d51dc3ef1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:49:07.694485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:07.694485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:07.694485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:07.694485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:07.694485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:07.694485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:07.694485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:07.694485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:07.694485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:07.694485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:07.694485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:07.694485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:49:07.694485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:49:07.694485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:49:07.694485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:49:07.695628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:49:07.695628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:49:07.695628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:49:07.695628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:49:07.695628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:07.695628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:07.695628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:07.695628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:07.695628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:07.695628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:07.695628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:07.695628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:07.695628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:07.695628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:07.695628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:07.695628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:07.696751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:07.696751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:07.696751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:07.696751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:07.696751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:49:07.696751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:49:07.696751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:49:07.696751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:49:07.696751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:49:07.696751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:49:07.696751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:49:07.696751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:07.696751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 606/1222] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:49:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:07.702006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d3752-b542-48d3-b4b1-9d0c9805f769 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:07.796970 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d3752-b542-48d3-b4b1-9d0c9805f769 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:07.820694 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:07.831455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2ad4c-6d90-42b9-a477-6f6b0e656305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:07.832156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2ad4c-6d90-42b9-a477-6f6b0e656305 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:07.832446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2ad4c-6d90-42b9-a477-6f6b0e656305 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:07.832727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2ad4c-6d90-42b9-a477-6f6b0e656305 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:07.833459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2ad4c-6d90-42b9-a477-6f6b0e656305 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:07.833770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2ad4c-6d90-42b9-a477-6f6b0e656305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:07.835135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2ad4c-6d90-42b9-a477-6f6b0e656305 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:07.842734 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 617/1223] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:49:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:49:07.848705 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33390307-1afe-4442-8291-733d51dc3ef1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:07.899570 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:07.955213 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33390307-1afe-4442-8291-733d51dc3ef1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:07.987776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259bbab-b8b8-4f82-b610-e791d7f49471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:07.988595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259bbab-b8b8-4f82-b610-e791d7f49471 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:07.988885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259bbab-b8b8-4f82-b610-e791d7f49471 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:07.989166 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259bbab-b8b8-4f82-b610-e791d7f49471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:08.000257 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259bbab-b8b8-4f82-b610-e791d7f49471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:08.001712 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259bbab-b8b8-4f82-b610-e791d7f49471 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:08.019602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e259bbab-b8b8-4f82-b610-e791d7f49471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:08.019602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:08.019602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:08.019602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:08.019602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:08.019602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:08.019602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:08.019602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:08.019602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:08.019602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:08.019602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:08.019602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:08.019602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:08.019602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:08.019602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:08.020710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:08.021898 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:08.021898 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:08.021898 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:08.021898 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:08.021898 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 607/1224] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:08.026653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2ad4c-6d90-42b9-a477-6f6b0e656305 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:08.124932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2ad4c-6d90-42b9-a477-6f6b0e656305 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:08.157946 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32588b-6df7-4a0b-af21-94a5e8292549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:08.158546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32588b-6df7-4a0b-af21-94a5e8292549 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:08.158834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32588b-6df7-4a0b-af21-94a5e8292549 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:08.159116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32588b-6df7-4a0b-af21-94a5e8292549 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:08.159824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32588b-6df7-4a0b-af21-94a5e8292549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:08.160162 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32588b-6df7-4a0b-af21-94a5e8292549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:08.161540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32588b-6df7-4a0b-af21-94a5e8292549 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:08.172958 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 618/1225] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:08.179073 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259bbab-b8b8-4f82-b610-e791d7f49471 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:08.271745 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:08.278294 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259bbab-b8b8-4f82-b610-e791d7f49471 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:08.310666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32142cce-859e-41d0-88b8-f6fbed1d7d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:08.311459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142cce-859e-41d0-88b8-f6fbed1d7d19 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:08.311748 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142cce-859e-41d0-88b8-f6fbed1d7d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:08.312056 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142cce-859e-41d0-88b8-f6fbed1d7d19 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:08.320086 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32142cce-859e-41d0-88b8-f6fbed1d7d19 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:08.321531 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32142cce-859e-41d0-88b8-f6fbed1d7d19 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:08.335446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-32142cce-859e-41d0-88b8-f6fbed1d7d19 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:08.335446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:08.335446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:08.335446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:08.335446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:08.335446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:08.335446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:08.335446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:08.335446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:08.335446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:08.335446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:08.335446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:08.335446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:49:08.335446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:49:08.335446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:49:08.335446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:08.336574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:08.337879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:08.337879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:08.337879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:49:08.337879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:49:08.337879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:49:08.337879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:49:08.337879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:49:08.337879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:49:08.337879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:08.337879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:08.337879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 608/1226] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:08.342399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32588b-6df7-4a0b-af21-94a5e8292549 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:08.390226 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:08.442790 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32588b-6df7-4a0b-af21-94a5e8292549 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:08.484532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcc057-4c19-43a7-ab12-d0065c6062b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:08.485196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcc057-4c19-43a7-ab12-d0065c6062b8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:08.485479 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcc057-4c19-43a7-ab12-d0065c6062b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:08.485809 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcc057-4c19-43a7-ab12-d0065c6062b8 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:08.486730 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcc057-4c19-43a7-ab12-d0065c6062b8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:08.487524 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcc057-4c19-43a7-ab12-d0065c6062b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:08.488989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcc057-4c19-43a7-ab12-d0065c6062b8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:08.505869 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 619/1227] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Jun 2 15:49:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:08.511579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32142cce-859e-41d0-88b8-f6fbed1d7d19 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:08.608390 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32142cce-859e-41d0-88b8-f6fbed1d7d19 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:08.640966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd062a5e-9121-4bbf-afac-8aac27be7b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:08.641748 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062a5e-9121-4bbf-afac-8aac27be7b98 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:08.642033 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062a5e-9121-4bbf-afac-8aac27be7b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:08.642312 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd062a5e-9121-4bbf-afac-8aac27be7b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:08.652656 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd062a5e-9121-4bbf-afac-8aac27be7b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:08.654097 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd062a5e-9121-4bbf-afac-8aac27be7b98 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:08.671265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fd062a5e-9121-4bbf-afac-8aac27be7b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:08.671265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:08.671265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:08.671265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:08.671265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:08.671265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:08.671265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:08.671265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:08.671265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:08.671265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:08.671265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:08.671265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:08.671265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:08.671265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:08.671265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:08.672423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:08.673614 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:08.673614 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:08.673614 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:08.673614 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:08.673614 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 609/1228] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:08.678867 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcc057-4c19-43a7-ab12-d0065c6062b8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:08.776345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcc057-4c19-43a7-ab12-d0065c6062b8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:08.778789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:08.810645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae706c9-4df6-4a29-9242-0c691f946f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:08.811309 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae706c9-4df6-4a29-9242-0c691f946f23 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:08.811614 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae706c9-4df6-4a29-9242-0c691f946f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:08.811874 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae706c9-4df6-4a29-9242-0c691f946f23 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:08.812613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae706c9-4df6-4a29-9242-0c691f946f23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:08.812921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae706c9-4df6-4a29-9242-0c691f946f23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:08.814289 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae706c9-4df6-4a29-9242-0c691f946f23 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:08.825045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 620/1229] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:08.830930 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd062a5e-9121-4bbf-afac-8aac27be7b98 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:08.840366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:08.931201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd062a5e-9121-4bbf-afac-8aac27be7b98 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:08.965171 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4e79d-0142-4722-a2a4-7bd71339e8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:08.965960 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4e79d-0142-4722-a2a4-7bd71339e8af None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:08.966247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4e79d-0142-4722-a2a4-7bd71339e8af None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:08.966530 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4e79d-0142-4722-a2a4-7bd71339e8af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:08.973687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4e79d-0142-4722-a2a4-7bd71339e8af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:08.975134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4e79d-0142-4722-a2a4-7bd71339e8af None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:08.989239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-bac4e79d-0142-4722-a2a4-7bd71339e8af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:08.989239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:08.989239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:08.989239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:08.989239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:08.989239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:08.989239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:08.989239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:08.989239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:08.989239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:08.989239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:08.989239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:08.989239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:49:08.989239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:49:08.989239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:08.990315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:08.991256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:49:08.991256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:49:08.991256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:49:08.991256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:49:08.991256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:49:08.991256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:49:08.991256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:08.991256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:08.991256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 610/1230] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:49:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 15:49:08.996432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae706c9-4df6-4a29-9242-0c691f946f23 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:09.095533 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae706c9-4df6-4a29-9242-0c691f946f23 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:09.128313 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fae1f9-a8bd-427c-a6d8-29e9850a472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:09.128977 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fae1f9-a8bd-427c-a6d8-29e9850a472f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:09.129265 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fae1f9-a8bd-427c-a6d8-29e9850a472f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:09.129543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fae1f9-a8bd-427c-a6d8-29e9850a472f None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:09.130317 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fae1f9-a8bd-427c-a6d8-29e9850a472f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:09.130629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fae1f9-a8bd-427c-a6d8-29e9850a472f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:09.132074 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fae1f9-a8bd-427c-a6d8-29e9850a472f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:09.144786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 621/1231] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:49:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:09.150789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4e79d-0142-4722-a2a4-7bd71339e8af None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:09.215394 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:09.248803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4e79d-0142-4722-a2a4-7bd71339e8af None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:09.281886 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fb806-2b24-4d54-baeb-bf6fa21378fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:09.282768 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fb806-2b24-4d54-baeb-bf6fa21378fd None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:09.283055 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fb806-2b24-4d54-baeb-bf6fa21378fd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:09.283334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fb806-2b24-4d54-baeb-bf6fa21378fd None admin] PATH_INFO: `/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/8d60a2abffc04ba59b65d5fca5e318a6/roles/740fa9b1529f4a558de5b8987dba5ba3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:09.297787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fb806-2b24-4d54-baeb-bf6fa21378fd None admin] RBAC: Authorizing `identity:create_grant(project_id=e2775777647e4323a554bb3a5d045fc0, user_id=8d60a2abffc04ba59b65d5fca5e318a6, role_id=740fa9b1529f4a558de5b8987dba5ba3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:09.299260 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fb806-2b24-4d54-baeb-bf6fa21378fd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:09.438682 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 611/1232] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:49:09 2022] PUT /identity/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/8d60a2abffc04ba59b65d5fca5e318a6/roles/740fa9b1529f4a558de5b8987dba5ba3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:49:11.684462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bff63-28dd-4a7c-a058-dd9bef7c9e42 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:11.684977 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bff63-28dd-4a7c-a058-dd9bef7c9e42 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:11.684977 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bff63-28dd-4a7c-a058-dd9bef7c9e42 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:11.686305 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 622/1233] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:49:11.691785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42264c7c-fa51-4568-81e3-a35068b079c5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:11.692231 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42264c7c-fa51-4568-81e3-a35068b079c5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:11.692382 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42264c7c-fa51-4568-81e3-a35068b079c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:11.708592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-42264c7c-fa51-4568-81e3-a35068b079c5 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:49:11.709785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-42264c7c-fa51-4568-81e3-a35068b079c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:49:11.775546 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 612/1234] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:49:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:49:11.799870 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bff63-28dd-4a7c-a058-dd9bef7c9e42 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:11.825870 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:11.899252 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bff63-28dd-4a7c-a058-dd9bef7c9e42 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:11.933898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bfcf8-9706-4eb0-aed4-4a05f78a928b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:11.934722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bfcf8-9706-4eb0-aed4-4a05f78a928b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:11.934957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bfcf8-9706-4eb0-aed4-4a05f78a928b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:11.935229 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bfcf8-9706-4eb0-aed4-4a05f78a928b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:11.944871 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bfcf8-9706-4eb0-aed4-4a05f78a928b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:49:11.952570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-700bfcf8-9706-4eb0-aed4-4a05f78a928b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:49:11.952570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:11.952570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:11.952570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:11.952570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:11.952570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:11.952570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:11.952570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:11.952570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:11.952570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:11.952570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:11.952570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:11.952570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:49:11.952570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:49:11.952570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:49:11.952570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:49:11.953713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:49:11.953713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:49:11.953713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:49:11.953713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:49:11.953713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:11.953713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:11.953713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:11.953713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:11.953713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:11.953713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:11.953713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:11.953713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:11.953713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:11.953713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:11.953713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:11.953713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:11.954838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:11.954838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:11.954838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:11.954838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:11.954838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:49:11.954838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:49:11.954838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:49:11.954838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:49:11.954838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:49:11.954838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:49:11.954838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 15:49:11.954838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:49:11.954838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 623/1235] 10.222.0.50 () {56 vars in 1102 bytes} [Thu Jun 2 15:49:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:11.960865 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42264c7c-fa51-4568-81e3-a35068b079c5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:12.012762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:12.063753 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42264c7c-fa51-4568-81e3-a35068b079c5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:12.097113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6f5a4-0dae-4e57-9a3a-44a98028a29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:12.097812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6f5a4-0dae-4e57-9a3a-44a98028a29f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:12.098102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6f5a4-0dae-4e57-9a3a-44a98028a29f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:12.098380 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6f5a4-0dae-4e57-9a3a-44a98028a29f None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:12.099118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6f5a4-0dae-4e57-9a3a-44a98028a29f None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:12.099427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6f5a4-0dae-4e57-9a3a-44a98028a29f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:12.100976 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6f5a4-0dae-4e57-9a3a-44a98028a29f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:12.109131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 613/1236] 10.222.0.50 () {56 vars in 1103 bytes} [Thu Jun 2 15:49:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:12.114884 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bfcf8-9706-4eb0-aed4-4a05f78a928b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:12.196717 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:12.212813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bfcf8-9706-4eb0-aed4-4a05f78a928b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:12.246923 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed634e-26da-4cbc-b7d3-50d824a0eb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:12.247980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed634e-26da-4cbc-b7d3-50d824a0eb50 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:12.248290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed634e-26da-4cbc-b7d3-50d824a0eb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:12.248565 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed634e-26da-4cbc-b7d3-50d824a0eb50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:12.258965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed634e-26da-4cbc-b7d3-50d824a0eb50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:12.260443 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed634e-26da-4cbc-b7d3-50d824a0eb50 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:12.277983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6fed634e-26da-4cbc-b7d3-50d824a0eb50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:12.277983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:12.277983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:12.277983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:12.277983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:12.277983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:12.277983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:12.277983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:12.277983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:12.277983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:12.277983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:12.277983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:12.277983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:12.277983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:12.277983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:12.278885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:12.279882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:12.279882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:12.279882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:12.279882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:49:12.279882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 624/1237] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:12.284978 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6f5a4-0dae-4e57-9a3a-44a98028a29f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:12.383942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6f5a4-0dae-4e57-9a3a-44a98028a29f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:12.393694 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:12.417136 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce81db-2cf5-4670-a831-59ab4a466aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:12.417791 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce81db-2cf5-4670-a831-59ab4a466aaf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:12.418076 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce81db-2cf5-4670-a831-59ab4a466aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:12.418357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce81db-2cf5-4670-a831-59ab4a466aaf None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:12.419068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce81db-2cf5-4670-a831-59ab4a466aaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:12.419377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce81db-2cf5-4670-a831-59ab4a466aaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:12.420785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce81db-2cf5-4670-a831-59ab4a466aaf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:12.431539 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 614/1238] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:12.437402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed634e-26da-4cbc-b7d3-50d824a0eb50 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:12.535545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed634e-26da-4cbc-b7d3-50d824a0eb50 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:12.584745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec30d3-7c72-457c-890f-a41e484eb3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:12.585539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec30d3-7c72-457c-890f-a41e484eb3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:12.585832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec30d3-7c72-457c-890f-a41e484eb3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:12.586099 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec30d3-7c72-457c-890f-a41e484eb3b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:12.589215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:12.594431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec30d3-7c72-457c-890f-a41e484eb3b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:12.595921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec30d3-7c72-457c-890f-a41e484eb3b8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:12.610631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-00ec30d3-7c72-457c-890f-a41e484eb3b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:12.610631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:12.610631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:12.610631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:12.610631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:12.610631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:12.610631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:12.610631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:12.610631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:12.610631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:12.610631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:12.610631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:12.610631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:49:12.610631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:49:12.610631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:49:12.610631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:12.612137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:12.613287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:12.613287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:12.613287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:49:12.613287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:49:12.613287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:49:12.613287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:49:12.613287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:49:12.613287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:49:12.613287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:12.613287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:49:12.613287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 625/1239] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:12.618246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce81db-2cf5-4670-a831-59ab4a466aaf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:12.716135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce81db-2cf5-4670-a831-59ab4a466aaf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:12.748541 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681437c2-128f-4a4d-b6dc-da14e98b6aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:12.749195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681437c2-128f-4a4d-b6dc-da14e98b6aed None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:12.749483 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681437c2-128f-4a4d-b6dc-da14e98b6aed None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:12.749763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681437c2-128f-4a4d-b6dc-da14e98b6aed None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:12.750587 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681437c2-128f-4a4d-b6dc-da14e98b6aed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:12.750902 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681437c2-128f-4a4d-b6dc-da14e98b6aed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:12.752939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681437c2-128f-4a4d-b6dc-da14e98b6aed None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:12.769388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 615/1240] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Jun 2 15:49:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:12.775126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec30d3-7c72-457c-890f-a41e484eb3b8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:12.871051 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec30d3-7c72-457c-890f-a41e484eb3b8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:12.904035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343e639-5d82-40a3-998b-ffdaeae25a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:12.904672 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343e639-5d82-40a3-998b-ffdaeae25a63 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:12.904957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343e639-5d82-40a3-998b-ffdaeae25a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:12.905235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343e639-5d82-40a3-998b-ffdaeae25a63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:12.963458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:12.969714 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343e639-5d82-40a3-998b-ffdaeae25a63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:12.971795 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343e639-5d82-40a3-998b-ffdaeae25a63 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:13.067129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 626/1241] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:49:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:49:13.072930 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681437c2-128f-4a4d-b6dc-da14e98b6aed None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:13.100124 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:13.169894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681437c2-128f-4a4d-b6dc-da14e98b6aed None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:13.202215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188ec47-2f5a-4ab1-9471-d2523b710efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:13.202998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188ec47-2f5a-4ab1-9471-d2523b710efe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:13.203290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188ec47-2f5a-4ab1-9471-d2523b710efe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:13.203575 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188ec47-2f5a-4ab1-9471-d2523b710efe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:13.213352 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188ec47-2f5a-4ab1-9471-d2523b710efe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:13.214798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188ec47-2f5a-4ab1-9471-d2523b710efe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:13.233325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0188ec47-2f5a-4ab1-9471-d2523b710efe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:13.233325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:13.233325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:13.233325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:13.233325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:13.233325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:13.233325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:13.233325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:13.233325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:13.233325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:13.233325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:13.233325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:13.233325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:13.233325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:13.233325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:13.234423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:13.235582 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:13.235582 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:13.235582 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:13.235582 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:13.235582 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 616/1242] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:13.240766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343e639-5d82-40a3-998b-ffdaeae25a63 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:13.330104 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:13.335960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343e639-5d82-40a3-998b-ffdaeae25a63 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:13.369156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bf929-8fbf-4719-8316-846fe945acc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:13.369821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bf929-8fbf-4719-8316-846fe945acc9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:13.370108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bf929-8fbf-4719-8316-846fe945acc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:13.370387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bf929-8fbf-4719-8316-846fe945acc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:13.371101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bf929-8fbf-4719-8316-846fe945acc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:13.371412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bf929-8fbf-4719-8316-846fe945acc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:13.373069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bf929-8fbf-4719-8316-846fe945acc9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:13.384362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 627/1243] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:13.390206 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188ec47-2f5a-4ab1-9471-d2523b710efe None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:13.466728 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:13.487708 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188ec47-2f5a-4ab1-9471-d2523b710efe None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:13.520849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271dbc8d-3c18-44fe-b2ba-6d2b1e26de1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:13.521674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dbc8d-3c18-44fe-b2ba-6d2b1e26de1e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:13.522108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dbc8d-3c18-44fe-b2ba-6d2b1e26de1e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:13.522394 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dbc8d-3c18-44fe-b2ba-6d2b1e26de1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:13.529138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271dbc8d-3c18-44fe-b2ba-6d2b1e26de1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:13.538657 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271dbc8d-3c18-44fe-b2ba-6d2b1e26de1e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:13.544477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-271dbc8d-3c18-44fe-b2ba-6d2b1e26de1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:13.544477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:13.544477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:13.544477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:13.544477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:13.544477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:13.544477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:13.544477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:13.544477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:13.544477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:13.544477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:13.544477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:13.544477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:49:13.544477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:49:13.544477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:13.545517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:13.546797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:49:13.546797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:49:13.546797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:49:13.546797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:49:13.546797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:49:13.546797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:49:13.546797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:13.546797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:13.546797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 617/1244] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:49:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:13.552088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bf929-8fbf-4719-8316-846fe945acc9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:13.649019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bf929-8fbf-4719-8316-846fe945acc9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:13.681065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893e751-c8fd-430a-b625-12332ef6af58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:13.681720 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893e751-c8fd-430a-b625-12332ef6af58 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:13.682005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893e751-c8fd-430a-b625-12332ef6af58 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:13.682285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893e751-c8fd-430a-b625-12332ef6af58 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:13.683064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893e751-c8fd-430a-b625-12332ef6af58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:13.683378 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893e751-c8fd-430a-b625-12332ef6af58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:13.684837 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893e751-c8fd-430a-b625-12332ef6af58 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:13.696378 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 628/1245] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:49:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:13.702321 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271dbc8d-3c18-44fe-b2ba-6d2b1e26de1e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:13.803249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271dbc8d-3c18-44fe-b2ba-6d2b1e26de1e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:13.837447 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6e42a-ddc6-4ccd-b8d4-aff56173a061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:13.838099 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6e42a-ddc6-4ccd-b8d4-aff56173a061 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:13.838392 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6e42a-ddc6-4ccd-b8d4-aff56173a061 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:13.838678 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6e42a-ddc6-4ccd-b8d4-aff56173a061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:13.839515 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6e42a-ddc6-4ccd-b8d4-aff56173a061 None admin] RBAC: Adding query filter params (role.id=740fa9b1529f4a558de5b8987dba5ba3, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=8d60a2abffc04ba59b65d5fca5e318a6) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:13.839837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6e42a-ddc6-4ccd-b8d4-aff56173a061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:13.841297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6e42a-ddc6-4ccd-b8d4-aff56173a061 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:13.846997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 618/1246] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:49:13 2022] GET /identity/v3/role_assignments?user.id=8d60a2abffc04ba59b65d5fca5e318a6&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=740fa9b1529f4a558de5b8987dba5ba3 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:16.147208 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dbfb2-e6be-4772-8930-77a2360b7b17 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:16.147804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dbfb2-e6be-4772-8930-77a2360b7b17 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:16.147804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9dbfb2-e6be-4772-8930-77a2360b7b17 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:16.149164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 629/1247] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:49:16.154486 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c3458-86fa-45f0-9242-ade4831e0675 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:16.154876 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c3458-86fa-45f0-9242-ade4831e0675 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:16.155048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c3458-86fa-45f0-9242-ade4831e0675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:16.160018 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:16.171630 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9f4c3458-86fa-45f0-9242-ade4831e0675 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:49:16.172833 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9f4c3458-86fa-45f0-9242-ade4831e0675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:49:16.235586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 619/1248] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:49:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:49:16.259365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dbfb2-e6be-4772-8930-77a2360b7b17 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:16.277838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:16.357676 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9dbfb2-e6be-4772-8930-77a2360b7b17 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:16.391378 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbfdb9-5b90-421f-bba1-7de239f3ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:16.392206 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbfdb9-5b90-421f-bba1-7de239f3ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:16.392499 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbfdb9-5b90-421f-bba1-7de239f3ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:16.392784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbfdb9-5b90-421f-bba1-7de239f3ecf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:16.403563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbfdb9-5b90-421f-bba1-7de239f3ecf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:49:16.411377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-bccbfdb9-5b90-421f-bba1-7de239f3ecf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:49:16.411377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:16.411377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:16.411377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:16.411377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:16.411377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:16.411377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:16.411377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:16.411377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:16.411377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:16.411377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:16.411377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:16.411377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:49:16.411377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:49:16.411377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:49:16.411377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:49:16.412557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:49:16.412557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:49:16.412557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:49:16.412557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:49:16.412557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:16.412557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:16.412557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:16.412557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:16.412557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:16.412557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:16.412557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:16.412557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:16.412557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:16.412557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:16.412557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:16.412557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:16.413472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:16.413472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:16.413472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:16.413472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:16.413472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:49:16.413472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:49:16.413472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:49:16.413472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:49:16.413472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:49:16.413472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:49:16.413472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:49:16.413472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:49:16.413472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 630/1249] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:49:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:16.419112 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c3458-86fa-45f0-9242-ade4831e0675 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:16.516868 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c3458-86fa-45f0-9242-ade4831e0675 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:16.544617 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:16.549882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac866d-0a24-40ee-8e23-8e8458631e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:16.550536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac866d-0a24-40ee-8e23-8e8458631e1b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:16.550824 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac866d-0a24-40ee-8e23-8e8458631e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:16.551106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac866d-0a24-40ee-8e23-8e8458631e1b None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:16.551838 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac866d-0a24-40ee-8e23-8e8458631e1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:16.552179 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac866d-0a24-40ee-8e23-8e8458631e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:16.553545 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac866d-0a24-40ee-8e23-8e8458631e1b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:16.561501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 620/1250] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:49:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:16.567595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbfdb9-5b90-421f-bba1-7de239f3ecf9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:16.642449 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:16.663671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbfdb9-5b90-421f-bba1-7de239f3ecf9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:16.695704 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121975c-6d41-4583-a59f-302d0fc92293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:16.696505 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121975c-6d41-4583-a59f-302d0fc92293 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:16.696793 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121975c-6d41-4583-a59f-302d0fc92293 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:16.697070 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121975c-6d41-4583-a59f-302d0fc92293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:16.707251 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121975c-6d41-4583-a59f-302d0fc92293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:16.708777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121975c-6d41-4583-a59f-302d0fc92293 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:16.725956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8121975c-6d41-4583-a59f-302d0fc92293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:16.725956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:16.725956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:16.725956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:16.725956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:16.725956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:16.725956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:16.725956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:16.725956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:16.725956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:16.725956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:16.725956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:16.725956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:16.725956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:16.725956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:16.727088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:16.728249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:16.728249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:16.728249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:16.728249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:49:16.728249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 631/1251] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:16.733099 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac866d-0a24-40ee-8e23-8e8458631e1b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:16.834632 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac866d-0a24-40ee-8e23-8e8458631e1b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:16.866556 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e421ce-7d52-480c-8c8b-4a77504a2d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:16.867199 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e421ce-7d52-480c-8c8b-4a77504a2d4f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:16.867483 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e421ce-7d52-480c-8c8b-4a77504a2d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:16.867759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e421ce-7d52-480c-8c8b-4a77504a2d4f None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:16.868491 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e421ce-7d52-480c-8c8b-4a77504a2d4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:16.868799 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e421ce-7d52-480c-8c8b-4a77504a2d4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:16.870159 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e421ce-7d52-480c-8c8b-4a77504a2d4f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:16.882404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 621/1252] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:16.888017 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121975c-6d41-4583-a59f-302d0fc92293 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:16.984594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121975c-6d41-4583-a59f-302d0fc92293 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:17.010004 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:17.018087 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fdf9c-7cc4-4c5d-bfaf-f73b81e76e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:17.020214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fdf9c-7cc4-4c5d-bfaf-f73b81e76e51 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:17.020214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fdf9c-7cc4-4c5d-bfaf-f73b81e76e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:17.020214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fdf9c-7cc4-4c5d-bfaf-f73b81e76e51 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:17.026650 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fdf9c-7cc4-4c5d-bfaf-f73b81e76e51 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:17.028137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fdf9c-7cc4-4c5d-bfaf-f73b81e76e51 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:17.041963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-912fdf9c-7cc4-4c5d-bfaf-f73b81e76e51 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:17.041963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:17.041963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:17.041963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:17.041963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:17.041963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:17.041963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:17.041963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:17.041963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:17.041963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:17.041963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:17.041963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:17.041963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:49:17.041963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:49:17.041963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:49:17.041963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:17.043175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:17.044561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:17.044561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:17.044561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:49:17.044561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:49:17.044561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:49:17.044561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:49:17.044561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:49:17.044561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:49:17.044561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:17.044561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:49:17.044561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 632/1253] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:17.048973 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e421ce-7d52-480c-8c8b-4a77504a2d4f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:17.103831 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:17.146921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e421ce-7d52-480c-8c8b-4a77504a2d4f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:17.179513 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d181-b669-4a34-9d46-c9760d823c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:17.180207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d181-b669-4a34-9d46-c9760d823c03 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:17.180498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d181-b669-4a34-9d46-c9760d823c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:17.180777 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d181-b669-4a34-9d46-c9760d823c03 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:17.181607 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810d181-b669-4a34-9d46-c9760d823c03 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:17.181919 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810d181-b669-4a34-9d46-c9760d823c03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:17.183365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810d181-b669-4a34-9d46-c9760d823c03 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:17.200466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 622/1254] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Jun 2 15:49:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:17.206351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fdf9c-7cc4-4c5d-bfaf-f73b81e76e51 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:17.303660 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fdf9c-7cc4-4c5d-bfaf-f73b81e76e51 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:17.335883 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1d6f0-5c87-4e48-b1b4-961d3c24997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:17.336602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1d6f0-5c87-4e48-b1b4-961d3c24997d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:17.336887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1d6f0-5c87-4e48-b1b4-961d3c24997d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:17.337163 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1d6f0-5c87-4e48-b1b4-961d3c24997d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:17.390877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:17.402689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1d6f0-5c87-4e48-b1b4-961d3c24997d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:17.404164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1d6f0-5c87-4e48-b1b4-961d3c24997d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:17.496539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 633/1255] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:49:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:49:17.502773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d181-b669-4a34-9d46-c9760d823c03 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:17.597951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d181-b669-4a34-9d46-c9760d823c03 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:17.610427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:17.630871 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a76ec-6920-41e6-8efe-5ca7d0987b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:17.631648 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a76ec-6920-41e6-8efe-5ca7d0987b1b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:17.631934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a76ec-6920-41e6-8efe-5ca7d0987b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:17.632237 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a76ec-6920-41e6-8efe-5ca7d0987b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:17.641717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a76ec-6920-41e6-8efe-5ca7d0987b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:17.643170 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a76ec-6920-41e6-8efe-5ca7d0987b1b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:17.660538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-507a76ec-6920-41e6-8efe-5ca7d0987b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:17.660538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:17.660538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:17.660538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:17.660538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:17.660538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:17.660538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:17.660538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:17.660538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:17.660538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:17.660538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:17.660538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:17.660538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:17.660538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:17.660538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:17.661593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:17.662815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:17.662815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:17.662815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:17.662815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:17.662815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 623/1256] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:17.667433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1d6f0-5c87-4e48-b1b4-961d3c24997d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:17.752172 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:17.763442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1d6f0-5c87-4e48-b1b4-961d3c24997d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:17.796636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a0c16-757c-4083-8d96-9be14fdc65e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:17.797301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a0c16-757c-4083-8d96-9be14fdc65e0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:17.797591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a0c16-757c-4083-8d96-9be14fdc65e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:17.797875 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a0c16-757c-4083-8d96-9be14fdc65e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:17.799126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a0c16-757c-4083-8d96-9be14fdc65e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:17.799442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a0c16-757c-4083-8d96-9be14fdc65e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:17.800863 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a0c16-757c-4083-8d96-9be14fdc65e0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:17.813660 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 634/1257] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:17.819206 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a76ec-6920-41e6-8efe-5ca7d0987b1b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:17.916520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a76ec-6920-41e6-8efe-5ca7d0987b1b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:17.949107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36842d41-503d-4c75-bfdc-e6471e0a910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:17.949884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36842d41-503d-4c75-bfdc-e6471e0a910d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:17.950166 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36842d41-503d-4c75-bfdc-e6471e0a910d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:17.950445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36842d41-503d-4c75-bfdc-e6471e0a910d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:17.957612 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36842d41-503d-4c75-bfdc-e6471e0a910d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:17.959046 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36842d41-503d-4c75-bfdc-e6471e0a910d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:17.981860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-36842d41-503d-4c75-bfdc-e6471e0a910d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:17.981860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:17.981860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:17.981860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:17.981860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:17.981860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:17.981860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:17.981860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:17.981860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:17.981860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:17.981860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:17.981860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:17.981860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:49:17.981860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:49:17.981860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:17.982925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:17.984109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:49:17.984109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:49:17.984109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:49:17.984109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:49:17.984109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:49:17.984109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:49:17.984109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:17.984109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:17.984109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 624/1258] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:49:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:17.989187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a0c16-757c-4083-8d96-9be14fdc65e0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:18.087386 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a0c16-757c-4083-8d96-9be14fdc65e0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:18.120237 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c7bf0-fb6e-4553-a02e-fc9114986d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:18.120896 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c7bf0-fb6e-4553-a02e-fc9114986d53 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:18.121179 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c7bf0-fb6e-4553-a02e-fc9114986d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:18.121455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c7bf0-fb6e-4553-a02e-fc9114986d53 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:18.122228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c7bf0-fb6e-4553-a02e-fc9114986d53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:18.122838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c7bf0-fb6e-4553-a02e-fc9114986d53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:18.124281 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c7bf0-fb6e-4553-a02e-fc9114986d53 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:18.135961 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 635/1259] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:49:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:18.141953 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36842d41-503d-4c75-bfdc-e6471e0a910d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:18.168060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:18.238596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36842d41-503d-4c75-bfdc-e6471e0a910d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:18.276763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7540428-730b-4d09-92cf-0f14377ddbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:18.277412 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7540428-730b-4d09-92cf-0f14377ddbfe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:18.277706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7540428-730b-4d09-92cf-0f14377ddbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:18.277991 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7540428-730b-4d09-92cf-0f14377ddbfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:18.278817 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7540428-730b-4d09-92cf-0f14377ddbfe None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=8d60a2abffc04ba59b65d5fca5e318a6) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:18.279134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7540428-730b-4d09-92cf-0f14377ddbfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:18.280603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7540428-730b-4d09-92cf-0f14377ddbfe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:18.285902 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 625/1260] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:49:18 2022] GET /identity/v3/role_assignments?user.id=8d60a2abffc04ba59b65d5fca5e318a6&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:20.491239 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb23348-dec0-4456-acea-3ffcad37c62c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:20.491833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb23348-dec0-4456-acea-3ffcad37c62c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:20.491833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb23348-dec0-4456-acea-3ffcad37c62c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:20.493227 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 636/1261] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:49:20.498677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5450b2-be3c-4778-8533-50f7d46771c8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:20.499113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5450b2-be3c-4778-8533-50f7d46771c8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:20.499244 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5450b2-be3c-4778-8533-50f7d46771c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:20.516065 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6d5450b2-be3c-4778-8533-50f7d46771c8 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:49:20.517237 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6d5450b2-be3c-4778-8533-50f7d46771c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:49:20.581899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 626/1262] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:49:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:49:20.605181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb23348-dec0-4456-acea-3ffcad37c62c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:20.616546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:20.703300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb23348-dec0-4456-acea-3ffcad37c62c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:20.737203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16552dc-b577-4c50-89d6-c9d3bdefcc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:20.737986 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16552dc-b577-4c50-89d6-c9d3bdefcc16 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:20.738273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16552dc-b577-4c50-89d6-c9d3bdefcc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:20.738551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16552dc-b577-4c50-89d6-c9d3bdefcc16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:20.748645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16552dc-b577-4c50-89d6-c9d3bdefcc16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:49:20.756513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d16552dc-b577-4c50-89d6-c9d3bdefcc16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:49:20.756513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:20.756513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:20.756513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:20.756513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:20.756513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:20.756513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:20.756513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:20.756513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:20.756513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:20.756513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:20.756513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:20.756513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:49:20.756513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:49:20.756513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:49:20.756513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:49:20.761834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:49:20.761834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:49:20.761834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:49:20.761834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:49:20.761834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:20.761834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:20.761834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:20.761834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:20.761834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:20.761834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:20.761834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:20.761834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:20.761834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:20.761834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:20.761834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:20.761834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:20.763086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:20.763086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:20.763086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:20.763086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:20.763086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:49:20.763086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:49:20.763086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:49:20.763086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:49:20.763086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:49:20.763086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:49:20.763086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:49:20.763086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:49:20.763086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 637/1263] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:49:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:20.764103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5450b2-be3c-4778-8533-50f7d46771c8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:20.781737 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:20.860487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5450b2-be3c-4778-8533-50f7d46771c8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:20.895120 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad0dd5-72e7-4b5f-86b2-32595bafb176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:20.895788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad0dd5-72e7-4b5f-86b2-32595bafb176 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:20.896103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad0dd5-72e7-4b5f-86b2-32595bafb176 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:20.896384 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad0dd5-72e7-4b5f-86b2-32595bafb176 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:20.897159 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad0dd5-72e7-4b5f-86b2-32595bafb176 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:20.897462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad0dd5-72e7-4b5f-86b2-32595bafb176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:20.898846 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad0dd5-72e7-4b5f-86b2-32595bafb176 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:20.906941 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 627/1264] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:49:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:49:20.913423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16552dc-b577-4c50-89d6-c9d3bdefcc16 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:20.978043 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:21.009579 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16552dc-b577-4c50-89d6-c9d3bdefcc16 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:21.041691 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d756f4-18b2-4db2-9341-31a15d62569a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:21.042467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d756f4-18b2-4db2-9341-31a15d62569a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:21.042757 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d756f4-18b2-4db2-9341-31a15d62569a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:21.043037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d756f4-18b2-4db2-9341-31a15d62569a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:21.053134 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d756f4-18b2-4db2-9341-31a15d62569a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:21.054578 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d756f4-18b2-4db2-9341-31a15d62569a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:21.070921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c3d756f4-18b2-4db2-9341-31a15d62569a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:21.070921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:21.070921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:21.070921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:21.070921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:21.070921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:21.070921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:21.070921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:21.070921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:21.070921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:21.070921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:21.070921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:21.070921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:21.070921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:21.070921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:21.072041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:21.073353 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:21.073353 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:21.073353 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:21.073353 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:49:21.073353 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 638/1265] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:21.077918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad0dd5-72e7-4b5f-86b2-32595bafb176 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:21.157009 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:21.176132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad0dd5-72e7-4b5f-86b2-32595bafb176 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:21.216668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532090bb-5ae9-4c67-9655-f03921baef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:21.217368 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532090bb-5ae9-4c67-9655-f03921baef6b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:21.217635 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532090bb-5ae9-4c67-9655-f03921baef6b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:21.217922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532090bb-5ae9-4c67-9655-f03921baef6b None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:21.218645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532090bb-5ae9-4c67-9655-f03921baef6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:21.218960 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532090bb-5ae9-4c67-9655-f03921baef6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:21.220953 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532090bb-5ae9-4c67-9655-f03921baef6b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:21.232785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 628/1266] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:21.238622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d756f4-18b2-4db2-9341-31a15d62569a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:21.337240 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d756f4-18b2-4db2-9341-31a15d62569a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:21.355879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:21.369190 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75aa68-a25f-41ef-a274-d4deef41b593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:21.369993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75aa68-a25f-41ef-a274-d4deef41b593 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:21.370277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75aa68-a25f-41ef-a274-d4deef41b593 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:21.370551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75aa68-a25f-41ef-a274-d4deef41b593 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:21.379053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75aa68-a25f-41ef-a274-d4deef41b593 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:21.380543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75aa68-a25f-41ef-a274-d4deef41b593 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:21.395441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9a75aa68-a25f-41ef-a274-d4deef41b593 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:21.395441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:21.395441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:21.395441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:21.395441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:21.395441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:21.395441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:21.395441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:21.395441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:21.395441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:21.395441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:21.395441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:21.395441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:49:21.395441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:49:21.395441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:49:21.395441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:21.396557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:21.398063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:21.398063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:21.398063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:49:21.398063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:49:21.398063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:49:21.398063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:49:21.398063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:49:21.398063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:49:21.398063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:21.398063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:49:21.398063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 639/1267] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:21.402648 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532090bb-5ae9-4c67-9655-f03921baef6b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:21.498753 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532090bb-5ae9-4c67-9655-f03921baef6b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:21.532306 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ea93f-6b97-4c76-8d09-58f59c0494c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:21.532989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ea93f-6b97-4c76-8d09-58f59c0494c5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:21.533280 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ea93f-6b97-4c76-8d09-58f59c0494c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:21.533563 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ea93f-6b97-4c76-8d09-58f59c0494c5 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:21.534383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ea93f-6b97-4c76-8d09-58f59c0494c5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:21.534695 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ea93f-6b97-4c76-8d09-58f59c0494c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:21.536142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ea93f-6b97-4c76-8d09-58f59c0494c5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:21.544688 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:21.553334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 629/1268] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Jun 2 15:49:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:21.559127 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75aa68-a25f-41ef-a274-d4deef41b593 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:21.662929 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75aa68-a25f-41ef-a274-d4deef41b593 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:21.695618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095e42d-8456-4f1b-89b2-d9c6fc865952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:21.696428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095e42d-8456-4f1b-89b2-d9c6fc865952 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:21.696714 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095e42d-8456-4f1b-89b2-d9c6fc865952 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:21.696993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095e42d-8456-4f1b-89b2-d9c6fc865952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:21.707019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095e42d-8456-4f1b-89b2-d9c6fc865952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:21.708551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095e42d-8456-4f1b-89b2-d9c6fc865952 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:21.725571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d095e42d-8456-4f1b-89b2-d9c6fc865952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:21.725571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:21.725571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:21.725571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:21.725571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:21.725571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:21.725571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:21.725571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:21.725571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:21.725571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:21.725571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:21.725571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:21.725571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:21.725571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:21.725571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:21.726709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:21.727670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:21.727670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:21.727670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:21.727670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:49:21.727670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 640/1269] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:21.732488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ea93f-6b97-4c76-8d09-58f59c0494c5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:21.830374 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ea93f-6b97-4c76-8d09-58f59c0494c5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:21.863597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d9979-90fb-45f9-8a5f-a8318f56ffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:21.864441 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d9979-90fb-45f9-8a5f-a8318f56ffaf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:21.864632 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d9979-90fb-45f9-8a5f-a8318f56ffaf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:21.864908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d9979-90fb-45f9-8a5f-a8318f56ffaf None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:21.865653 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d9979-90fb-45f9-8a5f-a8318f56ffaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:21.865972 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d9979-90fb-45f9-8a5f-a8318f56ffaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:21.867348 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d9979-90fb-45f9-8a5f-a8318f56ffaf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:21.879397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 630/1270] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:21.884970 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095e42d-8456-4f1b-89b2-d9c6fc865952 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:21.915260 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:21.982006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095e42d-8456-4f1b-89b2-d9c6fc865952 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:22.016421 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f6c62-dff2-4755-b18f-4a9b1c035a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:22.017233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f6c62-dff2-4755-b18f-4a9b1c035a71 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:22.023889 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f6c62-dff2-4755-b18f-4a9b1c035a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:22.023889 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f6c62-dff2-4755-b18f-4a9b1c035a71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:22.024974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f6c62-dff2-4755-b18f-4a9b1c035a71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:22.026409 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f6c62-dff2-4755-b18f-4a9b1c035a71 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:22.040211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b75f6c62-dff2-4755-b18f-4a9b1c035a71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:22.040211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:22.040211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:22.040211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:22.040211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:22.040211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:22.040211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:22.040211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:22.040211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:22.040211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:22.040211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:22.040211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:22.040211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:49:22.040211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:49:22.040211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:22.041321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:22.042321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:49:22.042321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:49:22.042321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:49:22.042321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:49:22.042321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:49:22.042321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:49:22.042321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:22.042321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:49:22.042321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 641/1271] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:49:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:22.047249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d9979-90fb-45f9-8a5f-a8318f56ffaf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:22.105356 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:22.145239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d9979-90fb-45f9-8a5f-a8318f56ffaf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:22.177602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6753ff-e68e-4cd6-90ac-45eb1ad51ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:22.178252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6753ff-e68e-4cd6-90ac-45eb1ad51ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:22.178541 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6753ff-e68e-4cd6-90ac-45eb1ad51ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:22.178821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6753ff-e68e-4cd6-90ac-45eb1ad51ca6 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:22.179597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6753ff-e68e-4cd6-90ac-45eb1ad51ca6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:22.179912 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6753ff-e68e-4cd6-90ac-45eb1ad51ca6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:22.181380 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6753ff-e68e-4cd6-90ac-45eb1ad51ca6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:22.193770 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 631/1272] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:49:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:49:22.199693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f6c62-dff2-4755-b18f-4a9b1c035a71 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:22.289585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:22.297908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f6c62-dff2-4755-b18f-4a9b1c035a71 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:22.331790 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fbdca-c553-42c7-9ca3-b46fd354f68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:22.332715 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fbdca-c553-42c7-9ca3-b46fd354f68d None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:22.333004 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fbdca-c553-42c7-9ca3-b46fd354f68d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:22.333285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fbdca-c553-42c7-9ca3-b46fd354f68d None admin] PATH_INFO: `/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/8d60a2abffc04ba59b65d5fca5e318a6/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:22.335226 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fbdca-c553-42c7-9ca3-b46fd354f68d None admin] RBAC: Authorizing `identity:create_grant(project_id=e2775777647e4323a554bb3a5d045fc0, user_id=8d60a2abffc04ba59b65d5fca5e318a6, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:22.336706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fbdca-c553-42c7-9ca3-b46fd354f68d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:22.486846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 642/1273] 10.222.0.50 () {58 vars in 1439 bytes} [Thu Jun 2 15:49:22 2022] PUT /identity/v3/projects/e2775777647e4323a554bb3a5d045fc0/users/8d60a2abffc04ba59b65d5fca5e318a6/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 15:49:24.696861 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2af0-9c15-4ba3-bd5f-e66cd50c2324 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:24.697377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2af0-9c15-4ba3-bd5f-e66cd50c2324 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:24.697377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2af0-9c15-4ba3-bd5f-e66cd50c2324 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:24.698697 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 632/1274] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:49:24.703893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbd138-3e44-4944-8b52-2fd69d006d9c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:24.708099 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbd138-3e44-4944-8b52-2fd69d006d9c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:24.708099 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbd138-3e44-4944-8b52-2fd69d006d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:24.720856 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-57dbd138-3e44-4944-8b52-2fd69d006d9c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:49:24.722047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-57dbd138-3e44-4944-8b52-2fd69d006d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:49:24.787007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 643/1275] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:49:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:49:24.810800 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc2af0-9c15-4ba3-bd5f-e66cd50c2324 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:24.911556 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc2af0-9c15-4ba3-bd5f-e66cd50c2324 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:24.928867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:24.945533 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2ec42-b951-46b2-bd04-d39cfcf7d3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:24.946324 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2ec42-b951-46b2-bd04-d39cfcf7d3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:24.946613 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2ec42-b951-46b2-bd04-d39cfcf7d3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:24.946942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2ec42-b951-46b2-bd04-d39cfcf7d3f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:24.956844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2ec42-b951-46b2-bd04-d39cfcf7d3f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 15:49:24.964478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7db2ec42-b951-46b2-bd04-d39cfcf7d3f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:49:24.964478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:24.964478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:24.964478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:24.964478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:24.964478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:24.964478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:24.964478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:24.964478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:24.964478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:24.964478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:24.964478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:24.964478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 15:49:24.964478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 15:49:24.964478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 15:49:24.964478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 15:49:24.965467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 15:49:24.965467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 15:49:24.965467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 15:49:24.965467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 15:49:24.965467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:24.965467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:24.965467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:24.965467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:24.965467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:24.965467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:24.965467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:24.965467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:24.965467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:24.965467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:24.965467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:24.965467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:24.966428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:24.966428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:24.966428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:24.966428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:24.966428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 15:49:24.966428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 15:49:24.966428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 15:49:24.966428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 15:49:24.966428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 15:49:24.966428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 15:49:24.966428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 15:49:24.966428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:24.966428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 633/1276] 10.222.0.50 () {56 vars in 1096 bytes} [Thu Jun 2 15:49:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:24.972264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbd138-3e44-4944-8b52-2fd69d006d9c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:25.051409 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:25.068413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbd138-3e44-4944-8b52-2fd69d006d9c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:25.101218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc145dae-394a-41c6-ac11-91c7ca106d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:25.101883 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc145dae-394a-41c6-ac11-91c7ca106d91 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:25.102181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc145dae-394a-41c6-ac11-91c7ca106d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:25.102664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc145dae-394a-41c6-ac11-91c7ca106d91 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:25.103564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc145dae-394a-41c6-ac11-91c7ca106d91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:25.104249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc145dae-394a-41c6-ac11-91c7ca106d91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:25.105679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc145dae-394a-41c6-ac11-91c7ca106d91 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:25.114195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 644/1277] 10.222.0.50 () {56 vars in 1099 bytes} [Thu Jun 2 15:49:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:25.119896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2ec42-b951-46b2-bd04-d39cfcf7d3f5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:25.218551 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2ec42-b951-46b2-bd04-d39cfcf7d3f5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:25.251635 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262e2e9-7ee5-4778-86f1-cd15ba85737b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:25.252449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262e2e9-7ee5-4778-86f1-cd15ba85737b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:25.252739 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262e2e9-7ee5-4778-86f1-cd15ba85737b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:25.253019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262e2e9-7ee5-4778-86f1-cd15ba85737b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:25.264075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262e2e9-7ee5-4778-86f1-cd15ba85737b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:25.265529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262e2e9-7ee5-4778-86f1-cd15ba85737b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:25.285920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6262e2e9-7ee5-4778-86f1-cd15ba85737b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:25.285920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:25.285920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:25.285920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:25.285920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:25.285920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:25.285920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:25.285920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:25.285920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:25.285920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:25.285920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:25.285920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:25.285920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:25.285920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:25.285920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:25.291346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:25.292387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:25.292387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:25.292387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:25.292387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:25.292387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 634/1278] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:25.292888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc145dae-394a-41c6-ac11-91c7ca106d91 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:25.392214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc145dae-394a-41c6-ac11-91c7ca106d91 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:25.425008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90406e55-2fcf-4cc1-a187-62646b784061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:25.425702 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90406e55-2fcf-4cc1-a187-62646b784061 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:25.425992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90406e55-2fcf-4cc1-a187-62646b784061 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:25.426327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90406e55-2fcf-4cc1-a187-62646b784061 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:25.426994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90406e55-2fcf-4cc1-a187-62646b784061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:25.427307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90406e55-2fcf-4cc1-a187-62646b784061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:25.428723 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90406e55-2fcf-4cc1-a187-62646b784061 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:25.440855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 645/1279] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:25.446496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262e2e9-7ee5-4778-86f1-cd15ba85737b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:25.477232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:25.543605 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262e2e9-7ee5-4778-86f1-cd15ba85737b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:25.576892 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0df7ee-1df6-4a09-a631-f2adbeaa33e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:25.577729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0df7ee-1df6-4a09-a631-f2adbeaa33e3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:25.578010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0df7ee-1df6-4a09-a631-f2adbeaa33e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:25.578289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0df7ee-1df6-4a09-a631-f2adbeaa33e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:25.586307 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0df7ee-1df6-4a09-a631-f2adbeaa33e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:25.587792 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0df7ee-1df6-4a09-a631-f2adbeaa33e3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:25.602288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0a0df7ee-1df6-4a09-a631-f2adbeaa33e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:25.602288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:25.602288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:25.602288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:25.602288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:25.602288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:25.602288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:25.602288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:25.602288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:25.602288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:25.602288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:25.602288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:25.602288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 15:49:25.602288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 15:49:25.602288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 15:49:25.602288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:25.603505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:25.604909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:25.604909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:25.604909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 15:49:25.604909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 15:49:25.604909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 15:49:25.604909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 15:49:25.604909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 15:49:25.604909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 15:49:25.604909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 15:49:25.604909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:25.604909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 635/1280] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:25.612505 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90406e55-2fcf-4cc1-a187-62646b784061 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:25.616464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:25.711685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90406e55-2fcf-4cc1-a187-62646b784061 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:25.744439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf6201-eb31-407d-afab-fdf6c807e66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:25.745037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf6201-eb31-407d-afab-fdf6c807e66b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:25.745320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf6201-eb31-407d-afab-fdf6c807e66b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:25.745595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf6201-eb31-407d-afab-fdf6c807e66b None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:25.746411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf6201-eb31-407d-afab-fdf6c807e66b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:25.746720 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf6201-eb31-407d-afab-fdf6c807e66b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:25.748422 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcf6201-eb31-407d-afab-fdf6c807e66b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:25.764726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 646/1281] 10.222.0.50 () {56 vars in 1143 bytes} [Thu Jun 2 15:49:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:25.770452 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0df7ee-1df6-4a09-a631-f2adbeaa33e3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:25.862286 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:25.871554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0df7ee-1df6-4a09-a631-f2adbeaa33e3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:25.903101 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e603f6-53a6-47e4-a572-618a7c0f3517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:25.903736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e603f6-53a6-47e4-a572-618a7c0f3517 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:25.904040 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e603f6-53a6-47e4-a572-618a7c0f3517 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:25.904320 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e603f6-53a6-47e4-a572-618a7c0f3517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:25.979065 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e603f6-53a6-47e4-a572-618a7c0f3517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:25.980669 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e603f6-53a6-47e4-a572-618a7c0f3517 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:26.076963 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:26.086832 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 636/1282] 10.222.0.50 () {58 vars in 1282 bytes} [Thu Jun 2 15:49:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 15:49:26.092624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf6201-eb31-407d-afab-fdf6c807e66b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:26.153755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:26.190525 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf6201-eb31-407d-afab-fdf6c807e66b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:26.222999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e0e40-3d6c-4ac5-9580-8983d5b9d67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:26.223790 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e0e40-3d6c-4ac5-9580-8983d5b9d67c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:26.224106 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e0e40-3d6c-4ac5-9580-8983d5b9d67c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:26.224392 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e0e40-3d6c-4ac5-9580-8983d5b9d67c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:26.234568 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e0e40-3d6c-4ac5-9580-8983d5b9d67c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:26.236035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e0e40-3d6c-4ac5-9580-8983d5b9d67c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:26.252648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5c9e0e40-3d6c-4ac5-9580-8983d5b9d67c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:26.252648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:26.252648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:26.252648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:26.252648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:26.252648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:26.252648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:26.252648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:26.252648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:26.252648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:26.252648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:26.252648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:26.252648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 15:49:26.252648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 15:49:26.252648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:26.255873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:26.257061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 15:49:26.257061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 15:49:26.257061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 15:49:26.257061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:49:26.257061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 647/1283] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 15:49:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:26.259657 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e603f6-53a6-47e4-a572-618a7c0f3517 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:26.360498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e603f6-53a6-47e4-a572-618a7c0f3517 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:26.394903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7fb5c-5cf8-4d89-9d36-81dfa7b0b430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:26.395562 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7fb5c-5cf8-4d89-9d36-81dfa7b0b430 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:26.395847 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7fb5c-5cf8-4d89-9d36-81dfa7b0b430 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:26.396160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7fb5c-5cf8-4d89-9d36-81dfa7b0b430 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:26.396870 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7fb5c-5cf8-4d89-9d36-81dfa7b0b430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:26.397179 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7fb5c-5cf8-4d89-9d36-81dfa7b0b430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:26.398554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7fb5c-5cf8-4d89-9d36-81dfa7b0b430 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:26.410417 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 637/1284] 10.222.0.50 () {56 vars in 1109 bytes} [Thu Jun 2 15:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:26.416097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e0e40-3d6c-4ac5-9580-8983d5b9d67c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:26.513904 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e0e40-3d6c-4ac5-9580-8983d5b9d67c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:26.527317 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:26.548616 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a47af-5817-47fa-ba88-5874579641cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:26.549413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a47af-5817-47fa-ba88-5874579641cd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:26.549702 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a47af-5817-47fa-ba88-5874579641cd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:26.549989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a47af-5817-47fa-ba88-5874579641cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:26.556567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a47af-5817-47fa-ba88-5874579641cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:26.558003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a47af-5817-47fa-ba88-5874579641cd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:26.571980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e03a47af-5817-47fa-ba88-5874579641cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:26.571980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:26.571980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:26.571980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:26.571980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:26.571980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:26.571980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:26.571980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:26.571980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:26.571980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:26.571980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:26.571980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:26.571980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 15:49:26.571980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 15:49:26.571980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:26.573423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:26.574615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 15:49:26.574615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 15:49:26.574615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 15:49:26.574615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 15:49:26.574615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 15:49:26.574615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 15:49:26.574615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 15:49:26.574615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jun 02 15:49:26.574615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 648/1285] 10.222.0.50 () {56 vars in 1111 bytes} [Thu Jun 2 15:49:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:26.579808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7fb5c-5cf8-4d89-9d36-81dfa7b0b430 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:26.636186 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:26.681498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7fb5c-5cf8-4d89-9d36-81dfa7b0b430 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:26.713624 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a38dcc-413c-417b-a6f2-3a68cc6dc092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:26.714283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a38dcc-413c-417b-a6f2-3a68cc6dc092 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:26.714569 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a38dcc-413c-417b-a6f2-3a68cc6dc092 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:26.714845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a38dcc-413c-417b-a6f2-3a68cc6dc092 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:26.715626 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a38dcc-413c-417b-a6f2-3a68cc6dc092 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:26.715966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a38dcc-413c-417b-a6f2-3a68cc6dc092 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:26.717417 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a38dcc-413c-417b-a6f2-3a68cc6dc092 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:26.729995 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 638/1286] 10.222.0.50 () {56 vars in 1148 bytes} [Thu Jun 2 15:49:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 15:49:26.736694 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a47af-5817-47fa-ba88-5874579641cd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:26.833105 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a47af-5817-47fa-ba88-5874579641cd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:26.870214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb2d35-5011-497c-bed1-c0f47aa62c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:26.870864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb2d35-5011-497c-bed1-c0f47aa62c65 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:26.871151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb2d35-5011-497c-bed1-c0f47aa62c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:26.871430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb2d35-5011-497c-bed1-c0f47aa62c65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:26.872528 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb2d35-5011-497c-bed1-c0f47aa62c65 None admin] RBAC: Adding query filter params (role.id=415d634cdffe4a578b9c65fc960bbf59, scope.project.id=e2775777647e4323a554bb3a5d045fc0, user.id=8d60a2abffc04ba59b65d5fca5e318a6) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:26.872855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb2d35-5011-497c-bed1-c0f47aa62c65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:26.874279 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb2d35-5011-497c-bed1-c0f47aa62c65 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:26.880068 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 649/1287] 10.222.0.50 () {56 vars in 1374 bytes} [Thu Jun 2 15:49:26 2022] GET /identity/v3/role_assignments?user.id=8d60a2abffc04ba59b65d5fca5e318a6&scope.project.id=e2775777647e4323a554bb3a5d045fc0&role.id=415d634cdffe4a578b9c65fc960bbf59 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:29.148705 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f94e7f-5dae-4014-8d35-3604f89f8417 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:29.149258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f94e7f-5dae-4014-8d35-3604f89f8417 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:29.149258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f94e7f-5dae-4014-8d35-3604f89f8417 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:29.150609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 639/1288] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:49:29.155877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180894a-a897-4497-870c-23850d5174cd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:29.156326 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180894a-a897-4497-870c-23850d5174cd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:29.156457 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180894a-a897-4497-870c-23850d5174cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:29.173303 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f180894a-a897-4497-870c-23850d5174cd None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:49:29.174486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f180894a-a897-4497-870c-23850d5174cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:49:29.203508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:29.239822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 650/1289] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:49:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:49:29.262717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f94e7f-5dae-4014-8d35-3604f89f8417 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:29.362719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f94e7f-5dae-4014-8d35-3604f89f8417 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:29.373834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:29.399440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd30ae-53e2-4e7b-9c71-3cf98993f4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:29.400202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd30ae-53e2-4e7b-9c71-3cf98993f4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:29.400490 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd30ae-53e2-4e7b-9c71-3cf98993f4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:29.400769 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd30ae-53e2-4e7b-9c71-3cf98993f4e3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:29.401421 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd30ae-53e2-4e7b-9c71-3cf98993f4e3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:29.402789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd30ae-53e2-4e7b-9c71-3cf98993f4e3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d2cd30ae-53e2-4e7b-9c71-3cf98993f4e3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:29.414664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:29.417107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:29.417107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:29.417107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:29.417107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:29.417107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:29.417107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:29.417107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:49:29.417107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:49:29.417107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:49:29.417107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:49:29.417107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:29.417107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:29.417107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:29.417107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:29.417107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:29.417107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:29.418215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:29.418215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:29.418215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:29.418215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:29.418215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:29.418215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:29.418215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:29.418215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:29.418215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:29.418215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:29.418215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:49:29.418215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:49:29.418215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:49:29.418215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:29.418215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 640/1290] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Jun 2 15:49:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:29.422005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180894a-a897-4497-870c-23850d5174cd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:29.520472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180894a-a897-4497-870c-23850d5174cd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:29.559372 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53982bc0-7e28-4226-84d5-5af53175828a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:29.560064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53982bc0-7e28-4226-84d5-5af53175828a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:29.560354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53982bc0-7e28-4226-84d5-5af53175828a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:29.560630 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53982bc0-7e28-4226-84d5-5af53175828a None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:29.561336 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53982bc0-7e28-4226-84d5-5af53175828a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:29.561648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53982bc0-7e28-4226-84d5-5af53175828a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:29.563012 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53982bc0-7e28-4226-84d5-5af53175828a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:29.567894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 651/1291] 10.222.0.50 () {56 vars in 1116 bytes} [Thu Jun 2 15:49:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:29.575043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd30ae-53e2-4e7b-9c71-3cf98993f4e3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:29.675243 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd30ae-53e2-4e7b-9c71-3cf98993f4e3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:29.708261 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe89ba-1d75-42c2-a98b-03f2050b3f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:29.708919 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe89ba-1d75-42c2-a98b-03f2050b3f9f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:29.709210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe89ba-1d75-42c2-a98b-03f2050b3f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:29.709492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe89ba-1d75-42c2-a98b-03f2050b3f9f None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:29.710189 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe89ba-1d75-42c2-a98b-03f2050b3f9f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:29.710499 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe89ba-1d75-42c2-a98b-03f2050b3f9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:29.711884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe89ba-1d75-42c2-a98b-03f2050b3f9f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:29.716283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 641/1292] 10.222.0.50 () {56 vars in 1116 bytes} [Thu Jun 2 15:49:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:31.946172 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd092c3-fd0a-42e4-bf91-4ff85d847031 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:31.946702 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd092c3-fd0a-42e4-bf91-4ff85d847031 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:31.946797 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd092c3-fd0a-42e4-bf91-4ff85d847031 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:31.948200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 652/1293] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:49:31.953278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743bb3-106e-4145-8369-a7bd214fc4f0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:31.953670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743bb3-106e-4145-8369-a7bd214fc4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:31.953908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743bb3-106e-4145-8369-a7bd214fc4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:31.970915 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c3743bb3-106e-4145-8369-a7bd214fc4f0 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:49:31.972142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c3743bb3-106e-4145-8369-a7bd214fc4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:49:32.001187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:32.037178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 642/1294] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:49:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:49:32.059980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd092c3-fd0a-42e4-bf91-4ff85d847031 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:32.090203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:32.160005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd092c3-fd0a-42e4-bf91-4ff85d847031 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:32.192954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558fff2-3683-48a0-bde1-13d3d287441c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:32.193613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558fff2-3683-48a0-bde1-13d3d287441c None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:32.193898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558fff2-3683-48a0-bde1-13d3d287441c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:32.194177 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558fff2-3683-48a0-bde1-13d3d287441c None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:32.194914 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558fff2-3683-48a0-bde1-13d3d287441c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:32.200586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558fff2-3683-48a0-bde1-13d3d287441c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:32.372736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 653/1295] 10.222.0.50 () {60 vars in 1141 bytes} [Thu Jun 2 15:49:32 2022] POST /identity/v3/services => generated 246 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 15:49:34.623918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743074b-2fa9-4b66-8045-06311e4e6c59 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:34.624462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743074b-2fa9-4b66-8045-06311e4e6c59 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:34.624462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743074b-2fa9-4b66-8045-06311e4e6c59 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:34.626380 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 643/1296] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:49:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:49:34.631490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3c943-e47e-4c9e-b57c-7a9d4ea8a89c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:34.631860 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3c943-e47e-4c9e-b57c-7a9d4ea8a89c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:34.632096 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3c943-e47e-4c9e-b57c-7a9d4ea8a89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:34.648450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-61e3c943-e47e-4c9e-b57c-7a9d4ea8a89c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:49:34.651321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-61e3c943-e47e-4c9e-b57c-7a9d4ea8a89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:49:34.719664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 654/1297] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:49:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:49:34.742727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743074b-2fa9-4b66-8045-06311e4e6c59 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:34.840904 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743074b-2fa9-4b66-8045-06311e4e6c59 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:34.874560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7132e-bbc8-43db-9056-ae7abc74463f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:34.875264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7132e-bbc8-43db-9056-ae7abc74463f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:34.875574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7132e-bbc8-43db-9056-ae7abc74463f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:34.875853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7132e-bbc8-43db-9056-ae7abc74463f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:34.876527 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7132e-bbc8-43db-9056-ae7abc74463f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:34.877897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7132e-bbc8-43db-9056-ae7abc74463f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-17b7132e-bbc8-43db-9056-ae7abc74463f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:34.889477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:34.890771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:34.890771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:34.890771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:34.890771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:34.890771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:34.890771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:34.890771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:49:34.890771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:49:34.890771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:49:34.890771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:49:34.890771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:34.890771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:34.890771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:34.890771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:34.890771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:34.890771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:34.891975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:34.891975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:34.891975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:34.891975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:34.891975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:34.891975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:34.891975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:34.891975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:34.891975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:34.891975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:34.891975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:49:34.891975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:49:34.891975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:49:34.891975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:34.891975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 644/1298] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Jun 2 15:49:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:34.896814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3c943-e47e-4c9e-b57c-7a9d4ea8a89c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:34.914911 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:34.996490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3c943-e47e-4c9e-b57c-7a9d4ea8a89c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:35.028475 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc35c0-2b73-4509-9f47-59c8d154aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:35.029133 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc35c0-2b73-4509-9f47-59c8d154aca4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:35.029416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc35c0-2b73-4509-9f47-59c8d154aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:35.029692 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc35c0-2b73-4509-9f47-59c8d154aca4 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:35.030374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc35c0-2b73-4509-9f47-59c8d154aca4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:35.030685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc35c0-2b73-4509-9f47-59c8d154aca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:35.032611 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc35c0-2b73-4509-9f47-59c8d154aca4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:35.038338 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 655/1299] 10.222.0.50 () {56 vars in 1116 bytes} [Thu Jun 2 15:49:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:35.044280 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7132e-bbc8-43db-9056-ae7abc74463f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:35.075007 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:35.142444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7132e-bbc8-43db-9056-ae7abc74463f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:35.175308 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c555d-6381-4274-943d-1d696381eb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:35.175956 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c555d-6381-4274-943d-1d696381eb8d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:35.176266 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c555d-6381-4274-943d-1d696381eb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:35.176547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c555d-6381-4274-943d-1d696381eb8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:35.177323 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c555d-6381-4274-943d-1d696381eb8d None admin] RBAC: Adding query filter params (interface=public, service_id=ef11b87559d24c2bbfc104fb2c3fdce2, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:35.177641 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c555d-6381-4274-943d-1d696381eb8d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:35.179015 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c555d-6381-4274-943d-1d696381eb8d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:35.183955 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 645/1300] 10.222.0.50 () {56 vars in 1251 bytes} [Thu Jun 2 15:49:35 2022] GET /identity/v3/endpoints?service_id=ef11b87559d24c2bbfc104fb2c3fdce2&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:35.189635 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc35c0-2b73-4509-9f47-59c8d154aca4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:35.270463 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:35.288422 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc35c0-2b73-4509-9f47-59c8d154aca4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:35.320155 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04643806-1c9a-49f3-b837-ee490259fec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:35.320875 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04643806-1c9a-49f3-b837-ee490259fec4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:35.321161 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04643806-1c9a-49f3-b837-ee490259fec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:35.321442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04643806-1c9a-49f3-b837-ee490259fec4 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:35.322109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04643806-1c9a-49f3-b837-ee490259fec4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:35.323509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04643806-1c9a-49f3-b837-ee490259fec4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:35.330734 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 656/1301] 10.222.0.50 () {56 vars in 1087 bytes} [Thu Jun 2 15:49:35 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 15:49:37.559231 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1e639-aa65-40d7-ac9b-a75f9c737a25 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:37.559832 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1e639-aa65-40d7-ac9b-a75f9c737a25 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:37.559832 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1e639-aa65-40d7-ac9b-a75f9c737a25 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:37.561181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 646/1302] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:49:37.566844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56743e-5efc-404d-91d3-7afbbf7e8031 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:37.567289 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56743e-5efc-404d-91d3-7afbbf7e8031 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:37.567395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56743e-5efc-404d-91d3-7afbbf7e8031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:37.583686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3a56743e-5efc-404d-91d3-7afbbf7e8031 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:49:37.584929 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3a56743e-5efc-404d-91d3-7afbbf7e8031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:49:37.648457 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 657/1303] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:49:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 15:49:37.670933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1e639-aa65-40d7-ac9b-a75f9c737a25 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:37.764277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:37.770725 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1e639-aa65-40d7-ac9b-a75f9c737a25 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:37.804131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad2623-e95f-403c-88c0-949b8ebc07e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:37.804922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad2623-e95f-403c-88c0-949b8ebc07e4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:37.805208 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad2623-e95f-403c-88c0-949b8ebc07e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:37.805485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad2623-e95f-403c-88c0-949b8ebc07e4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:37.806130 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad2623-e95f-403c-88c0-949b8ebc07e4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:37.807487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad2623-e95f-403c-88c0-949b8ebc07e4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7dad2623-e95f-403c-88c0-949b8ebc07e4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 15:49:37.819160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 15:49:37.822128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 15:49:37.822128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 15:49:37.822128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 15:49:37.822128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 15:49:37.822128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 15:49:37.822128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 15:49:37.822128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 15:49:37.822128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 15:49:37.822128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 15:49:37.822128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 15:49:37.822128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 15:49:37.822128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 15:49:37.822128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 15:49:37.822128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 15:49:37.822128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 15:49:37.822128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 15:49:37.823247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 15:49:37.823247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jun 02 15:49:37.823247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 15:49:37.823247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jun 02 15:49:37.823247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 15:49:37.823247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 15:49:37.823247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 15:49:37.823247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jun 02 15:49:37.823247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 15:49:37.823247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jun 02 15:49:37.823247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 15:49:37.823247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 15:49:37.823247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 15:49:37.823247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jun 02 15:49:37.823247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 647/1304] 10.222.0.50 () {56 vars in 1117 bytes} [Thu Jun 2 15:49:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 15:49:37.826426 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56743e-5efc-404d-91d3-7afbbf7e8031 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:37.899162 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:37.920910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56743e-5efc-404d-91d3-7afbbf7e8031 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:37.954374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb134a-4c6e-4ff1-a0e3-68a08d0d916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:37.955032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb134a-4c6e-4ff1-a0e3-68a08d0d916e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:37.955317 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb134a-4c6e-4ff1-a0e3-68a08d0d916e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:37.955595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb134a-4c6e-4ff1-a0e3-68a08d0d916e None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:37.956319 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb134a-4c6e-4ff1-a0e3-68a08d0d916e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 15:49:37.956654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb134a-4c6e-4ff1-a0e3-68a08d0d916e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:37.958016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb134a-4c6e-4ff1-a0e3-68a08d0d916e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:37.963020 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 658/1305] 10.222.0.50 () {56 vars in 1116 bytes} [Thu Jun 2 15:49:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 15:49:37.968726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad2623-e95f-403c-88c0-949b8ebc07e4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:49:38.065661 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad2623-e95f-403c-88c0-949b8ebc07e4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:49:38.097565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adaec15-3727-491f-b468-720361b3cb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:49:38.098205 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adaec15-3727-491f-b468-720361b3cb15 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:49:38.098494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adaec15-3727-491f-b468-720361b3cb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:49:38.098820 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adaec15-3727-491f-b468-720361b3cb15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:49:38.099556 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adaec15-3727-491f-b468-720361b3cb15 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:49:38.100938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adaec15-3727-491f-b468-720361b3cb15 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:49:38.204201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 648/1306] 10.222.0.50 () {60 vars in 1144 bytes} [Thu Jun 2 15:49:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 15:49:47.960011 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=30 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:49:48.198830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:10.739631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9da00-e769-45c0-9b3f-df2b70f33fd4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:10.740138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9da00-e769-45c0-9b3f-df2b70f33fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:10.740138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9da00-e769-45c0-9b3f-df2b70f33fd4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:10.741768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 659/1307] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:10.747611 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185647b-f949-4991-8cfb-0768ed3ed50c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:10.748041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185647b-f949-4991-8cfb-0768ed3ed50c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:10.748324 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185647b-f949-4991-8cfb-0768ed3ed50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:10.837897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a185647b-f949-4991-8cfb-0768ed3ed50c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:10.839090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a185647b-f949-4991-8cfb-0768ed3ed50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:10.956187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 649/1308] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:57:11.006766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaca12e-afc1-4a4e-b2f1-b7d9066eaf32 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:11.007053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaca12e-afc1-4a4e-b2f1-b7d9066eaf32 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:11.007335 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaca12e-afc1-4a4e-b2f1-b7d9066eaf32 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:11.008755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 660/1309] 10.222.0.50 () {54 vars in 964 bytes} [Thu Jun 2 15:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:11.016010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef4192-0d42-47a6-bbc2-0d1e5e5093fa None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:11.021072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef4192-0d42-47a6-bbc2-0d1e5e5093fa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:11.021072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef4192-0d42-47a6-bbc2-0d1e5e5093fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:11.103600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b1ef4192-0d42-47a6-bbc2-0d1e5e5093fa None None] MFA Rules not processed for user `c3ec010ab4c5414a8782cecf202fbcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:11.104905 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b1ef4192-0d42-47a6-bbc2-0d1e5e5093fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:11.129267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:11.186493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 650/1310] 10.222.0.50 () {58 vars in 1061 bytes} [Thu Jun 2 15:57:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:57:11.195295 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaca12e-afc1-4a4e-b2f1-b7d9066eaf32 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:57:11.197065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-beaca12e-afc1-4a4e-b2f1-b7d9066eaf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:11.309537 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaca12e-afc1-4a4e-b2f1-b7d9066eaf32 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:57:11.390683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f0555-d4e2-4129-a056-7291297a511f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:57:11.391430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f0555-d4e2-4129-a056-7291297a511f service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:11.391821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f0555-d4e2-4129-a056-7291297a511f service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:11.392232 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f0555-d4e2-4129-a056-7291297a511f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:11.394155 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f89f0555-d4e2-4129-a056-7291297a511f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:11.450936 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:11.508472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f0555-d4e2-4129-a056-7291297a511f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:57:11.510166 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f0555-d4e2-4129-a056-7291297a511f service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:57:11.532389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 661/1311] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:57:14.061632 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924839a-e5e4-4c80-b2d4-0f383a264dd0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:14.061632 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924839a-e5e4-4c80-b2d4-0f383a264dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:14.062118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924839a-e5e4-4c80-b2d4-0f383a264dd0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:14.063078 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 651/1312] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:14.068726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d025f0-aadc-4a04-bf6a-bd4444ff104d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:14.069516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d025f0-aadc-4a04-bf6a-bd4444ff104d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:14.069803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d025f0-aadc-4a04-bf6a-bd4444ff104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:14.161616 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e8d025f0-aadc-4a04-bf6a-bd4444ff104d None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:14.161616 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e8d025f0-aadc-4a04-bf6a-bd4444ff104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:14.280041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 662/1313] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 15:57:14.318702 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924839a-e5e4-4c80-b2d4-0f383a264dd0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:57:14.320568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0924839a-e5e4-4c80-b2d4-0f383a264dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:14.432019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924839a-e5e4-4c80-b2d4-0f383a264dd0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:57:14.506591 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:14.509079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90286f4c-77bd-4a80-a358-7384cbfca1cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:57:14.509732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90286f4c-77bd-4a80-a358-7384cbfca1cf service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:14.510021 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90286f4c-77bd-4a80-a358-7384cbfca1cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:14.510305 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90286f4c-77bd-4a80-a358-7384cbfca1cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:14.512587 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-90286f4c-77bd-4a80-a358-7384cbfca1cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:14.628584 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90286f4c-77bd-4a80-a358-7384cbfca1cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:57:14.630040 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90286f4c-77bd-4a80-a358-7384cbfca1cf service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:57:14.649133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 652/1314] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:57:17.523463 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db856a-f3e2-4a40-9df6-755d67609648 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:17.524010 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db856a-f3e2-4a40-9df6-755d67609648 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:17.524130 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db856a-f3e2-4a40-9df6-755d67609648 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:17.525452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 663/1315] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:17.531140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c62c6-a6d0-4c60-be4d-511732ceaf6b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:17.531580 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c62c6-a6d0-4c60-be4d-511732ceaf6b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:17.532039 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c62c6-a6d0-4c60-be4d-511732ceaf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:17.607290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a85c62c6-a6d0-4c60-be4d-511732ceaf6b None None] MFA Rules not processed for user `85d51d7f1b3d4b0886d5e89e243c87c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:17.608522 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a85c62c6-a6d0-4c60-be4d-511732ceaf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:17.658600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:17.701703 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 653/1316] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:57:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:57:17.741244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db856a-f3e2-4a40-9df6-755d67609648 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:57:17.742841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-17db856a-f3e2-4a40-9df6-755d67609648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:17.752830 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:17.844105 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db856a-f3e2-4a40-9df6-755d67609648 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:57:17.915695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7745aff-05f9-4710-ac3d-90981baae621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:57:17.916301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745aff-05f9-4710-ac3d-90981baae621 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:17.916591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745aff-05f9-4710-ac3d-90981baae621 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:17.916874 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7745aff-05f9-4710-ac3d-90981baae621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:17.918565 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b7745aff-05f9-4710-ac3d-90981baae621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:17.978726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:18.023667 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7745aff-05f9-4710-ac3d-90981baae621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:57:18.025158 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7745aff-05f9-4710-ac3d-90981baae621 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:57:18.043890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 664/1317] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:57:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:57:21.140085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155bc96-2ca9-4e05-86cb-1b837712da67 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:21.140617 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155bc96-2ca9-4e05-86cb-1b837712da67 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:21.140735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155bc96-2ca9-4e05-86cb-1b837712da67 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:21.142016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 654/1318] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:21.147195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524842-b59c-4099-a01b-983086ef6bba None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:21.147612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524842-b59c-4099-a01b-983086ef6bba None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:21.147755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524842-b59c-4099-a01b-983086ef6bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:21.209387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-25524842-b59c-4099-a01b-983086ef6bba None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:21.210576 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-25524842-b59c-4099-a01b-983086ef6bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:21.305563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 665/1319] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:57:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:57:21.357422 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1be35c-f1c9-441d-8adb-03baa90f6028 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:21.357718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1be35c-f1c9-441d-8adb-03baa90f6028 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:21.358005 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1be35c-f1c9-441d-8adb-03baa90f6028 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:21.359366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 655/1320] 10.222.0.50 () {54 vars in 964 bytes} [Thu Jun 2 15:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:21.365097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcb947-0df1-4651-9b04-401bb80aa389 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:21.365387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcb947-0df1-4651-9b04-401bb80aa389 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:21.365701 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcb947-0df1-4651-9b04-401bb80aa389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:21.385908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:21.438392 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5ddcb947-0df1-4651-9b04-401bb80aa389 None None] MFA Rules not processed for user `c3ec010ab4c5414a8782cecf202fbcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:21.439522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5ddcb947-0df1-4651-9b04-401bb80aa389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:21.512524 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 666/1321] 10.222.0.50 () {58 vars in 1061 bytes} [Thu Jun 2 15:57:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:57:21.521614 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1be35c-f1c9-441d-8adb-03baa90f6028 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:57:21.523178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ba1be35c-f1c9-441d-8adb-03baa90f6028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:21.627506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1be35c-f1c9-441d-8adb-03baa90f6028 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:57:21.700258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75761219-c8f8-4b71-b979-0ac40166ae4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:57:21.700817 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75761219-c8f8-4b71-b979-0ac40166ae4e service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:21.701104 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75761219-c8f8-4b71-b979-0ac40166ae4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:21.701383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75761219-c8f8-4b71-b979-0ac40166ae4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:21.703028 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-75761219-c8f8-4b71-b979-0ac40166ae4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:21.710297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:21.808805 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75761219-c8f8-4b71-b979-0ac40166ae4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:57:21.810237 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75761219-c8f8-4b71-b979-0ac40166ae4e service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:57:21.828218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 656/1322] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:57:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:57:25.394316 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e796abf-f665-49cc-b122-74bbcbb2aadb None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:25.394833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e796abf-f665-49cc-b122-74bbcbb2aadb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:25.394931 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e796abf-f665-49cc-b122-74bbcbb2aadb None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:25.396417 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 667/1323] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:25.401535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e29234-a5e8-4f1f-beab-de579e7ef83c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:25.401966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e29234-a5e8-4f1f-beab-de579e7ef83c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:25.402123 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e29234-a5e8-4f1f-beab-de579e7ef83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:25.467813 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-46e29234-a5e8-4f1f-beab-de579e7ef83c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:25.469093 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-46e29234-a5e8-4f1f-beab-de579e7ef83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:25.526264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:25.565560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 657/1324] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:57:25.600855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e796abf-f665-49cc-b122-74bbcbb2aadb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:57:25.602379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6e796abf-f665-49cc-b122-74bbcbb2aadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:25.706318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e796abf-f665-49cc-b122-74bbcbb2aadb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:57:25.718900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:25.780756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9fd26-b9df-4237-85d2-0cbf51dbaaca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:57:25.781407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9fd26-b9df-4237-85d2-0cbf51dbaaca service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:25.781690 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9fd26-b9df-4237-85d2-0cbf51dbaaca service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:25.781965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9fd26-b9df-4237-85d2-0cbf51dbaaca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:25.783591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-21b9fd26-b9df-4237-85d2-0cbf51dbaaca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:25.891638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9fd26-b9df-4237-85d2-0cbf51dbaaca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:57:25.893105 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9fd26-b9df-4237-85d2-0cbf51dbaaca service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:57:25.913359 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 668/1325] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:57:28.202391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b62ba9-66b6-4dfb-a956-7148a396111a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:28.203226 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b62ba9-66b6-4dfb-a956-7148a396111a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:28.203400 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b62ba9-66b6-4dfb-a956-7148a396111a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:28.205412 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 658/1326] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:57:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:28.211043 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5a3d4-1db0-4c0f-b8da-9afb4a41b437 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:28.211471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5a3d4-1db0-4c0f-b8da-9afb4a41b437 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:28.211819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5a3d4-1db0-4c0f-b8da-9afb4a41b437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:28.290682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:28.312626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b3b5a3d4-1db0-4c0f-b8da-9afb4a41b437 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:28.313855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b3b5a3d4-1db0-4c0f-b8da-9afb4a41b437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:28.418602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 669/1327] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:57:28.456680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b62ba9-66b6-4dfb-a956-7148a396111a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:57:28.457033 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-34b62ba9-66b6-4dfb-a956-7148a396111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:28.560175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b62ba9-66b6-4dfb-a956-7148a396111a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:57:28.633328 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe5878-20c1-44a5-b61b-ce673f5c7b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:57:28.633981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe5878-20c1-44a5-b61b-ce673f5c7b09 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:28.634271 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe5878-20c1-44a5-b61b-ce673f5c7b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:28.634554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe5878-20c1-44a5-b61b-ce673f5c7b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:28.636745 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-affe5878-20c1-44a5-b61b-ce673f5c7b09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:28.654217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:28.746177 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe5878-20c1-44a5-b61b-ce673f5c7b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:57:28.747540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe5878-20c1-44a5-b61b-ce673f5c7b09 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:57:28.765457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 659/1328] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:57:31.044161 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06005f58-3ce5-4899-b6c4-6d39d35d27ae None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:31.044732 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06005f58-3ce5-4899-b6c4-6d39d35d27ae None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:31.044732 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06005f58-3ce5-4899-b6c4-6d39d35d27ae None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:31.046141 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 670/1329] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:31.051799 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec85a8b-187f-46c1-947b-0c1d7afaadc9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:31.052306 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec85a8b-187f-46c1-947b-0c1d7afaadc9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:31.052422 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec85a8b-187f-46c1-947b-0c1d7afaadc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:31.125639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1ec85a8b-187f-46c1-947b-0c1d7afaadc9 None None] MFA Rules not processed for user `85d51d7f1b3d4b0886d5e89e243c87c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:31.127127 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1ec85a8b-187f-46c1-947b-0c1d7afaadc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:31.191036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:31.351829 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 660/1330] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:57:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:57:31.389765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06005f58-3ce5-4899-b6c4-6d39d35d27ae None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:57:31.391318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-06005f58-3ce5-4899-b6c4-6d39d35d27ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:31.493081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06005f58-3ce5-4899-b6c4-6d39d35d27ae None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:57:31.513434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:31.567585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa3aa1-7923-47bb-9446-0d03148f44e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:57:31.568267 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa3aa1-7923-47bb-9446-0d03148f44e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:31.568552 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa3aa1-7923-47bb-9446-0d03148f44e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:31.568833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa3aa1-7923-47bb-9446-0d03148f44e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:31.570464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-53aa3aa1-7923-47bb-9446-0d03148f44e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:31.679790 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa3aa1-7923-47bb-9446-0d03148f44e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:57:31.681208 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa3aa1-7923-47bb-9446-0d03148f44e4 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:57:31.699043 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 671/1331] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:57:31 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:57:34.350000 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048898a-f128-4447-8183-732d0c95c871 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:34.354208 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048898a-f128-4447-8183-732d0c95c871 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:34.354208 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048898a-f128-4447-8183-732d0c95c871 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:34.354208 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 661/1332] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:34.358028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bb88b-da6c-4092-9624-84078867fbbe None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:34.358464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bb88b-da6c-4092-9624-84078867fbbe None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:34.358614 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bb88b-da6c-4092-9624-84078867fbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:34.451700 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:34.451700 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f99bb88b-da6c-4092-9624-84078867fbbe None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:34.452554 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f99bb88b-da6c-4092-9624-84078867fbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:34.553656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 672/1333] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:57:34.589669 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048898a-f128-4447-8183-732d0c95c871 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:57:34.591207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0048898a-f128-4447-8183-732d0c95c871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:34.694100 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048898a-f128-4447-8183-732d0c95c871 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:57:34.770142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d5ca9-7651-481b-b47d-b3dd0f49c5eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:57:34.770803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d5ca9-7651-481b-b47d-b3dd0f49c5eb service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:34.771089 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d5ca9-7651-481b-b47d-b3dd0f49c5eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:34.771364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d5ca9-7651-481b-b47d-b3dd0f49c5eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:34.773034 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9a9d5ca9-7651-481b-b47d-b3dd0f49c5eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:34.800706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:34.887463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d5ca9-7651-481b-b47d-b3dd0f49c5eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:57:34.888939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d5ca9-7651-481b-b47d-b3dd0f49c5eb service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:57:34.908283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 662/1334] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:57:37.216243 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11863bc6-6932-4ee7-9b23-9db0c121977c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:37.216752 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11863bc6-6932-4ee7-9b23-9db0c121977c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:37.216752 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11863bc6-6932-4ee7-9b23-9db0c121977c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:37.218083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 673/1335] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:37.223194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab2e5b-92ca-4168-8e49-7fabece63dcb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:37.223640 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab2e5b-92ca-4168-8e49-7fabece63dcb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:37.223756 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab2e5b-92ca-4168-8e49-7fabece63dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:37.286715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9eab2e5b-92ca-4168-8e49-7fabece63dcb None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:37.287909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9eab2e5b-92ca-4168-8e49-7fabece63dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:37.361429 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:37.385035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 663/1336] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:57:37.424885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11863bc6-6932-4ee7-9b23-9db0c121977c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:57:37.426430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-11863bc6-6932-4ee7-9b23-9db0c121977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:37.531147 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11863bc6-6932-4ee7-9b23-9db0c121977c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:57:37.559956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:37.604243 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5d23c-da6c-4488-95a7-f825a3eb9739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:57:37.605390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d23c-da6c-4488-95a7-f825a3eb9739 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:37.605671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d23c-da6c-4488-95a7-f825a3eb9739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:37.605944 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d23c-da6c-4488-95a7-f825a3eb9739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:37.607569 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4de5d23c-da6c-4488-95a7-f825a3eb9739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:37.711654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5d23c-da6c-4488-95a7-f825a3eb9739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:57:37.713105 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5d23c-da6c-4488-95a7-f825a3eb9739 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:57:37.731782 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 674/1337] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:57:40.672056 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c9729-336b-48c7-8ddd-c701cc662414 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:40.672581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c9729-336b-48c7-8ddd-c701cc662414 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:40.672581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c9729-336b-48c7-8ddd-c701cc662414 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:40.673893 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 664/1338] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:40.679090 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3a6ed-3e07-4b3f-b181-9a3c1b061e24 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:40.679509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3a6ed-3e07-4b3f-b181-9a3c1b061e24 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:40.679651 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3a6ed-3e07-4b3f-b181-9a3c1b061e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:40.742215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-84d3a6ed-3e07-4b3f-b181-9a3c1b061e24 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:40.743411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-84d3a6ed-3e07-4b3f-b181-9a3c1b061e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:40.751424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:40.838298 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 675/1339] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:57:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:57:40.874645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c9729-336b-48c7-8ddd-c701cc662414 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:57:40.877930 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-516c9729-336b-48c7-8ddd-c701cc662414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:40.997588 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c9729-336b-48c7-8ddd-c701cc662414 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:57:41.001238 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971860f-d529-4c88-aae3-83b5d7fd83df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:57:41.001891 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971860f-d529-4c88-aae3-83b5d7fd83df service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:41.002449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971860f-d529-4c88-aae3-83b5d7fd83df service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:41.002732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971860f-d529-4c88-aae3-83b5d7fd83df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:41.004591 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3971860f-d529-4c88-aae3-83b5d7fd83df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:41.106122 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971860f-d529-4c88-aae3-83b5d7fd83df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:57:41.107544 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971860f-d529-4c88-aae3-83b5d7fd83df service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:57:41.117844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:41.126526 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 665/1340] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:57:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:57:45.527525 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2df1f-537f-41c6-830f-3a9f0437e656 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:45.527979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2df1f-537f-41c6-830f-3a9f0437e656 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:45.528122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2df1f-537f-41c6-830f-3a9f0437e656 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:45.529498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 676/1341] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:45.534704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61901306-402b-4118-ba14-c3238e6ebb98 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:45.535173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61901306-402b-4118-ba14-c3238e6ebb98 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:45.535294 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61901306-402b-4118-ba14-c3238e6ebb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:45.582097 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-61901306-402b-4118-ba14-c3238e6ebb98 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:45.583278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-61901306-402b-4118-ba14-c3238e6ebb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:45.659964 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 666/1342] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:57:45.697744 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2df1f-537f-41c6-830f-3a9f0437e656 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:57:45.709877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2df1f-537f-41c6-830f-3a9f0437e656 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:57:45.713364 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e703b3-15ba-4784-b59a-6d3eccd0982b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:57:45.714569 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e703b3-15ba-4784-b59a-6d3eccd0982b service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:45.714855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e703b3-15ba-4784-b59a-6d3eccd0982b service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:45.715136 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e703b3-15ba-4784-b59a-6d3eccd0982b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:45.724218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e703b3-15ba-4784-b59a-6d3eccd0982b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:57:45.725645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e703b3-15ba-4784-b59a-6d3eccd0982b service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:57:45.734937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 677/1343] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:57:48.917655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebab23-1c45-4658-86fd-c2d677cf1bb5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:48.918149 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebab23-1c45-4658-86fd-c2d677cf1bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:48.918149 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebab23-1c45-4658-86fd-c2d677cf1bb5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:48.919530 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 667/1344] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:48.924821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff828d-7338-442a-b7b1-9577f66a190b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:48.925248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff828d-7338-442a-b7b1-9577f66a190b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:48.925411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff828d-7338-442a-b7b1-9577f66a190b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:48.953134 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4aff828d-7338-442a-b7b1-9577f66a190b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:48.954347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4aff828d-7338-442a-b7b1-9577f66a190b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:48.962185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 678/1345] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:57:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:57:48.999451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebab23-1c45-4658-86fd-c2d677cf1bb5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:57:49.010149 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebab23-1c45-4658-86fd-c2d677cf1bb5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:57:49.014124 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a70876-9336-4d41-ad08-e0ac6eab6712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:57:49.014750 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a70876-9336-4d41-ad08-e0ac6eab6712 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:49.015033 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a70876-9336-4d41-ad08-e0ac6eab6712 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:49.015307 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a70876-9336-4d41-ad08-e0ac6eab6712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:49.023946 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a70876-9336-4d41-ad08-e0ac6eab6712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:57:49.025424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a70876-9336-4d41-ad08-e0ac6eab6712 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:57:49.034785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 668/1346] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:57:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:57:53.749205 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70413873-f744-4312-99ca-4cf518d48f52 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:53.749744 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70413873-f744-4312-99ca-4cf518d48f52 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:53.749744 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70413873-f744-4312-99ca-4cf518d48f52 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:53.751052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 679/1347] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:53.756557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977e3a8-fb8d-4d17-99f0-c10d33f32559 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:53.756962 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977e3a8-fb8d-4d17-99f0-c10d33f32559 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:53.757144 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977e3a8-fb8d-4d17-99f0-c10d33f32559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:53.775368 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d977e3a8-fb8d-4d17-99f0-c10d33f32559 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:53.776593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d977e3a8-fb8d-4d17-99f0-c10d33f32559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:53.784269 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 669/1348] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:57:53.821529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70413873-f744-4312-99ca-4cf518d48f52 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:57:53.832589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70413873-f744-4312-99ca-4cf518d48f52 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:57:53.836001 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e66ef-a940-45a5-9fc9-3fe2daaec0c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:57:53.836638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e66ef-a940-45a5-9fc9-3fe2daaec0c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:53.836920 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e66ef-a940-45a5-9fc9-3fe2daaec0c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:53.837198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e66ef-a940-45a5-9fc9-3fe2daaec0c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:53.846564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e66ef-a940-45a5-9fc9-3fe2daaec0c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:57:53.848043 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e66ef-a940-45a5-9fc9-3fe2daaec0c0 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:57:53.857523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 680/1349] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:57:59.355131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30397e-4c81-490d-88eb-735664394e43 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:59.355931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30397e-4c81-490d-88eb-735664394e43 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:59.356389 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30397e-4c81-490d-88eb-735664394e43 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:59.358183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 670/1350] 10.222.0.50 () {54 vars in 921 bytes} [Thu Jun 2 15:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:57:59.363196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1df2d1-1e9f-4cfb-9593-d54e2678f793 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:57:59.363617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1df2d1-1e9f-4cfb-9593-d54e2678f793 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:57:59.363747 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1df2d1-1e9f-4cfb-9593-d54e2678f793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:57:59.475613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4e1df2d1-1e9f-4cfb-9593-d54e2678f793 None None] MFA Rules not processed for user `8d60a2abffc04ba59b65d5fca5e318a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:57:59.481640 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4e1df2d1-1e9f-4cfb-9593-d54e2678f793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:57:59.572509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:57:59.602144 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 681/1351] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Jun 2 15:57:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:03.770181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=56 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:03.877336 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4620ba-1390-4001-8c35-4fbb98e8ce4e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:03.877987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4620ba-1390-4001-8c35-4fbb98e8ce4e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:03.878210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4620ba-1390-4001-8c35-4fbb98e8ce4e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:03.879690 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 671/1352] 10.222.0.50 () {54 vars in 921 bytes} [Thu Jun 2 15:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:03.884832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afb704-25fd-4e8c-afbd-350f13abedc1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:03.886241 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afb704-25fd-4e8c-afbd-350f13abedc1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:03.886745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afb704-25fd-4e8c-afbd-350f13abedc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:03.907278 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a2afb704-25fd-4e8c-afbd-350f13abedc1 None None] MFA Rules not processed for user `8d60a2abffc04ba59b65d5fca5e318a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:03.908513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a2afb704-25fd-4e8c-afbd-350f13abedc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:03.917487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 682/1353] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Jun 2 15:58:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:05.421670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151440c-d68a-4369-b0ae-54a14e3c9be7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:05.422219 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151440c-d68a-4369-b0ae-54a14e3c9be7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:05.422219 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151440c-d68a-4369-b0ae-54a14e3c9be7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:05.423689 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 672/1354] 10.222.0.50 () {54 vars in 921 bytes} [Thu Jun 2 15:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:05.429404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52859a9a-8d79-4d21-a2c5-4be39fb685c9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:05.429972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52859a9a-8d79-4d21-a2c5-4be39fb685c9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:05.429972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52859a9a-8d79-4d21-a2c5-4be39fb685c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:05.449055 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-52859a9a-8d79-4d21-a2c5-4be39fb685c9 None None] MFA Rules not processed for user `8d60a2abffc04ba59b65d5fca5e318a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:05.450361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-52859a9a-8d79-4d21-a2c5-4be39fb685c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:05.458991 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 683/1355] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Jun 2 15:58:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:09.313351 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d6791-7f8e-4791-b010-795455a2252d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:09.313873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d6791-7f8e-4791-b010-795455a2252d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:09.313958 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d6791-7f8e-4791-b010-795455a2252d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:09.315240 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 673/1356] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:09.320661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe167a-6165-4c54-a225-b8ac6b90d791 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:09.321081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe167a-6165-4c54-a225-b8ac6b90d791 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:09.321304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe167a-6165-4c54-a225-b8ac6b90d791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:09.340556 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f5fe167a-6165-4c54-a225-b8ac6b90d791 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:09.341749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f5fe167a-6165-4c54-a225-b8ac6b90d791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:09.350140 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 684/1357] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:09.404403 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d02d8-ab0c-4862-956d-1273e0e350e9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:09.404931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d02d8-ab0c-4862-956d-1273e0e350e9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:09.405475 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d02d8-ab0c-4862-956d-1273e0e350e9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:09.407503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 674/1358] 10.222.0.50 () {54 vars in 961 bytes} [Thu Jun 2 15:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:09.414934 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf34165-c5b7-43fd-9bc0-8564d0edb6d2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:09.415237 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf34165-c5b7-43fd-9bc0-8564d0edb6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:09.420822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf34165-c5b7-43fd-9bc0-8564d0edb6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:09.466335 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1bf34165-c5b7-43fd-9bc0-8564d0edb6d2 None None] MFA Rules not processed for user `2e53683ae2b34947a1550de269b74d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:09.467541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1bf34165-c5b7-43fd-9bc0-8564d0edb6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:09.559852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 685/1359] 10.222.0.50 () {58 vars in 1058 bytes} [Thu Jun 2 15:58:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:09.568671 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d02d8-ab0c-4862-956d-1273e0e350e9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:09.591593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d02d8-ab0c-4862-956d-1273e0e350e9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:09.598613 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dc3e8-7e80-4324-b49c-f52dc839cdfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:09.602305 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dc3e8-7e80-4324-b49c-f52dc839cdfa service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:09.602721 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dc3e8-7e80-4324-b49c-f52dc839cdfa service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:09.603020 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dc3e8-7e80-4324-b49c-f52dc839cdfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:09.612604 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dc3e8-7e80-4324-b49c-f52dc839cdfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:09.615449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dc3e8-7e80-4324-b49c-f52dc839cdfa service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:09.633151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 675/1360] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 15:58:12.138350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a793c3-8362-45c9-97d0-0119b5289643 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:12.138865 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a793c3-8362-45c9-97d0-0119b5289643 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:12.138975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a793c3-8362-45c9-97d0-0119b5289643 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:12.140622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 686/1361] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:12.145878 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d30ea1-c62e-4d01-bba5-d9ba04826a88 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:12.146283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d30ea1-c62e-4d01-bba5-d9ba04826a88 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:12.146446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d30ea1-c62e-4d01-bba5-d9ba04826a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:12.165065 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b3d30ea1-c62e-4d01-bba5-d9ba04826a88 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:12.166236 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b3d30ea1-c62e-4d01-bba5-d9ba04826a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:12.174348 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 676/1362] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:12.219139 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a793c3-8362-45c9-97d0-0119b5289643 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:12.236117 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a793c3-8362-45c9-97d0-0119b5289643 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:12.241817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be2873-8269-4bd7-bc7d-5e9d59d109b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:12.242537 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be2873-8269-4bd7-bc7d-5e9d59d109b5 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:12.242892 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be2873-8269-4bd7-bc7d-5e9d59d109b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:12.243262 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be2873-8269-4bd7-bc7d-5e9d59d109b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:12.252748 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be2873-8269-4bd7-bc7d-5e9d59d109b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:12.254582 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be2873-8269-4bd7-bc7d-5e9d59d109b5 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:12.265864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 687/1363] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:14.987143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a347c-ad89-4139-a098-e4afe10bc080 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:14.987634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a347c-ad89-4139-a098-e4afe10bc080 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:14.987634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a347c-ad89-4139-a098-e4afe10bc080 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:14.989053 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 677/1364] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:14.994434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9799f-16f5-48f8-ab21-e1afd835f55c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:14.994943 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9799f-16f5-48f8-ab21-e1afd835f55c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:14.995096 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9799f-16f5-48f8-ab21-e1afd835f55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:15.014341 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b2b9799f-16f5-48f8-ab21-e1afd835f55c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:15.015537 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b2b9799f-16f5-48f8-ab21-e1afd835f55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:15.023619 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 688/1365] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:15.069207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153138a-d2a2-46aa-8baa-77f46fa4f449 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:15.069491 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153138a-d2a2-46aa-8baa-77f46fa4f449 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:15.069940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153138a-d2a2-46aa-8baa-77f46fa4f449 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:15.071322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 678/1366] 10.222.0.50 () {54 vars in 961 bytes} [Thu Jun 2 15:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:15.077328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d4b1a-2c10-4670-9118-0d51f6495333 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:15.080845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d4b1a-2c10-4670-9118-0d51f6495333 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:15.080845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d4b1a-2c10-4670-9118-0d51f6495333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:15.096519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ba2d4b1a-2c10-4670-9118-0d51f6495333 None None] MFA Rules not processed for user `2e53683ae2b34947a1550de269b74d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:15.097649 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ba2d4b1a-2c10-4670-9118-0d51f6495333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:15.107021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 689/1367] 10.222.0.50 () {58 vars in 1058 bytes} [Thu Jun 2 15:58:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:15.114839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153138a-d2a2-46aa-8baa-77f46fa4f449 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:15.129134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153138a-d2a2-46aa-8baa-77f46fa4f449 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:15.134723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ead74-973e-42d1-8cb8-96726cfa3537 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:15.135847 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ead74-973e-42d1-8cb8-96726cfa3537 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:15.136162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ead74-973e-42d1-8cb8-96726cfa3537 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:15.136439 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ead74-973e-42d1-8cb8-96726cfa3537 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:15.145302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ead74-973e-42d1-8cb8-96726cfa3537 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:15.146870 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ead74-973e-42d1-8cb8-96726cfa3537 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:15.156956 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 679/1368] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:17.628698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820184c-000b-4838-b4bc-1651bdeea72e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:17.629203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820184c-000b-4838-b4bc-1651bdeea72e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:17.629203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820184c-000b-4838-b4bc-1651bdeea72e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:17.630549 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 690/1369] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:17.636658 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3ac38-992b-49e0-9c63-ad8fd451f0f5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:17.637462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3ac38-992b-49e0-9c63-ad8fd451f0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:17.637743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3ac38-992b-49e0-9c63-ad8fd451f0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:17.645305 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ee934-c726-4ddf-8084-f4da6bda904f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:17.645808 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ee934-c726-4ddf-8084-f4da6bda904f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:17.646246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ee934-c726-4ddf-8084-f4da6bda904f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:17.647773 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 691/1370] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:58:17.653205 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ec5c6-ef0a-4353-a136-a734d5f12d58 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:17.653703 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ec5c6-ef0a-4353-a136-a734d5f12d58 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:17.654140 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ec5c6-ef0a-4353-a136-a734d5f12d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:17.656158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-07f3ac38-992b-49e0-9c63-ad8fd451f0f5 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:17.657372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-07f3ac38-992b-49e0-9c63-ad8fd451f0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:17.665525 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 680/1371] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:17.673111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-158ec5c6-ef0a-4353-a136-a734d5f12d58 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:17.674509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-158ec5c6-ef0a-4353-a136-a734d5f12d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:17.682850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 692/1372] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 15:58:17.729408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3ac38-992b-49e0-9c63-ad8fd451f0f5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:17.742121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3ac38-992b-49e0-9c63-ad8fd451f0f5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:17.748295 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e2a1a-41d6-4b74-9d11-cbe089fb5d2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:17.749067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e2a1a-41d6-4b74-9d11-cbe089fb5d2e service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:17.749454 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e2a1a-41d6-4b74-9d11-cbe089fb5d2e service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:17.749830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e2a1a-41d6-4b74-9d11-cbe089fb5d2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:17.758782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e2a1a-41d6-4b74-9d11-cbe089fb5d2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:17.761107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e2a1a-41d6-4b74-9d11-cbe089fb5d2e service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:17.771153 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 681/1373] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:17.995878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf493f-0e97-4a6d-b7ff-51298e7bfdf6 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:17.995878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf493f-0e97-4a6d-b7ff-51298e7bfdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:17.995878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf493f-0e97-4a6d-b7ff-51298e7bfdf6 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:17.995878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 693/1374] 10.222.0.50 () {54 vars in 963 bytes} [Thu Jun 2 15:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:18.003469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d237a-3b5c-49c1-91f4-db5811a279d2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:18.003869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d237a-3b5c-49c1-91f4-db5811a279d2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:18.004297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d237a-3b5c-49c1-91f4-db5811a279d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:18.065586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-368d237a-3b5c-49c1-91f4-db5811a279d2 None None] MFA Rules not processed for user `a4c3818af2794f598c21ee4aab4b3a70`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:18.066827 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-368d237a-3b5c-49c1-91f4-db5811a279d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:18.137226 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 682/1375] 10.222.0.50 () {58 vars in 1060 bytes} [Thu Jun 2 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:18.144819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf493f-0e97-4a6d-b7ff-51298e7bfdf6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:18.158881 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf493f-0e97-4a6d-b7ff-51298e7bfdf6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:18.162869 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e626d4f-719f-414b-9d3c-0e176891edbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:18.163618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e626d4f-719f-414b-9d3c-0e176891edbc service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:18.164200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e626d4f-719f-414b-9d3c-0e176891edbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:18.164578 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e626d4f-719f-414b-9d3c-0e176891edbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:18.175376 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e626d4f-719f-414b-9d3c-0e176891edbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:18.177057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e626d4f-719f-414b-9d3c-0e176891edbc service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:18.188971 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 694/1376] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:20.182266 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74503205-b852-4c43-86fa-90d8beb33685 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:20.182808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74503205-b852-4c43-86fa-90d8beb33685 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:20.182808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74503205-b852-4c43-86fa-90d8beb33685 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:20.184184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 683/1377] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:20.189984 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b205f-844e-4306-9f70-8968681d7b37 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:20.190499 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b205f-844e-4306-9f70-8968681d7b37 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:20.190900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b205f-844e-4306-9f70-8968681d7b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:20.210482 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2c6b205f-844e-4306-9f70-8968681d7b37 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:20.211784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2c6b205f-844e-4306-9f70-8968681d7b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:20.220511 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 695/1378] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:20.266068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74503205-b852-4c43-86fa-90d8beb33685 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:20.281282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74503205-b852-4c43-86fa-90d8beb33685 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:20.287013 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047008e-1977-4b36-9969-61f4cdb7be83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:20.287688 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047008e-1977-4b36-9969-61f4cdb7be83 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:20.287979 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047008e-1977-4b36-9969-61f4cdb7be83 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:20.288288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047008e-1977-4b36-9969-61f4cdb7be83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:20.297185 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047008e-1977-4b36-9969-61f4cdb7be83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:20.298787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047008e-1977-4b36-9969-61f4cdb7be83 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:20.308503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 684/1379] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:22.734661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd4b95-4359-4673-bb8c-aa3f5786aafe None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:22.735215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd4b95-4359-4673-bb8c-aa3f5786aafe None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:22.735215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd4b95-4359-4673-bb8c-aa3f5786aafe None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:22.736551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 696/1380] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:22.741957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5789fc-7121-40e3-8af2-a853743395c0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:22.742350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5789fc-7121-40e3-8af2-a853743395c0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:22.742529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5789fc-7121-40e3-8af2-a853743395c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:22.762614 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ed5789fc-7121-40e3-8af2-a853743395c0 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:22.763815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ed5789fc-7121-40e3-8af2-a853743395c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:22.772069 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 685/1381] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:22.815412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd4b95-4359-4673-bb8c-aa3f5786aafe None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:22.830434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd4b95-4359-4673-bb8c-aa3f5786aafe None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:22.835844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726a666-62bc-4d44-a8e3-8d23616a86fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:22.836509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726a666-62bc-4d44-a8e3-8d23616a86fb service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:22.836804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726a666-62bc-4d44-a8e3-8d23616a86fb service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:22.837086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726a666-62bc-4d44-a8e3-8d23616a86fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:22.845442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726a666-62bc-4d44-a8e3-8d23616a86fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:22.847063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726a666-62bc-4d44-a8e3-8d23616a86fb service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:22.857061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 697/1382] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:25.385924 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abb51e-342c-4fb0-b79a-8e6aa5385821 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:25.386387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abb51e-342c-4fb0-b79a-8e6aa5385821 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:25.386495 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abb51e-342c-4fb0-b79a-8e6aa5385821 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:25.388045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 686/1383] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:25.393276 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36743bbb-b839-4fec-bf5c-4d940905256b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:25.393695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36743bbb-b839-4fec-bf5c-4d940905256b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:25.393846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36743bbb-b839-4fec-bf5c-4d940905256b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:25.401647 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:25.412035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-36743bbb-b839-4fec-bf5c-4d940905256b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:25.413245 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-36743bbb-b839-4fec-bf5c-4d940905256b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:25.421610 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 698/1384] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:25.464045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abb51e-342c-4fb0-b79a-8e6aa5385821 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:25.478771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abb51e-342c-4fb0-b79a-8e6aa5385821 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:25.484413 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bcb0b-a819-4252-8970-197b0f6d0fa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:25.485059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bcb0b-a819-4252-8970-197b0f6d0fa0 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:25.485347 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bcb0b-a819-4252-8970-197b0f6d0fa0 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:25.485630 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bcb0b-a819-4252-8970-197b0f6d0fa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:25.495321 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bcb0b-a819-4252-8970-197b0f6d0fa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:25.496949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bcb0b-a819-4252-8970-197b0f6d0fa0 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:25.507106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 687/1385] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:28.105581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778c5c2-2a4b-4dcb-a5b7-6f0f6b3bd069 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:28.106122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778c5c2-2a4b-4dcb-a5b7-6f0f6b3bd069 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:28.106215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778c5c2-2a4b-4dcb-a5b7-6f0f6b3bd069 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:28.107638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 699/1386] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:28.113495 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd6963-9098-49b5-b8e5-7fd791213717 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:28.113943 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd6963-9098-49b5-b8e5-7fd791213717 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:28.114220 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd6963-9098-49b5-b8e5-7fd791213717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:28.133174 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6cbd6963-9098-49b5-b8e5-7fd791213717 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:28.134370 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6cbd6963-9098-49b5-b8e5-7fd791213717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:28.144333 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 688/1387] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:28.191108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778c5c2-2a4b-4dcb-a5b7-6f0f6b3bd069 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:28.214667 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778c5c2-2a4b-4dcb-a5b7-6f0f6b3bd069 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:28.224271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c81f2-001e-4509-9ab9-93bba751fb41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:28.225381 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c81f2-001e-4509-9ab9-93bba751fb41 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:28.225941 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c81f2-001e-4509-9ab9-93bba751fb41 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:28.226455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c81f2-001e-4509-9ab9-93bba751fb41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:28.243383 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c81f2-001e-4509-9ab9-93bba751fb41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:28.246841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c81f2-001e-4509-9ab9-93bba751fb41 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:28.266545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 700/1388] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:30.677311 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7eb80-401d-421c-8cfd-e680c2f70c7e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:30.677842 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7eb80-401d-421c-8cfd-e680c2f70c7e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:30.677962 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7eb80-401d-421c-8cfd-e680c2f70c7e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:30.679655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 689/1389] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:30.687082 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ea33d-3d7e-4f45-9d17-0cdd196b458e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:30.687512 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ea33d-3d7e-4f45-9d17-0cdd196b458e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:30.687837 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ea33d-3d7e-4f45-9d17-0cdd196b458e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:30.709567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-915ea33d-3d7e-4f45-9d17-0cdd196b458e None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:30.711405 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-915ea33d-3d7e-4f45-9d17-0cdd196b458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:30.721327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 701/1390] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:30.767115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7eb80-401d-421c-8cfd-e680c2f70c7e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:30.781465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7eb80-401d-421c-8cfd-e680c2f70c7e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:30.786888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade718b-3bec-498b-a704-2744435abf0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:30.787523 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade718b-3bec-498b-a704-2744435abf0f service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:30.787810 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade718b-3bec-498b-a704-2744435abf0f service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:30.788120 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade718b-3bec-498b-a704-2744435abf0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:30.796990 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade718b-3bec-498b-a704-2744435abf0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:30.798580 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade718b-3bec-498b-a704-2744435abf0f service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:30.808761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 690/1391] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:33.306112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07b190-d8cb-4dd1-a189-eccdf458f0d2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:33.307186 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07b190-d8cb-4dd1-a189-eccdf458f0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:33.307186 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07b190-d8cb-4dd1-a189-eccdf458f0d2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:33.308550 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 702/1392] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:33.314325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff017802-2da6-4e72-ac60-d27f67e41a37 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:33.314798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff017802-2da6-4e72-ac60-d27f67e41a37 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:33.314911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff017802-2da6-4e72-ac60-d27f67e41a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:33.333471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ff017802-2da6-4e72-ac60-d27f67e41a37 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:33.334806 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ff017802-2da6-4e72-ac60-d27f67e41a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:33.342431 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 691/1393] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:33.388246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07b190-d8cb-4dd1-a189-eccdf458f0d2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:33.402684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07b190-d8cb-4dd1-a189-eccdf458f0d2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:33.408333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54a900-9a5b-46f3-a0e9-2421e449e6e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:33.408991 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54a900-9a5b-46f3-a0e9-2421e449e6e4 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:33.409274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54a900-9a5b-46f3-a0e9-2421e449e6e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:33.409550 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54a900-9a5b-46f3-a0e9-2421e449e6e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:33.417886 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54a900-9a5b-46f3-a0e9-2421e449e6e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:33.419465 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54a900-9a5b-46f3-a0e9-2421e449e6e4 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:33.428981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 703/1394] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:34.489998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b66504-2ad8-4ab1-944a-f71fc197b6c3 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:34.490594 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b66504-2ad8-4ab1-944a-f71fc197b6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:34.490594 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b66504-2ad8-4ab1-944a-f71fc197b6c3 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:34.491932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 692/1395] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:34.497221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cd966-366b-42da-89bd-a91e5e5c75de None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:34.497644 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cd966-366b-42da-89bd-a91e5e5c75de None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:34.497761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5cd966-366b-42da-89bd-a91e5e5c75de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:34.515860 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4f5cd966-366b-42da-89bd-a91e5e5c75de None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:34.517066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4f5cd966-366b-42da-89bd-a91e5e5c75de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:34.524846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 704/1396] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:34.579798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa709e1-b418-486c-a197-139a3e66251f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:34.580127 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa709e1-b418-486c-a197-139a3e66251f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:34.580418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa709e1-b418-486c-a197-139a3e66251f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:34.581935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 693/1397] 10.222.0.50 () {54 vars in 962 bytes} [Thu Jun 2 15:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:34.586798 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd37cb-608a-498c-8f8c-8cd6e926d89e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:34.587097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd37cb-608a-498c-8f8c-8cd6e926d89e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:34.587384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd37cb-608a-498c-8f8c-8cd6e926d89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:34.635977 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-34dd37cb-608a-498c-8f8c-8cd6e926d89e None None] MFA Rules not processed for user `a6a5157588644972a6a4554b3a9f1d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:34.637130 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-34dd37cb-608a-498c-8f8c-8cd6e926d89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:34.697362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 705/1398] 10.222.0.50 () {58 vars in 1059 bytes} [Thu Jun 2 15:58:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:34.705245 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa709e1-b418-486c-a197-139a3e66251f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:34.710705 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:34.717334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa709e1-b418-486c-a197-139a3e66251f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:34.721226 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fedde-2a15-461b-a58d-9bfc57da9809 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5157588644972a6a4554b3a9f1d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:34.722775 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fedde-2a15-461b-a58d-9bfc57da9809 service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:34.722775 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fedde-2a15-461b-a58d-9bfc57da9809 service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:34.722775 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fedde-2a15-461b-a58d-9bfc57da9809 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:34.733057 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fedde-2a15-461b-a58d-9bfc57da9809 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:34.734549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fedde-2a15-461b-a58d-9bfc57da9809 service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:34.744108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 694/1399] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:35.458182 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12499c-4218-4e5a-95d7-dff191587455 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:35.458480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12499c-4218-4e5a-95d7-dff191587455 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:35.458767 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12499c-4218-4e5a-95d7-dff191587455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:35.507890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8e12499c-4218-4e5a-95d7-dff191587455 None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:35.509281 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8e12499c-4218-4e5a-95d7-dff191587455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:35.580984 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 706/1400] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Jun 2 15:58:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:35.620986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655366dc-b06d-4e5e-897e-be58d8a65bff None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:35.621496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655366dc-b06d-4e5e-897e-be58d8a65bff None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:35.621607 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655366dc-b06d-4e5e-897e-be58d8a65bff None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:35.623052 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 695/1401] 10.222.0.50 () {54 vars in 942 bytes} [Thu Jun 2 15:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:58:35.629756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11c711-0fad-4e7c-bcb7-8949a757fe2d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:35.630118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11c711-0fad-4e7c-bcb7-8949a757fe2d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:35.630499 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11c711-0fad-4e7c-bcb7-8949a757fe2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:35.643107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:35.678770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6f11c711-0fad-4e7c-bcb7-8949a757fe2d None None] MFA Rules not processed for user `02eade9a475b4002bd3990f08f8a1198`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:35.680683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6f11c711-0fad-4e7c-bcb7-8949a757fe2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:35.756597 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 707/1402] 10.222.0.50 () {58 vars in 1039 bytes} [Thu Jun 2 15:58:35 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 15:58:35.766772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655366dc-b06d-4e5e-897e-be58d8a65bff None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:35.779672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655366dc-b06d-4e5e-897e-be58d8a65bff None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:35.784493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1a66b-2366-4049-be8c-d9c414fb593a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:35.785124 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1a66b-2366-4049-be8c-d9c414fb593a service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:35.785407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1a66b-2366-4049-be8c-d9c414fb593a service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:35.785680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1a66b-2366-4049-be8c-d9c414fb593a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:35.793935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1a66b-2366-4049-be8c-d9c414fb593a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:35.795769 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1a66b-2366-4049-be8c-d9c414fb593a service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:35.803692 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 696/1403] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 15:58:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 15:58:35.872766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2599c8e-c2d7-4e42-b9aa-943bc2c62359 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:35.873058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2599c8e-c2d7-4e42-b9aa-943bc2c62359 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:35.873348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2599c8e-c2d7-4e42-b9aa-943bc2c62359 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:35.874758 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 708/1404] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:35.880523 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696cead-711f-4ba3-b75f-c66a66a72f83 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:35.880839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696cead-711f-4ba3-b75f-c66a66a72f83 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:35.881118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696cead-711f-4ba3-b75f-c66a66a72f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:35.898900 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9696cead-711f-4ba3-b75f-c66a66a72f83 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:35.900332 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9696cead-711f-4ba3-b75f-c66a66a72f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:35.910253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 697/1405] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:35.960655 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2599c8e-c2d7-4e42-b9aa-943bc2c62359 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:35.974862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2599c8e-c2d7-4e42-b9aa-943bc2c62359 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:35.980855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9a392-1251-41e4-b388-9f3325f1aab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:35.981484 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9a392-1251-41e4-b388-9f3325f1aab7 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:35.981771 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9a392-1251-41e4-b388-9f3325f1aab7 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:35.982076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9a392-1251-41e4-b388-9f3325f1aab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:35.990314 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9a392-1251-41e4-b388-9f3325f1aab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:35.992777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9a392-1251-41e4-b388-9f3325f1aab7 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:36.002188 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 709/1406] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:38.496785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d343cc1-8e81-4013-9f65-88630b9f027c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:38.497328 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d343cc1-8e81-4013-9f65-88630b9f027c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:38.497328 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d343cc1-8e81-4013-9f65-88630b9f027c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:38.498733 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 698/1407] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 15:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:58:38.504182 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508f951-b6d0-44e4-94c8-864d2cea0adc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:38.504581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508f951-b6d0-44e4-94c8-864d2cea0adc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:38.504759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508f951-b6d0-44e4-94c8-864d2cea0adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:38.530758 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a508f951-b6d0-44e4-94c8-864d2cea0adc None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:58:38.532086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a508f951-b6d0-44e4-94c8-864d2cea0adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:58:38.541372 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 710/1408] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 15:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:58:38.584364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d343cc1-8e81-4013-9f65-88630b9f027c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:58:38.599385 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d343cc1-8e81-4013-9f65-88630b9f027c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:58:38.606096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235ab2c-d158-4848-a18f-d44cfe14a0fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:58:38.606741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235ab2c-d158-4848-a18f-d44cfe14a0fb service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:58:38.607016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235ab2c-d158-4848-a18f-d44cfe14a0fb service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:58:38.607305 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235ab2c-d158-4848-a18f-d44cfe14a0fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:58:38.615761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235ab2c-d158-4848-a18f-d44cfe14a0fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:58:38.617368 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235ab2c-d158-4848-a18f-d44cfe14a0fb service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:58:38.628103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 699/1409] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:58:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:58:48.735123 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=50 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:58:48.735738 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=20 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:59:00.537251 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d567e5d-1674-43b0-a5e6-f36e62de4edb None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:00.537813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d567e5d-1674-43b0-a5e6-f36e62de4edb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:00.537813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d567e5d-1674-43b0-a5e6-f36e62de4edb None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:00.539180 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 711/1410] 10.222.0.50 () {54 vars in 918 bytes} [Thu Jun 2 15:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:00.544972 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e6859-a371-4c79-b159-67bd6d634b97 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:00.545415 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e6859-a371-4c79-b159-67bd6d634b97 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:00.545524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e6859-a371-4c79-b159-67bd6d634b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:00.563519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2a3e6859-a371-4c79-b159-67bd6d634b97 None None] MFA Rules not processed for user `8d60a2abffc04ba59b65d5fca5e318a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:00.564818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2a3e6859-a371-4c79-b159-67bd6d634b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:00.573140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 700/1411] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Jun 2 15:59:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:00.587021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a83ad6-60eb-42b7-a25d-bec22f659a71 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:00.587314 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a83ad6-60eb-42b7-a25d-bec22f659a71 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:00.587624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a83ad6-60eb-42b7-a25d-bec22f659a71 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:00.589019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 712/1412] 10.222.0.50 () {54 vars in 918 bytes} [Thu Jun 2 15:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:00.593547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ccf8b-483c-4015-af14-d34437318a7c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:00.593855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ccf8b-483c-4015-af14-d34437318a7c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:00.594139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ccf8b-483c-4015-af14-d34437318a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:00.611782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e84ccf8b-483c-4015-af14-d34437318a7c None None] MFA Rules not processed for user `2e53683ae2b34947a1550de269b74d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:00.612994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e84ccf8b-483c-4015-af14-d34437318a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:00.622587 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 701/1413] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Jun 2 15:59:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:03.321138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb79e8-3f40-4a0d-a85e-469163326daf None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:03.321727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb79e8-3f40-4a0d-a85e-469163326daf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:03.321727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb79e8-3f40-4a0d-a85e-469163326daf None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:03.323126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 15:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:03.328420 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c603ae5-cdfd-4f43-87d9-d1d88061da33 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:03.328843 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c603ae5-cdfd-4f43-87d9-d1d88061da33 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:03.328980 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c603ae5-cdfd-4f43-87d9-d1d88061da33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:03.346646 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9c603ae5-cdfd-4f43-87d9-d1d88061da33 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:03.347821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9c603ae5-cdfd-4f43-87d9-d1d88061da33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:03.356588 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 15:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:03.398553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb79e8-3f40-4a0d-a85e-469163326daf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:03.413004 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb79e8-3f40-4a0d-a85e-469163326daf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:03.418835 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a63d6-2bac-453c-add8-539c55ac14d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:03.419458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a63d6-2bac-453c-add8-539c55ac14d6 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:03.419743 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a63d6-2bac-453c-add8-539c55ac14d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:03.420048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a63d6-2bac-453c-add8-539c55ac14d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:03.428025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a63d6-2bac-453c-add8-539c55ac14d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:03.429598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a63d6-2bac-453c-add8-539c55ac14d6 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:03.439809 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 714/1416] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:04.410447 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96af4a-5f73-499c-8624-62fadc8e693e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:04.410903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96af4a-5f73-499c-8624-62fadc8e693e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:04.411000 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96af4a-5f73-499c-8624-62fadc8e693e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:04.412408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 15:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:04.417454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6e942-f040-43c3-a5af-c8cd83b70b33 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:04.417884 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6e942-f040-43c3-a5af-c8cd83b70b33 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:04.418018 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6e942-f040-43c3-a5af-c8cd83b70b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:04.435737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4ad6e942-f040-43c3-a5af-c8cd83b70b33 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:04.436970 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4ad6e942-f040-43c3-a5af-c8cd83b70b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:04.445030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 15:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:04.602091 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96af4a-5f73-499c-8624-62fadc8e693e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:04.616501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96af4a-5f73-499c-8624-62fadc8e693e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:04.622616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d50109-cbc9-4d13-b9eb-b283375ed092 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:04.623183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d50109-cbc9-4d13-b9eb-b283375ed092 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:04.623469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d50109-cbc9-4d13-b9eb-b283375ed092 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:04.623747 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d50109-cbc9-4d13-b9eb-b283375ed092 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:04.631903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d50109-cbc9-4d13-b9eb-b283375ed092 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:04.633499 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d50109-cbc9-4d13-b9eb-b283375ed092 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:04.642679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 704/1419] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:05.566440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcda27-6137-4c6d-a790-8b2aeb448117 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:05.566979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcda27-6137-4c6d-a790-8b2aeb448117 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:05.566979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcda27-6137-4c6d-a790-8b2aeb448117 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:05.568432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 15:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:05.573310 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a4058-a52e-431f-8049-b9817412f32f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:05.573751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a4058-a52e-431f-8049-b9817412f32f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:05.573872 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a4058-a52e-431f-8049-b9817412f32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:05.591964 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-259a4058-a52e-431f-8049-b9817412f32f None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:05.593190 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-259a4058-a52e-431f-8049-b9817412f32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:05.600908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 15:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:05.748778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcda27-6137-4c6d-a790-8b2aeb448117 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:05.763038 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcda27-6137-4c6d-a790-8b2aeb448117 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:05.768397 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9548010-d451-431a-81a1-af8380312bae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:05.769032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548010-d451-431a-81a1-af8380312bae service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:05.769320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548010-d451-431a-81a1-af8380312bae service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:05.769602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548010-d451-431a-81a1-af8380312bae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:05.778210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9548010-d451-431a-81a1-af8380312bae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:05.779793 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9548010-d451-431a-81a1-af8380312bae service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:05.789205 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 717/1422] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:06.683013 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f067b16-50ed-4fdc-b620-6ee17078d24a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:06.683541 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f067b16-50ed-4fdc-b620-6ee17078d24a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:06.683541 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f067b16-50ed-4fdc-b620-6ee17078d24a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:06.684868 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 15:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:06.689829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19fc8-d834-4e78-b928-a7afd5c4c501 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:06.690202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19fc8-d834-4e78-b928-a7afd5c4c501 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:06.690393 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c19fc8-d834-4e78-b928-a7afd5c4c501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:06.708622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-88c19fc8-d834-4e78-b928-a7afd5c4c501 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:06.709849 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-88c19fc8-d834-4e78-b928-a7afd5c4c501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:06.718199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:06.864968 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f067b16-50ed-4fdc-b620-6ee17078d24a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:06.879971 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f067b16-50ed-4fdc-b620-6ee17078d24a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:06.885296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd1821-4f3c-4d41-888c-dd703fe25ee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:06.885929 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd1821-4f3c-4d41-888c-dd703fe25ee5 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:06.886211 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd1821-4f3c-4d41-888c-dd703fe25ee5 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:06.886488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd1821-4f3c-4d41-888c-dd703fe25ee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:06.894465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd1821-4f3c-4d41-888c-dd703fe25ee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:06.896050 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd1821-4f3c-4d41-888c-dd703fe25ee5 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:06.905675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 707/1425] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:07.820851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbbca5-f847-494f-b624-cfd2841ec530 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:07.821967 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbbca5-f847-494f-b624-cfd2841ec530 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:07.821967 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbbca5-f847-494f-b624-cfd2841ec530 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:07.823349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 15:59:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 15:59:07.828637 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bfa22-5ce4-42f4-8ecb-7101d7d82281 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:07.829035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bfa22-5ce4-42f4-8ecb-7101d7d82281 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:07.829229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bfa22-5ce4-42f4-8ecb-7101d7d82281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:07.846950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-334bfa22-5ce4-42f4-8ecb-7101d7d82281 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:07.848192 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-334bfa22-5ce4-42f4-8ecb-7101d7d82281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:07.856098 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 15:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:08.005477 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbbca5-f847-494f-b624-cfd2841ec530 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:08.021991 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbbca5-f847-494f-b624-cfd2841ec530 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:08.028802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd8b09-ef96-48f3-918f-d3347062abe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:08.029568 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd8b09-ef96-48f3-918f-d3347062abe0 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:08.029902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd8b09-ef96-48f3-918f-d3347062abe0 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:08.030235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd8b09-ef96-48f3-918f-d3347062abe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:08.039724 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd8b09-ef96-48f3-918f-d3347062abe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:08.042274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd8b09-ef96-48f3-918f-d3347062abe0 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:08.053389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 720/1428] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:08.966111 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6497e8-951b-4029-afc1-7af21724456a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:08.966673 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6497e8-951b-4029-afc1-7af21724456a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:08.966673 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6497e8-951b-4029-afc1-7af21724456a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:08.968064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 15:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:08.973014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4324eb-bbd2-4823-9eff-ad31b61a1bd7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:08.973483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4324eb-bbd2-4823-9eff-ad31b61a1bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:08.973591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4324eb-bbd2-4823-9eff-ad31b61a1bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:08.991877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1b4324eb-bbd2-4823-9eff-ad31b61a1bd7 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:08.993690 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1b4324eb-bbd2-4823-9eff-ad31b61a1bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:09.001577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 15:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:09.160727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6497e8-951b-4029-afc1-7af21724456a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:09.175472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6497e8-951b-4029-afc1-7af21724456a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:09.180719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000261e3-9e0a-4b7b-855c-6335389bd7d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:09.181343 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000261e3-9e0a-4b7b-855c-6335389bd7d0 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:09.181631 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000261e3-9e0a-4b7b-855c-6335389bd7d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:09.181911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000261e3-9e0a-4b7b-855c-6335389bd7d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:09.190074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000261e3-9e0a-4b7b-855c-6335389bd7d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:09.191680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000261e3-9e0a-4b7b-855c-6335389bd7d0 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:09.201002 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 710/1431] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:10.109654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35585cc-502b-4a69-8b40-d7e67e40fc02 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:10.110222 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35585cc-502b-4a69-8b40-d7e67e40fc02 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:10.110222 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35585cc-502b-4a69-8b40-d7e67e40fc02 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:10.111598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 15:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:10.116652 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e194c5-8a98-4ac8-8144-972548bd0d0f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:10.117064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e194c5-8a98-4ac8-8144-972548bd0d0f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:10.117223 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e194c5-8a98-4ac8-8144-972548bd0d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:10.135202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-37e194c5-8a98-4ac8-8144-972548bd0d0f None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:10.136440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-37e194c5-8a98-4ac8-8144-972548bd0d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:10.144216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:10.294410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35585cc-502b-4a69-8b40-d7e67e40fc02 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:10.310912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35585cc-502b-4a69-8b40-d7e67e40fc02 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:10.318720 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1f71f-0af1-4ea4-8c81-f4524b5dcd15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:10.319375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1f71f-0af1-4ea4-8c81-f4524b5dcd15 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:10.319665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1f71f-0af1-4ea4-8c81-f4524b5dcd15 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:10.319952 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1f71f-0af1-4ea4-8c81-f4524b5dcd15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:10.328937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1f71f-0af1-4ea4-8c81-f4524b5dcd15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:10.330543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1f71f-0af1-4ea4-8c81-f4524b5dcd15 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:10.340073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 723/1434] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:11.276524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3856e-9205-4d5d-a658-139ec49b0cec None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:11.277036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3856e-9205-4d5d-a658-139ec49b0cec None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:11.277144 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a3856e-9205-4d5d-a658-139ec49b0cec None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:11.278735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 15:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:11.285507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627f6d3-5b01-4011-9832-3d3e4b664994 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:11.285919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627f6d3-5b01-4011-9832-3d3e4b664994 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:11.286229 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627f6d3-5b01-4011-9832-3d3e4b664994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:11.309241 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4627f6d3-5b01-4011-9832-3d3e4b664994 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:11.310842 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4627f6d3-5b01-4011-9832-3d3e4b664994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:11.321594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 15:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:11.473427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3856e-9205-4d5d-a658-139ec49b0cec None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:11.489927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a3856e-9205-4d5d-a658-139ec49b0cec None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:11.495957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203b171-a944-43a9-b749-790823d676f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:11.496645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203b171-a944-43a9-b749-790823d676f1 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:11.496934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203b171-a944-43a9-b749-790823d676f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:11.497219 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203b171-a944-43a9-b749-790823d676f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:11.509028 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203b171-a944-43a9-b749-790823d676f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:11.510752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203b171-a944-43a9-b749-790823d676f1 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:11.520693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 713/1437] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:12.485173 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89930ea-f522-4adc-8227-c3bf3797acb3 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:12.485798 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89930ea-f522-4adc-8227-c3bf3797acb3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:12.485798 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89930ea-f522-4adc-8227-c3bf3797acb3 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:12.487162 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 15:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:12.492922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e8ba6-5174-4d4a-b300-5df6b30dbd15 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:12.493400 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e8ba6-5174-4d4a-b300-5df6b30dbd15 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:12.494132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e8ba6-5174-4d4a-b300-5df6b30dbd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:12.520049 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-806e8ba6-5174-4d4a-b300-5df6b30dbd15 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:12.521932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-806e8ba6-5174-4d4a-b300-5df6b30dbd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:12.533846 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 15:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:12.684310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89930ea-f522-4adc-8227-c3bf3797acb3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:12.698999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89930ea-f522-4adc-8227-c3bf3797acb3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:12.704450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fb60a-4076-49c7-bc73-f49db9efbaef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:12.705088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fb60a-4076-49c7-bc73-f49db9efbaef service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:12.705378 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fb60a-4076-49c7-bc73-f49db9efbaef service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:12.705662 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fb60a-4076-49c7-bc73-f49db9efbaef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:12.714555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fb60a-4076-49c7-bc73-f49db9efbaef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:12.716182 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fb60a-4076-49c7-bc73-f49db9efbaef service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:12.725528 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 726/1440] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:14.834967 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd32bbe-9ad8-4e37-9276-333a647dfec1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:14.835523 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd32bbe-9ad8-4e37-9276-333a647dfec1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:14.835523 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd32bbe-9ad8-4e37-9276-333a647dfec1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:14.837519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 15:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:14.842747 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17cce4-56da-4ab0-8061-c2eaa7dc8d9e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:14.843157 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17cce4-56da-4ab0-8061-c2eaa7dc8d9e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:14.843318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17cce4-56da-4ab0-8061-c2eaa7dc8d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:14.860721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cd17cce4-56da-4ab0-8061-c2eaa7dc8d9e None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:14.861922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cd17cce4-56da-4ab0-8061-c2eaa7dc8d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:14.869725 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 15:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:14.908460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd32bbe-9ad8-4e37-9276-333a647dfec1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:14.919152 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd32bbe-9ad8-4e37-9276-333a647dfec1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:14.922639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52799a0c-4a94-4842-958a-ed93936fea33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:14.923272 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52799a0c-4a94-4842-958a-ed93936fea33 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:14.923560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52799a0c-4a94-4842-958a-ed93936fea33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:14.923842 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52799a0c-4a94-4842-958a-ed93936fea33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:14.932961 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52799a0c-4a94-4842-958a-ed93936fea33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:14.936774 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52799a0c-4a94-4842-958a-ed93936fea33 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:14.943715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 716/1443] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:17.292285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac886beb-7c50-4929-aa2a-f9e6fbac2ffb None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:17.292816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac886beb-7c50-4929-aa2a-f9e6fbac2ffb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:17.292816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac886beb-7c50-4929-aa2a-f9e6fbac2ffb None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:17.294160 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 15:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:17.299538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87064bb-e5c9-426a-803d-b197559e78e7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:17.299953 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87064bb-e5c9-426a-803d-b197559e78e7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:17.300136 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87064bb-e5c9-426a-803d-b197559e78e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:17.318081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e87064bb-e5c9-426a-803d-b197559e78e7 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:17.319277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e87064bb-e5c9-426a-803d-b197559e78e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:17.327087 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 15:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:17.365011 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac886beb-7c50-4929-aa2a-f9e6fbac2ffb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:17.376350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac886beb-7c50-4929-aa2a-f9e6fbac2ffb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:17.380112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0a3df-b744-4c89-9d96-690c534bd001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:17.380753 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0a3df-b744-4c89-9d96-690c534bd001 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:17.381041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0a3df-b744-4c89-9d96-690c534bd001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:17.381320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0a3df-b744-4c89-9d96-690c534bd001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:17.390009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0a3df-b744-4c89-9d96-690c534bd001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:17.391452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0a3df-b744-4c89-9d96-690c534bd001 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:17.401261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 729/1446] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:19.990796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcc8fb-d307-4daf-9af8-bafad2b074aa None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:19.991408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcc8fb-d307-4daf-9af8-bafad2b074aa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:19.991408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcc8fb-d307-4daf-9af8-bafad2b074aa None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:19.992766 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 15:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:19.998166 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db71d5-1c63-4b91-b538-3610682acc2a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:19.998617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db71d5-1c63-4b91-b538-3610682acc2a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:19.998808 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db71d5-1c63-4b91-b538-3610682acc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:20.016442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-13db71d5-1c63-4b91-b538-3610682acc2a None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:20.017638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-13db71d5-1c63-4b91-b538-3610682acc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:20.025996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 15:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:20.063847 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcc8fb-d307-4daf-9af8-bafad2b074aa None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:20.074827 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcc8fb-d307-4daf-9af8-bafad2b074aa None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:20.078364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beff60e-9aee-4cd7-a2bb-0b5474203120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:20.078994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beff60e-9aee-4cd7-a2bb-0b5474203120 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:20.079280 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beff60e-9aee-4cd7-a2bb-0b5474203120 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:20.079561 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beff60e-9aee-4cd7-a2bb-0b5474203120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:20.089157 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beff60e-9aee-4cd7-a2bb-0b5474203120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:20.090577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beff60e-9aee-4cd7-a2bb-0b5474203120 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:20.099730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 719/1449] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:22.496092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6368c55-b6ec-4798-9850-205f03f85c7d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:22.496662 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6368c55-b6ec-4798-9850-205f03f85c7d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:22.496662 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6368c55-b6ec-4798-9850-205f03f85c7d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:22.498062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 15:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:22.503243 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56635c-182a-44ff-b1f9-b02e1a607bab None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:22.503639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56635c-182a-44ff-b1f9-b02e1a607bab None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:22.503801 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56635c-182a-44ff-b1f9-b02e1a607bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:22.522001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-db56635c-182a-44ff-b1f9-b02e1a607bab None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:22.523213 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-db56635c-182a-44ff-b1f9-b02e1a607bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:22.531512 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 15:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:22.568724 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6368c55-b6ec-4798-9850-205f03f85c7d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:22.579745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6368c55-b6ec-4798-9850-205f03f85c7d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:22.583281 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d6cab-2ab1-45d1-a0f4-e2cf04a59753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:22.583911 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d6cab-2ab1-45d1-a0f4-e2cf04a59753 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:22.584311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d6cab-2ab1-45d1-a0f4-e2cf04a59753 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:22.585208 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d6cab-2ab1-45d1-a0f4-e2cf04a59753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:22.595164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d6cab-2ab1-45d1-a0f4-e2cf04a59753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:22.596656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d6cab-2ab1-45d1-a0f4-e2cf04a59753 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:22.605973 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 732/1452] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:24.889731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f5981-600a-4ddd-aef2-e0475052ef3c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:24.890218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f5981-600a-4ddd-aef2-e0475052ef3c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:24.890323 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f5981-600a-4ddd-aef2-e0475052ef3c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:24.891654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 15:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:24.896959 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a022b1-48a6-4b27-98bf-249974c2383f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:24.897395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a022b1-48a6-4b27-98bf-249974c2383f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:24.897532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a022b1-48a6-4b27-98bf-249974c2383f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:24.915806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-73a022b1-48a6-4b27-98bf-249974c2383f None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:24.917028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-73a022b1-48a6-4b27-98bf-249974c2383f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:24.924720 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 15:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:24.962181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f5981-600a-4ddd-aef2-e0475052ef3c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:24.963839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-750f5981-600a-4ddd-aef2-e0475052ef3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:24.976463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f5981-600a-4ddd-aef2-e0475052ef3c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:24.980540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce761c-152a-4f75-beaf-d32a64d8e8ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:24.981174 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce761c-152a-4f75-beaf-d32a64d8e8ed service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:24.981460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce761c-152a-4f75-beaf-d32a64d8e8ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:24.981741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce761c-152a-4f75-beaf-d32a64d8e8ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:24.990439 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce761c-152a-4f75-beaf-d32a64d8e8ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:24.991864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce761c-152a-4f75-beaf-d32a64d8e8ed service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:25.001053 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 722/1455] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:27.338395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ac4c0-dd0c-4da2-9296-fc9d6c23eaa2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:27.338949 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ac4c0-dd0c-4da2-9296-fc9d6c23eaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:27.338949 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ac4c0-dd0c-4da2-9296-fc9d6c23eaa2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:27.340351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 15:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:27.345456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0bbc9-269b-44e3-94c0-c1bfd80d741e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:27.345859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0bbc9-269b-44e3-94c0-c1bfd80d741e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:27.346011 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0bbc9-269b-44e3-94c0-c1bfd80d741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:27.363329 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c3e0bbc9-269b-44e3-94c0-c1bfd80d741e None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:27.364543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c3e0bbc9-269b-44e3-94c0-c1bfd80d741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:27.372696 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 15:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:27.410201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ac4c0-dd0c-4da2-9296-fc9d6c23eaa2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:27.420879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ac4c0-dd0c-4da2-9296-fc9d6c23eaa2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:27.424410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dea329-24cc-44e9-9478-b2f342539eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:27.425044 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dea329-24cc-44e9-9478-b2f342539eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:27.425332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dea329-24cc-44e9-9478-b2f342539eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:27.425614 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dea329-24cc-44e9-9478-b2f342539eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:27.434909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dea329-24cc-44e9-9478-b2f342539eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:27.436377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dea329-24cc-44e9-9478-b2f342539eb5 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:27.445589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 735/1458] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:29.761455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8b470-48d0-4c0e-bbcb-6dfc1e08e32e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:29.761997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8b470-48d0-4c0e-bbcb-6dfc1e08e32e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:29.761997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8b470-48d0-4c0e-bbcb-6dfc1e08e32e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:29.763659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 15:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:29.769090 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98177c4e-a624-4da5-97d8-d9c9b5855c44 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:29.769515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98177c4e-a624-4da5-97d8-d9c9b5855c44 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:29.769694 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98177c4e-a624-4da5-97d8-d9c9b5855c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:29.776283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=70 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:59:29.788950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-98177c4e-a624-4da5-97d8-d9c9b5855c44 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:29.790143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-98177c4e-a624-4da5-97d8-d9c9b5855c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:29.797832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 15:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:29.834696 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8b470-48d0-4c0e-bbcb-6dfc1e08e32e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:29.840796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=73 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:59:29.846338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8b470-48d0-4c0e-bbcb-6dfc1e08e32e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:29.855444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f48b5-d958-4ca2-9ad2-390014939480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:29.855444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f48b5-d958-4ca2-9ad2-390014939480 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:29.855444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f48b5-d958-4ca2-9ad2-390014939480 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:29.855444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f48b5-d958-4ca2-9ad2-390014939480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:29.859710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f48b5-d958-4ca2-9ad2-390014939480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:29.861162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f48b5-d958-4ca2-9ad2-390014939480 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:29.870270 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 725/1461] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:32.151593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807deb7-4e7d-436f-854f-70ed21711553 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:32.152162 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807deb7-4e7d-436f-854f-70ed21711553 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:32.152162 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807deb7-4e7d-436f-854f-70ed21711553 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:32.153556 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 15:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:32.158834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324dbb5-9e5b-45c7-bada-e443c08ce347 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:32.159261 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324dbb5-9e5b-45c7-bada-e443c08ce347 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:32.159414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324dbb5-9e5b-45c7-bada-e443c08ce347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:32.177313 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8324dbb5-9e5b-45c7-bada-e443c08ce347 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:32.178505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8324dbb5-9e5b-45c7-bada-e443c08ce347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:32.186840 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 15:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:32.224071 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807deb7-4e7d-436f-854f-70ed21711553 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:32.235118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807deb7-4e7d-436f-854f-70ed21711553 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:32.238618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101cd79-770c-4b12-8bb7-3e5f437d14dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:32.239248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101cd79-770c-4b12-8bb7-3e5f437d14dd service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:32.239532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101cd79-770c-4b12-8bb7-3e5f437d14dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:32.239812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101cd79-770c-4b12-8bb7-3e5f437d14dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:32.249138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101cd79-770c-4b12-8bb7-3e5f437d14dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:32.250561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101cd79-770c-4b12-8bb7-3e5f437d14dd service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:32.260094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 738/1464] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:34.481772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed010d1e-89ba-4366-9bbf-b2965d1a9d35 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:34.482332 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed010d1e-89ba-4366-9bbf-b2965d1a9d35 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:34.482332 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed010d1e-89ba-4366-9bbf-b2965d1a9d35 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:34.483695 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 15:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:34.489038 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b095bd-0819-4bb8-8fa8-3f3c5c60555c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:34.489480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b095bd-0819-4bb8-8fa8-3f3c5c60555c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:34.489586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b095bd-0819-4bb8-8fa8-3f3c5c60555c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:34.507649 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-25b095bd-0819-4bb8-8fa8-3f3c5c60555c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:34.508883 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-25b095bd-0819-4bb8-8fa8-3f3c5c60555c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:34.516692 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 15:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:34.552761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed010d1e-89ba-4366-9bbf-b2965d1a9d35 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:34.563600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed010d1e-89ba-4366-9bbf-b2965d1a9d35 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:34.567029 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8c7f5-8039-4e36-a3a2-93411dd4c411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:34.567653 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8c7f5-8039-4e36-a3a2-93411dd4c411 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:34.567938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8c7f5-8039-4e36-a3a2-93411dd4c411 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:34.568245 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8c7f5-8039-4e36-a3a2-93411dd4c411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:34.578879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8c7f5-8039-4e36-a3a2-93411dd4c411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:34.581243 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8c7f5-8039-4e36-a3a2-93411dd4c411 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:34.591439 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 728/1467] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:36.801525 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f30001-9825-4b0f-9bcb-395a0f2abbf3 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:36.802056 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f30001-9825-4b0f-9bcb-395a0f2abbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:36.802056 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f30001-9825-4b0f-9bcb-395a0f2abbf3 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:36.803382 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 15:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 15:59:36.808600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b716b-89b8-471a-a4b6-00bb76a1b998 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:36.809051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b716b-89b8-471a-a4b6-00bb76a1b998 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:36.809150 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b716b-89b8-471a-a4b6-00bb76a1b998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:36.826960 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d29b716b-89b8-471a-a4b6-00bb76a1b998 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 15:59:36.828179 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d29b716b-89b8-471a-a4b6-00bb76a1b998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 15:59:36.836102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 15:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 15:59:36.874673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f30001-9825-4b0f-9bcb-395a0f2abbf3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 15:59:36.886246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f30001-9825-4b0f-9bcb-395a0f2abbf3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 15:59:36.889793 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1523d4-19e1-4d6b-be6f-bce5b13c6b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 15:59:36.890590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1523d4-19e1-4d6b-be6f-bce5b13c6b91 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 15:59:36.890931 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1523d4-19e1-4d6b-be6f-bce5b13c6b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 15:59:36.891215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1523d4-19e1-4d6b-be6f-bce5b13c6b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 15:59:36.900922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1523d4-19e1-4d6b-be6f-bce5b13c6b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 15:59:36.902357 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1523d4-19e1-4d6b-be6f-bce5b13c6b91 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 15:59:36.911672 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 741/1470] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 15:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 15:59:46.821937 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=17 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 15:59:46.907649 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=17 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:00:08.627370 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fdb68-bd8c-4c38-8941-eaafbb5ad113 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:08.627957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fdb68-bd8c-4c38-8941-eaafbb5ad113 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:08.627957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fdb68-bd8c-4c38-8941-eaafbb5ad113 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:08.629250 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 730/1471] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 16:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:08.635128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73fc44-4150-4486-afd3-ebe2f4d533a4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:08.635529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73fc44-4150-4486-afd3-ebe2f4d533a4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:08.635681 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73fc44-4150-4486-afd3-ebe2f4d533a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:08.652828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ee73fc44-4150-4486-afd3-ebe2f4d533a4 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:08.654010 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ee73fc44-4150-4486-afd3-ebe2f4d533a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:08.661587 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 742/1472] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 16:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:08.708210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d64fa-ccbc-4570-b97e-4e7e109996c9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:08.708504 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d64fa-ccbc-4570-b97e-4e7e109996c9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:08.708788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d64fa-ccbc-4570-b97e-4e7e109996c9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:08.710114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 731/1473] 10.222.0.50 () {54 vars in 962 bytes} [Thu Jun 2 16:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 16:00:08.714768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592a850-6938-47a2-b787-7704a6d06334 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:08.715065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592a850-6938-47a2-b787-7704a6d06334 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:08.715348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592a850-6938-47a2-b787-7704a6d06334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:08.732688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d592a850-6938-47a2-b787-7704a6d06334 None None] MFA Rules not processed for user `a6a5157588644972a6a4554b3a9f1d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:08.733837 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d592a850-6938-47a2-b787-7704a6d06334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:08.740175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 743/1474] 10.222.0.50 () {58 vars in 1059 bytes} [Thu Jun 2 16:00:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:08.747599 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d64fa-ccbc-4570-b97e-4e7e109996c9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:08.758700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d64fa-ccbc-4570-b97e-4e7e109996c9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:08.762146 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e31529-7e71-416d-b74f-534ba3e77056 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5157588644972a6a4554b3a9f1d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:08.762767 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e31529-7e71-416d-b74f-534ba3e77056 service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:08.763049 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e31529-7e71-416d-b74f-534ba3e77056 service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:08.763640 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e31529-7e71-416d-b74f-534ba3e77056 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:08.772459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e31529-7e71-416d-b74f-534ba3e77056 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:08.773878 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e31529-7e71-416d-b74f-534ba3e77056 service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:08.783055 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 732/1475] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:00:11.096639 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca91b5e-48f4-4155-b4b2-5b747baffcb2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:11.097151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca91b5e-48f4-4155-b4b2-5b747baffcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:11.097317 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca91b5e-48f4-4155-b4b2-5b747baffcb2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:11.098702 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 744/1476] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 16:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:11.104523 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696e722-fafa-4bea-a971-30897a7cfc52 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:11.104957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696e722-fafa-4bea-a971-30897a7cfc52 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:11.105115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696e722-fafa-4bea-a971-30897a7cfc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:11.123158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2696e722-fafa-4bea-a971-30897a7cfc52 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:11.124396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2696e722-fafa-4bea-a971-30897a7cfc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:11.132392 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 733/1477] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 16:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:11.155811 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca91b5e-48f4-4155-b4b2-5b747baffcb2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:11.169328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca91b5e-48f4-4155-b4b2-5b747baffcb2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:11.173831 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42ce5b-4451-4ea8-8fda-7518e8b8c278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:11.175360 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ce5b-4451-4ea8-8fda-7518e8b8c278 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:11.175360 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ce5b-4451-4ea8-8fda-7518e8b8c278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:11.175360 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42ce5b-4451-4ea8-8fda-7518e8b8c278 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:11.175815 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42ce5b-4451-4ea8-8fda-7518e8b8c278 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:11.179009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-3f42ce5b-4451-4ea8-8fda-7518e8b8c278 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:00:11.179009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: warnings.warn(msg) Jun 02 16:00:11.179009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: Jun 02 16:00:11.179009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42ce5b-4451-4ea8-8fda-7518e8b8c278 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:11.199121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 745/1478] 10.222.0.50 () {56 vars in 1108 bytes} [Thu Jun 2 16:00:11 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:00:13.481693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c823d-6d36-4b47-b739-9e47c93ed534 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:13.482263 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c823d-6d36-4b47-b739-9e47c93ed534 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:13.482263 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c823d-6d36-4b47-b739-9e47c93ed534 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:13.483619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 734/1479] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 16:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:13.488904 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e9376-d145-47de-aa33-2c02037c5e2f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:13.489301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e9376-d145-47de-aa33-2c02037c5e2f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:13.489468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e9376-d145-47de-aa33-2c02037c5e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:13.507894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-417e9376-d145-47de-aa33-2c02037c5e2f None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:13.508968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-417e9376-d145-47de-aa33-2c02037c5e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:13.516600 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 746/1480] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 16:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:13.561337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c823d-6d36-4b47-b739-9e47c93ed534 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:13.576742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c823d-6d36-4b47-b739-9e47c93ed534 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:13.582036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10600f-445c-4995-9e3d-29eae10b4b01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:13.582704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10600f-445c-4995-9e3d-29eae10b4b01 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:13.582995 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10600f-445c-4995-9e3d-29eae10b4b01 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:13.583268 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10600f-445c-4995-9e3d-29eae10b4b01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:13.592090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10600f-445c-4995-9e3d-29eae10b4b01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:13.593726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10600f-445c-4995-9e3d-29eae10b4b01 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:13.603214 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 735/1481] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:00:15.996894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8308fbb-0466-4ef1-b24d-d5402e65b4e0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:15.997438 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8308fbb-0466-4ef1-b24d-d5402e65b4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:15.997562 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8308fbb-0466-4ef1-b24d-d5402e65b4e0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:15.998927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 747/1482] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 16:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:16.004250 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37b9f8-5dae-4e43-b6eb-9f08d89f094c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:16.004681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37b9f8-5dae-4e43-b6eb-9f08d89f094c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:16.004788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37b9f8-5dae-4e43-b6eb-9f08d89f094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:16.023112 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fe37b9f8-5dae-4e43-b6eb-9f08d89f094c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:16.024345 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fe37b9f8-5dae-4e43-b6eb-9f08d89f094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:16.031960 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 736/1483] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 16:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:16.067520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8308fbb-0466-4ef1-b24d-d5402e65b4e0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:16.078654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8308fbb-0466-4ef1-b24d-d5402e65b4e0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:16.082085 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754c4c0-83a5-4586-9133-6130417c346f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:16.082708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754c4c0-83a5-4586-9133-6130417c346f service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:16.082993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754c4c0-83a5-4586-9133-6130417c346f service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:16.083273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754c4c0-83a5-4586-9133-6130417c346f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:16.091892 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754c4c0-83a5-4586-9133-6130417c346f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:16.093351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754c4c0-83a5-4586-9133-6130417c346f service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:16.102571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 748/1484] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:00:18.369427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27388c0e-9295-4dae-840f-40d450a8006e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:18.369827 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27388c0e-9295-4dae-840f-40d450a8006e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:18.369827 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27388c0e-9295-4dae-840f-40d450a8006e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:18.371202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 737/1485] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 16:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:18.376724 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c420cb-1d48-4fdf-bda9-7a177ae24a45 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:18.377198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c420cb-1d48-4fdf-bda9-7a177ae24a45 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:18.377380 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c420cb-1d48-4fdf-bda9-7a177ae24a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:18.394831 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c5c420cb-1d48-4fdf-bda9-7a177ae24a45 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:18.396073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c5c420cb-1d48-4fdf-bda9-7a177ae24a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:18.404186 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 749/1486] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 16:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:18.441453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27388c0e-9295-4dae-840f-40d450a8006e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:18.452014 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27388c0e-9295-4dae-840f-40d450a8006e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:18.455506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc2f69-2a5b-47a1-8357-ea5bdec2bb27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:18.456168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc2f69-2a5b-47a1-8357-ea5bdec2bb27 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:18.456457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc2f69-2a5b-47a1-8357-ea5bdec2bb27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:18.456738 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc2f69-2a5b-47a1-8357-ea5bdec2bb27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:18.465911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc2f69-2a5b-47a1-8357-ea5bdec2bb27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:18.467330 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc2f69-2a5b-47a1-8357-ea5bdec2bb27 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:18.477586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 738/1487] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:00:20.865267 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fca17-943d-4696-bd16-3dfaf87e9740 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:20.865940 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fca17-943d-4696-bd16-3dfaf87e9740 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:20.865940 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fca17-943d-4696-bd16-3dfaf87e9740 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:20.867248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 750/1488] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 16:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:20.876547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86a532-0d48-4ca0-99c5-9e8e6b5e85c4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:20.876547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86a532-0d48-4ca0-99c5-9e8e6b5e85c4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:20.876547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86a532-0d48-4ca0-99c5-9e8e6b5e85c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:20.892565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8b86a532-0d48-4ca0-99c5-9e8e6b5e85c4 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:20.893774 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8b86a532-0d48-4ca0-99c5-9e8e6b5e85c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:20.902216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 739/1489] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:00:20.941962 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fca17-943d-4696-bd16-3dfaf87e9740 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:20.952943 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fca17-943d-4696-bd16-3dfaf87e9740 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:20.956501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6822579-f7d5-47dd-b312-3751ef5e5ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:20.957146 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6822579-f7d5-47dd-b312-3751ef5e5ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:20.957436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6822579-f7d5-47dd-b312-3751ef5e5ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:20.957719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6822579-f7d5-47dd-b312-3751ef5e5ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:20.966698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6822579-f7d5-47dd-b312-3751ef5e5ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:20.968172 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6822579-f7d5-47dd-b312-3751ef5e5ad6 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:20.978108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 751/1490] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:00:23.605003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e8e2d-a97f-4f88-8a7a-0517dadde28c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:23.605568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e8e2d-a97f-4f88-8a7a-0517dadde28c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:23.605568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e8e2d-a97f-4f88-8a7a-0517dadde28c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:23.606915 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 740/1491] 10.222.0.50 () {54 vars in 926 bytes} [Thu Jun 2 16:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:00:23.612267 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bb390-d1f9-427c-b5e2-436b44efad23 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:23.612671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bb390-d1f9-427c-b5e2-436b44efad23 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:23.612841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bb390-d1f9-427c-b5e2-436b44efad23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:23.630737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-498bb390-d1f9-427c-b5e2-436b44efad23 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:00:23.632242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-498bb390-d1f9-427c-b5e2-436b44efad23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:00:23.640430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 752/1492] 10.222.0.50 () {58 vars in 1023 bytes} [Thu Jun 2 16:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:00:23.678126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e8e2d-a97f-4f88-8a7a-0517dadde28c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:00:23.689045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e8e2d-a97f-4f88-8a7a-0517dadde28c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:00:23.692501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c992b-acee-4fbb-ba74-d460237e64fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:00:23.693125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c992b-acee-4fbb-ba74-d460237e64fc service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:00:23.693409 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c992b-acee-4fbb-ba74-d460237e64fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:00:23.693686 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c992b-acee-4fbb-ba74-d460237e64fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:00:23.703418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c992b-acee-4fbb-ba74-d460237e64fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:00:23.704879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c992b-acee-4fbb-ba74-d460237e64fc service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:00:23.714752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 741/1493] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:00:33.625679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=33 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:00:33.709945 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=33 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:02:04.291180 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cf022-eebe-4dbd-9160-1aea9bad443c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:04.291802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cf022-eebe-4dbd-9160-1aea9bad443c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:04.291802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cf022-eebe-4dbd-9160-1aea9bad443c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:04.309983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-017cf022-eebe-4dbd-9160-1aea9bad443c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:02:04.311181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-017cf022-eebe-4dbd-9160-1aea9bad443c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:02:04.318925 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 753/1494] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:02:04.326777 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9fd94-fdc8-4778-b8f9-a35772dda0fb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:04.327242 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9fd94-fdc8-4778-b8f9-a35772dda0fb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:04.327371 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de9fd94-fdc8-4778-b8f9-a35772dda0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:04.345194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1de9fd94-fdc8-4778-b8f9-a35772dda0fb None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:02:04.346373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1de9fd94-fdc8-4778-b8f9-a35772dda0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:02:04.354701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 742/1495] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:02:04.359106 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cf022-eebe-4dbd-9160-1aea9bad443c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:04.368989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cf022-eebe-4dbd-9160-1aea9bad443c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:04.373309 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb19a3a-e652-4dc6-a0a3-5001be75e65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:04.373957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb19a3a-e652-4dc6-a0a3-5001be75e65b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:04.374240 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb19a3a-e652-4dc6-a0a3-5001be75e65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:04.374517 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb19a3a-e652-4dc6-a0a3-5001be75e65b admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:04.375231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb19a3a-e652-4dc6-a0a3-5001be75e65b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:02:04.375535 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb19a3a-e652-4dc6-a0a3-5001be75e65b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:04.376605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-bcb19a3a-e652-4dc6-a0a3-5001be75e65b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:02:04.376605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: warnings.warn(msg) Jun 02 16:02:04.376605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: Jun 02 16:02:04.377485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb19a3a-e652-4dc6-a0a3-5001be75e65b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:04.388971 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 754/1496] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:02:04.397393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9fd94-fdc8-4778-b8f9-a35772dda0fb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:04.406334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de9fd94-fdc8-4778-b8f9-a35772dda0fb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:04.410777 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e7fc6-9379-4729-925d-4968db9051eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:04.412036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e7fc6-9379-4729-925d-4968db9051eb admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:04.412341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e7fc6-9379-4729-925d-4968db9051eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:04.412620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e7fc6-9379-4729-925d-4968db9051eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:04.413332 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e7fc6-9379-4729-925d-4968db9051eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:04.415067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-a41e7fc6-9379-4729-925d-4968db9051eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:02:04.415067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: warnings.warn(msg) Jun 02 16:02:04.415067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: Jun 02 16:02:04.416281 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e7fc6-9379-4729-925d-4968db9051eb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:04.545406 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 743/1497] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:02:04 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:02:04.549612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb19a3a-e652-4dc6-a0a3-5001be75e65b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:04.559829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb19a3a-e652-4dc6-a0a3-5001be75e65b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:04.614774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a146bc-261f-4ae2-9eeb-c59b35f2f0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:04.615435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a146bc-261f-4ae2-9eeb-c59b35f2f0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:04.615718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a146bc-261f-4ae2-9eeb-c59b35f2f0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:04.616010 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a146bc-261f-4ae2-9eeb-c59b35f2f0b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:04.616688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a146bc-261f-4ae2-9eeb-c59b35f2f0b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:04.617693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-64a146bc-261f-4ae2-9eeb-c59b35f2f0b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:02:04.617693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: warnings.warn(msg) Jun 02 16:02:04.617693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: Jun 02 16:02:04.618933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a146bc-261f-4ae2-9eeb-c59b35f2f0b7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:04.697944 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 755/1498] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:02:04 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:02:04.702083 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e7fc6-9379-4729-925d-4968db9051eb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:04.712976 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e7fc6-9379-4729-925d-4968db9051eb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:04.717482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a569e0-e3c5-4c69-99ed-0049636e5dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:04.718137 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a569e0-e3c5-4c69-99ed-0049636e5dec admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:04.718456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a569e0-e3c5-4c69-99ed-0049636e5dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:04.718707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a569e0-e3c5-4c69-99ed-0049636e5dec admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:04.719457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a569e0-e3c5-4c69-99ed-0049636e5dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:04.720508 dv-cinder-797608-27-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-e0a569e0-e3c5-4c69-99ed-0049636e5dec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:02:04.720508 dv-cinder-797608-27-smb devstack@keystone.service[80316]: warnings.warn(msg) Jun 02 16:02:04.720508 dv-cinder-797608-27-smb devstack@keystone.service[80316]: Jun 02 16:02:04.721493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a569e0-e3c5-4c69-99ed-0049636e5dec admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:04.733911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 744/1499] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:02:04.737649 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a146bc-261f-4ae2-9eeb-c59b35f2f0b7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:04.747305 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a146bc-261f-4ae2-9eeb-c59b35f2f0b7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:04.751823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3387285-fea2-4b48-a845-0d9c4e51cccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:04.752506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3387285-fea2-4b48-a845-0d9c4e51cccf admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:04.752793 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3387285-fea2-4b48-a845-0d9c4e51cccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:04.753071 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3387285-fea2-4b48-a845-0d9c4e51cccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:04.753786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3387285-fea2-4b48-a845-0d9c4e51cccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:04.754802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-b3387285-fea2-4b48-a845-0d9c4e51cccf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:02:04.754802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: warnings.warn(msg) Jun 02 16:02:04.754802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: Jun 02 16:02:04.756208 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3387285-fea2-4b48-a845-0d9c4e51cccf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:04.769207 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 756/1500] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:02:04.773679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a569e0-e3c5-4c69-99ed-0049636e5dec admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:04.788558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a569e0-e3c5-4c69-99ed-0049636e5dec admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:04.793174 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6555282-fd49-4f20-968e-5d9ddd37f14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:04.794054 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6555282-fd49-4f20-968e-5d9ddd37f14a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:04.794342 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6555282-fd49-4f20-968e-5d9ddd37f14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:04.794624 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6555282-fd49-4f20-968e-5d9ddd37f14a admin admin] PATH_INFO: `/v3/projects/41bbce1b4bb9494abab865b7f58383f5/users/f8b9aca2d10d4419b4ee1bae21cbf99d/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:04.809285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6555282-fd49-4f20-968e-5d9ddd37f14a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41bbce1b4bb9494abab865b7f58383f5, user_id=f8b9aca2d10d4419b4ee1bae21cbf99d, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:04.810249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-d6555282-fd49-4f20-968e-5d9ddd37f14a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:02:04.810249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: warnings.warn(msg) Jun 02 16:02:04.810249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: Jun 02 16:02:04.812188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6555282-fd49-4f20-968e-5d9ddd37f14a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:04.880962 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 745/1501] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:02:04 2022] PUT /identity/v3/projects/41bbce1b4bb9494abab865b7f58383f5/users/f8b9aca2d10d4419b4ee1bae21cbf99d/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:02:04.893646 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8880c-46da-42af-997b-bb6c0c2e570e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:04.893944 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8880c-46da-42af-997b-bb6c0c2e570e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:04.894232 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8880c-46da-42af-997b-bb6c0c2e570e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:04.921682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3fc8880c-46da-42af-997b-bb6c0c2e570e None None] MFA Rules not processed for user `f8b9aca2d10d4419b4ee1bae21cbf99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:02:04.922884 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3fc8880c-46da-42af-997b-bb6c0c2e570e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:02:04.985283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 757/1502] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:02:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:02:04.998454 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02142f0d-ceb4-4c19-9224-9aa48312bc80 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:04.998844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02142f0d-ceb4-4c19-9224-9aa48312bc80 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:04.999132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02142f0d-ceb4-4c19-9224-9aa48312bc80 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:05.000712 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 746/1503] 10.222.0.50 () {54 vars in 963 bytes} [Thu Jun 2 16:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:02:05.006054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ba67f-d248-4ffd-9df0-8ea5d3fd1357 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:05.006345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ba67f-d248-4ffd-9df0-8ea5d3fd1357 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:05.006624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ba67f-d248-4ffd-9df0-8ea5d3fd1357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:05.025066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-727ba67f-d248-4ffd-9df0-8ea5d3fd1357 None None] MFA Rules not processed for user `a4c3818af2794f598c21ee4aab4b3a70`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:02:05.026255 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-727ba67f-d248-4ffd-9df0-8ea5d3fd1357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:02:05.069576 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:02:05.076981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 758/1504] 10.222.0.50 () {58 vars in 1060 bytes} [Thu Jun 2 16:02:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:02:05.084691 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02142f0d-ceb4-4c19-9224-9aa48312bc80 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:05.095520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02142f0d-ceb4-4c19-9224-9aa48312bc80 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:05.099224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff032b-8b52-4089-8c12-62b7a8b25eea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:05.099851 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff032b-8b52-4089-8c12-62b7a8b25eea service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:05.100176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff032b-8b52-4089-8c12-62b7a8b25eea service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:05.100459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff032b-8b52-4089-8c12-62b7a8b25eea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:05.108680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff032b-8b52-4089-8c12-62b7a8b25eea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:05.115263 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff032b-8b52-4089-8c12-62b7a8b25eea service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:05.119447 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 747/1505] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:02:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:02:05.162979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae593f0-1895-4b49-a915-ce93ba2fd0c4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:05.163271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae593f0-1895-4b49-a915-ce93ba2fd0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:05.163552 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae593f0-1895-4b49-a915-ce93ba2fd0c4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:05.164858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 759/1506] 10.222.0.50 () {52 vars in 829 bytes} [Thu Jun 2 16:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:02:05.168516 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff032b-8b52-4089-8c12-62b7a8b25eea service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:05.230589 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff032b-8b52-4089-8c12-62b7a8b25eea service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:05.235053 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339d8a0-2c8b-4648-a000-656038497b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:05.235917 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339d8a0-2c8b-4648-a000-656038497b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:05.236255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339d8a0-2c8b-4648-a000-656038497b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:05.236535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339d8a0-2c8b-4648-a000-656038497b38 admin admin] PATH_INFO: `/v3/users/f8b9aca2d10d4419b4ee1bae21cbf99d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:05.237718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339d8a0-2c8b-4648-a000-656038497b38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8b9aca2d10d4419b4ee1bae21cbf99d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:05.238736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-4339d8a0-2c8b-4648-a000-656038497b38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:02:05.238736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: warnings.warn(msg) Jun 02 16:02:05.238736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: Jun 02 16:02:05.239934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339d8a0-2c8b-4648-a000-656038497b38 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:05.441856 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4339d8a0-2c8b-4648-a000-656038497b38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8b9aca2d10d4419b4ee1bae21cbf99d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:05.461509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4339d8a0-2c8b-4648-a000-656038497b38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8b9aca2d10d4419b4ee1bae21cbf99d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:05.462287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4339d8a0-2c8b-4648-a000-656038497b38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8b9aca2d10d4419b4ee1bae21cbf99d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:05.474416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4339d8a0-2c8b-4648-a000-656038497b38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8b9aca2d10d4419b4ee1bae21cbf99d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:05.475088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4339d8a0-2c8b-4648-a000-656038497b38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8b9aca2d10d4419b4ee1bae21cbf99d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:05.479226 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:02:05.543176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 748/1507] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:02:05 2022] DELETE /identity/v3/users/f8b9aca2d10d4419b4ee1bae21cbf99d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:02:05.547870 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f3d75-fb18-47ca-ae30-f6121a30cb58 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:05.548384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f3d75-fb18-47ca-ae30-f6121a30cb58 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:05.548484 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f3d75-fb18-47ca-ae30-f6121a30cb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:05.566145 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f66f3d75-fb18-47ca-ae30-f6121a30cb58 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:02:05.567354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f66f3d75-fb18-47ca-ae30-f6121a30cb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:02:05.625342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 760/1508] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:02:05.635454 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339d8a0-2c8b-4648-a000-656038497b38 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:05.636876 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4339d8a0-2c8b-4648-a000-656038497b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:02:05.691996 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339d8a0-2c8b-4648-a000-656038497b38 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:05.696162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1595a4e-965d-4cbd-a99c-9cc458fcb2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:05.696804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1595a4e-965d-4cbd-a99c-9cc458fcb2fe service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:05.697092 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1595a4e-965d-4cbd-a99c-9cc458fcb2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:05.697373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1595a4e-965d-4cbd-a99c-9cc458fcb2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:05.706407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1595a4e-965d-4cbd-a99c-9cc458fcb2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:05.707844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1595a4e-965d-4cbd-a99c-9cc458fcb2fe service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:05.718078 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 749/1509] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:02:06.151301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f3d75-fb18-47ca-ae30-f6121a30cb58 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:02:06.152778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f66f3d75-fb18-47ca-ae30-f6121a30cb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:02:06.165227 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f3d75-fb18-47ca-ae30-f6121a30cb58 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:02:06.169778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41dfa8-f9f9-4d1b-aca4-7130b38fa867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:02:06.170646 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41dfa8-f9f9-4d1b-aca4-7130b38fa867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:02:06.170935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41dfa8-f9f9-4d1b-aca4-7130b38fa867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:02:06.171216 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41dfa8-f9f9-4d1b-aca4-7130b38fa867 admin admin] PATH_INFO: `/v3/projects/41bbce1b4bb9494abab865b7f58383f5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:02:06.173014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41dfa8-f9f9-4d1b-aca4-7130b38fa867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41bbce1b4bb9494abab865b7f58383f5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:02:06.173459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-6a41dfa8-f9f9-4d1b-aca4-7130b38fa867 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:02:06.173459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: warnings.warn(msg) Jun 02 16:02:06.173459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: Jun 02 16:02:06.174644 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41dfa8-f9f9-4d1b-aca4-7130b38fa867 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:02:06.296114 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6a41dfa8-f9f9-4d1b-aca4-7130b38fa867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41bbce1b4bb9494abab865b7f58383f5', 'request_id': 'req-6a41dfa8-f9f9-4d1b-aca4-7130b38fa867'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:06.366737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6a41dfa8-f9f9-4d1b-aca4-7130b38fa867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41bbce1b4bb9494abab865b7f58383f5', 'request_id': 'req-6a41dfa8-f9f9-4d1b-aca4-7130b38fa867'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:06.380443 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6a41dfa8-f9f9-4d1b-aca4-7130b38fa867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41bbce1b4bb9494abab865b7f58383f5', 'request_id': 'req-6a41dfa8-f9f9-4d1b-aca4-7130b38fa867'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:06.391842 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6a41dfa8-f9f9-4d1b-aca4-7130b38fa867 admin admin] The token cache is being invalidate because project 41bbce1b4bb9494abab865b7f58383f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:02:06.392177 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6a41dfa8-f9f9-4d1b-aca4-7130b38fa867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:06.392910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6a41dfa8-f9f9-4d1b-aca4-7130b38fa867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:02:06.394498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 761/1510] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:02:06 2022] DELETE /identity/v3/projects/41bbce1b4bb9494abab865b7f58383f5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:02:15.713848 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:02:16.388810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:03:51.463261 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736de0f6-2e76-41ae-8d1e-f9d8bad95a52 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:03:51.463826 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736de0f6-2e76-41ae-8d1e-f9d8bad95a52 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:03:51.463826 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736de0f6-2e76-41ae-8d1e-f9d8bad95a52 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:03:51.465229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 16:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:03:51.469910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a44e3-260a-4d77-923e-d6e4773a350c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:03:51.470345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a44e3-260a-4d77-923e-d6e4773a350c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:03:51.470475 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a44e3-260a-4d77-923e-d6e4773a350c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:03:51.488999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-680a44e3-260a-4d77-923e-d6e4773a350c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:03:51.490317 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-680a44e3-260a-4d77-923e-d6e4773a350c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:03:51.547146 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 16:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:03:51.713852 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736de0f6-2e76-41ae-8d1e-f9d8bad95a52 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:03:51.715570 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-736de0f6-2e76-41ae-8d1e-f9d8bad95a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:03:51.793203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736de0f6-2e76-41ae-8d1e-f9d8bad95a52 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:03:51.798693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885d0fd-32c5-4ce0-b551-22f7c3d6b22b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:03:51.799342 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885d0fd-32c5-4ce0-b551-22f7c3d6b22b service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:03:51.799631 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885d0fd-32c5-4ce0-b551-22f7c3d6b22b service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:03:51.799915 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885d0fd-32c5-4ce0-b551-22f7c3d6b22b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:03:51.809285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885d0fd-32c5-4ce0-b551-22f7c3d6b22b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:03:51.811232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885d0fd-32c5-4ce0-b551-22f7c3d6b22b service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:03:51.822033 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 751/1513] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:03:52.678418 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710701c-ac32-438e-9f0c-894c3255a7f7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:03:52.679311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710701c-ac32-438e-9f0c-894c3255a7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:03:52.679311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710701c-ac32-438e-9f0c-894c3255a7f7 None None] PATH_INFO: `/v3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:03:52.680439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 763/1514] 10.222.0.39 () {54 vars in 925 bytes} [Thu Jun 2 16:03:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:03:52.686583 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1a6eb-08ec-42bb-97e2-b51e8062e1f7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:03:52.687013 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1a6eb-08ec-42bb-97e2-b51e8062e1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:03:52.687138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1a6eb-08ec-42bb-97e2-b51e8062e1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:03:52.705209 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8bc1a6eb-08ec-42bb-97e2-b51e8062e1f7 None None] MFA Rules not processed for user `8d60a2abffc04ba59b65d5fca5e318a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:03:52.706415 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8bc1a6eb-08ec-42bb-97e2-b51e8062e1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:03:52.719487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c989b99-3522-4b93-809c-978cf08c9ad8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:03:52.720036 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c989b99-3522-4b93-809c-978cf08c9ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:03:52.720327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c989b99-3522-4b93-809c-978cf08c9ad8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:03:52.721719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 764/1515] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 16:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:03:52.726838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeab28-2ac6-42bb-bb70-292a1edad081 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:03:52.727198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeab28-2ac6-42bb-bb70-292a1edad081 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:03:52.727483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeab28-2ac6-42bb-bb70-292a1edad081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:03:52.745525 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dcdeab28-2ac6-42bb-bb70-292a1edad081 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:03:52.746722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dcdeab28-2ac6-42bb-bb70-292a1edad081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:03:52.754780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 765/1516] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 16:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:03:52.772263 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 752/1517] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jun 2 16:03:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:03:52.905079 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeab28-2ac6-42bb-bb70-292a1edad081 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:03:52.918433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeab28-2ac6-42bb-bb70-292a1edad081 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:03:52.923828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dde96-3138-468a-825a-e2827025de58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:03:52.924495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dde96-3138-468a-825a-e2827025de58 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:03:52.924784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dde96-3138-468a-825a-e2827025de58 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:03:52.925067 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dde96-3138-468a-825a-e2827025de58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:03:52.933197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7dde96-3138-468a-825a-e2827025de58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:03:52.934731 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7dde96-3138-468a-825a-e2827025de58 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:03:52.943952 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 766/1518] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:03:56.911797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521c399-bc98-4a1a-95c2-71620be1918e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:03:56.912407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521c399-bc98-4a1a-95c2-71620be1918e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:03:56.912407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521c399-bc98-4a1a-95c2-71620be1918e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:03:56.914296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 753/1519] 10.222.0.50 () {54 vars in 960 bytes} [Thu Jun 2 16:03:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:03:56.919238 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f24120-b1e3-4456-87b9-1fb06a940fa6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:03:56.919669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f24120-b1e3-4456-87b9-1fb06a940fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:03:56.919809 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f24120-b1e3-4456-87b9-1fb06a940fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:03:56.939559 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b0f24120-b1e3-4456-87b9-1fb06a940fa6 None None] MFA Rules not processed for user `8d60a2abffc04ba59b65d5fca5e318a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:03:56.940780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b0f24120-b1e3-4456-87b9-1fb06a940fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:03:56.949183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 767/1520] 10.222.0.50 () {58 vars in 1057 bytes} [Thu Jun 2 16:03:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:03:56.956492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521c399-bc98-4a1a-95c2-71620be1918e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:03:56.969717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521c399-bc98-4a1a-95c2-71620be1918e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:03:56.974805 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e91dd-5371-4f04-8e09-c2c957811b5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60a2abffc04ba59b65d5fca5e318a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:03:56.975357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e91dd-5371-4f04-8e09-c2c957811b5e service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:03:56.976177 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e91dd-5371-4f04-8e09-c2c957811b5e service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:03:56.976469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e91dd-5371-4f04-8e09-c2c957811b5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:03:56.984936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e91dd-5371-4f04-8e09-c2c957811b5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:03:56.986506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e91dd-5371-4f04-8e09-c2c957811b5e service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:03:56.996792 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 754/1521] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:03:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:04:04.204624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a72e5-ff1e-4a9a-b8c2-de2598e7f17f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:04.205206 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a72e5-ff1e-4a9a-b8c2-de2598e7f17f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:04.205206 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a72e5-ff1e-4a9a-b8c2-de2598e7f17f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:04.206596 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 16:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:04:04.211395 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839c8a2-4990-4ea9-84a1-1967c8e24f7f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:04.211796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839c8a2-4990-4ea9-84a1-1967c8e24f7f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:04.211954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839c8a2-4990-4ea9-84a1-1967c8e24f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:04.230009 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9839c8a2-4990-4ea9-84a1-1967c8e24f7f None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:04:04.231206 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9839c8a2-4990-4ea9-84a1-1967c8e24f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:04.239020 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 16:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:04:04.392968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a72e5-ff1e-4a9a-b8c2-de2598e7f17f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:04:04.407218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a72e5-ff1e-4a9a-b8c2-de2598e7f17f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:04:04.412662 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d6fd2-ba8f-4a42-b4c5-2b6ca9a057df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:04:04.413295 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6fd2-ba8f-4a42-b4c5-2b6ca9a057df service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:04.413577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6fd2-ba8f-4a42-b4c5-2b6ca9a057df service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:04.413854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d6fd2-ba8f-4a42-b4c5-2b6ca9a057df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:04.422930 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d6fd2-ba8f-4a42-b4c5-2b6ca9a057df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:04:04.424555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d6fd2-ba8f-4a42-b4c5-2b6ca9a057df service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:04:04.434504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 769/1524] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:04:05.307642 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671b413-48f9-47ee-ac6c-e0b00a60314b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:05.308220 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671b413-48f9-47ee-ac6c-e0b00a60314b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:05.308220 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0671b413-48f9-47ee-ac6c-e0b00a60314b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:05.309537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 16:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:04:05.314406 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b8880-69d0-454a-9186-558108892737 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:05.314808 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b8880-69d0-454a-9186-558108892737 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:05.314964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b8880-69d0-454a-9186-558108892737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:05.334988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-002b8880-69d0-454a-9186-558108892737 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:04:05.336804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-002b8880-69d0-454a-9186-558108892737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:05.344554 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 16:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:04:05.494404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671b413-48f9-47ee-ac6c-e0b00a60314b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:04:05.508975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0671b413-48f9-47ee-ac6c-e0b00a60314b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:04:05.514545 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9edace-0e8b-4b0a-808c-4a3ab7222c4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:04:05.515171 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9edace-0e8b-4b0a-808c-4a3ab7222c4d service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:05.515456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9edace-0e8b-4b0a-808c-4a3ab7222c4d service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:05.515734 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9edace-0e8b-4b0a-808c-4a3ab7222c4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:05.523708 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9edace-0e8b-4b0a-808c-4a3ab7222c4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:04:05.525392 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9edace-0e8b-4b0a-808c-4a3ab7222c4d service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:04:05.534565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 757/1527] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:04:09.804929 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd4039-a793-4d59-a921-191ce08a9f2a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:09.805748 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd4039-a793-4d59-a921-191ce08a9f2a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:09.805748 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd4039-a793-4d59-a921-191ce08a9f2a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:09.807465 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 16:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:04:09.816056 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122231b-069d-46e1-9d31-8a0d416b2326 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:09.816687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122231b-069d-46e1-9d31-8a0d416b2326 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:09.816687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122231b-069d-46e1-9d31-8a0d416b2326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:09.840307 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a122231b-069d-46e1-9d31-8a0d416b2326 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:04:09.841543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a122231b-069d-46e1-9d31-8a0d416b2326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:09.852118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 16:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:04:09.893597 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd4039-a793-4d59-a921-191ce08a9f2a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:04:09.895402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9cbd4039-a793-4d59-a921-191ce08a9f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:09.955597 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd4039-a793-4d59-a921-191ce08a9f2a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:04:09.959104 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760f4b4-618e-4019-945a-b885b2f7c749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:04:09.959749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760f4b4-618e-4019-945a-b885b2f7c749 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:09.960123 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760f4b4-618e-4019-945a-b885b2f7c749 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:09.960408 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760f4b4-618e-4019-945a-b885b2f7c749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:09.970039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760f4b4-618e-4019-945a-b885b2f7c749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:04:09.971477 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760f4b4-618e-4019-945a-b885b2f7c749 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:04:09.981507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 772/1530] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:04:12.267961 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866679b1-1818-4e19-99d1-d4d19c37845c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:12.268553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866679b1-1818-4e19-99d1-d4d19c37845c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:12.268553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866679b1-1818-4e19-99d1-d4d19c37845c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:12.269911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 16:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:04:12.275676 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e7799-a236-410e-839e-7f2d94c360e4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:12.276120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e7799-a236-410e-839e-7f2d94c360e4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:12.276279 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e7799-a236-410e-839e-7f2d94c360e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:12.294577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b51e7799-a236-410e-839e-7f2d94c360e4 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:04:12.295779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b51e7799-a236-410e-839e-7f2d94c360e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:12.303550 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 16:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:04:12.339225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866679b1-1818-4e19-99d1-d4d19c37845c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:04:12.340916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-866679b1-1818-4e19-99d1-d4d19c37845c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:12.354437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866679b1-1818-4e19-99d1-d4d19c37845c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:04:12.357904 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed52e9c-bfc4-4450-a3d6-319ea0c245b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:04:12.358533 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed52e9c-bfc4-4450-a3d6-319ea0c245b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:12.358818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed52e9c-bfc4-4450-a3d6-319ea0c245b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:12.359095 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed52e9c-bfc4-4450-a3d6-319ea0c245b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:12.368156 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed52e9c-bfc4-4450-a3d6-319ea0c245b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:04:12.369718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed52e9c-bfc4-4450-a3d6-319ea0c245b0 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:04:12.379459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 760/1533] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:04:16.249807 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea606529-9cc0-45e2-a9d3-fb9b2417a855 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:16.250351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea606529-9cc0-45e2-a9d3-fb9b2417a855 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:16.250351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea606529-9cc0-45e2-a9d3-fb9b2417a855 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:16.251745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 16:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:04:16.257019 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044f78e-5eeb-47d7-b2a4-a709acfb7c30 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:16.257430 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044f78e-5eeb-47d7-b2a4-a709acfb7c30 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:16.258201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044f78e-5eeb-47d7-b2a4-a709acfb7c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:16.264788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:04:16.276457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8044f78e-5eeb-47d7-b2a4-a709acfb7c30 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:04:16.277704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8044f78e-5eeb-47d7-b2a4-a709acfb7c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:16.285527 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 16:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:04:16.556786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea606529-9cc0-45e2-a9d3-fb9b2417a855 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:04:16.558490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ea606529-9cc0-45e2-a9d3-fb9b2417a855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:16.564313 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=78 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:04:16.614927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea606529-9cc0-45e2-a9d3-fb9b2417a855 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:04:16.618520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9323df5-403d-42a0-8564-e2b09590464f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:04:16.619167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9323df5-403d-42a0-8564-e2b09590464f service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:16.619456 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9323df5-403d-42a0-8564-e2b09590464f service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:16.619738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9323df5-403d-42a0-8564-e2b09590464f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:16.628643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9323df5-403d-42a0-8564-e2b09590464f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:04:16.630079 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9323df5-403d-42a0-8564-e2b09590464f service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:04:16.639644 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 775/1536] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:04:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:04:18.875966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a477c1-7dd0-4b1e-ba0f-665eded1b41c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:18.876522 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a477c1-7dd0-4b1e-ba0f-665eded1b41c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:18.876648 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a477c1-7dd0-4b1e-ba0f-665eded1b41c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:18.877940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 16:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:04:18.883690 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803b00a-107d-481c-9d29-4518853323f3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:18.884123 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803b00a-107d-481c-9d29-4518853323f3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:18.884276 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803b00a-107d-481c-9d29-4518853323f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:18.902405 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5803b00a-107d-481c-9d29-4518853323f3 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:04:18.903590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5803b00a-107d-481c-9d29-4518853323f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:18.911233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 16:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:04:19.176851 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a477c1-7dd0-4b1e-ba0f-665eded1b41c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:04:19.178680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e5a477c1-7dd0-4b1e-ba0f-665eded1b41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:04:19.191731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a477c1-7dd0-4b1e-ba0f-665eded1b41c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:04:19.195606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e454a-bdb8-4b80-b81d-13c74b71a0e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:04:19.196262 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e454a-bdb8-4b80-b81d-13c74b71a0e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:04:19.196549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e454a-bdb8-4b80-b81d-13c74b71a0e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:04:19.196828 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e454a-bdb8-4b80-b81d-13c74b71a0e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:04:19.205715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e454a-bdb8-4b80-b81d-13c74b71a0e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:04:19.207175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e454a-bdb8-4b80-b81d-13c74b71a0e1 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:04:19.217203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 763/1539] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:04:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:04:28.897301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=28 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:04:29.213078 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=8 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:53.439169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ea2f4-dbd4-4985-b01a-0cc183391df5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:53.439811 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ea2f4-dbd4-4985-b01a-0cc183391df5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:53.439811 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ea2f4-dbd4-4985-b01a-0cc183391df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:53.470995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6a9ea2f4-dbd4-4985-b01a-0cc183391df5 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:53.472689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6a9ea2f4-dbd4-4985-b01a-0cc183391df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:53.486572 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 777/1540] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:53.497381 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ad585-e46f-41bb-a4a6-68e596d4db6b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:53.497975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ad585-e46f-41bb-a4a6-68e596d4db6b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:53.497975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ad585-e46f-41bb-a4a6-68e596d4db6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:53.528326 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cd4ad585-e46f-41bb-a4a6-68e596d4db6b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:53.529749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cd4ad585-e46f-41bb-a4a6-68e596d4db6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:53.539501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 764/1541] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:53.544901 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ea2f4-dbd4-4985-b01a-0cc183391df5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:53.560799 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ea2f4-dbd4-4985-b01a-0cc183391df5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:53.565748 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f1f9a-5c26-4333-b6c9-3f6500068fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:53.566430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f1f9a-5c26-4333-b6c9-3f6500068fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:53.566716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f1f9a-5c26-4333-b6c9-3f6500068fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:53.566997 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f1f9a-5c26-4333-b6c9-3f6500068fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:53.567732 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f1f9a-5c26-4333-b6c9-3f6500068fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:05:53.568085 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f1f9a-5c26-4333-b6c9-3f6500068fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:53.569764 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f1f9a-5c26-4333-b6c9-3f6500068fa2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:53.589238 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 778/1542] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:05:53.598353 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ad585-e46f-41bb-a4a6-68e596d4db6b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:53.620362 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ad585-e46f-41bb-a4a6-68e596d4db6b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:53.649330 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3934f-9241-4fa0-aab8-aff539a2000b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:53.650038 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3934f-9241-4fa0-aab8-aff539a2000b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:53.650327 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3934f-9241-4fa0-aab8-aff539a2000b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:53.650608 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3934f-9241-4fa0-aab8-aff539a2000b admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:53.651519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3934f-9241-4fa0-aab8-aff539a2000b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:53.654282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3934f-9241-4fa0-aab8-aff539a2000b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:53.818604 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 765/1543] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:05:53 2022] POST /identity/v3/projects => generated 373 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:53.823871 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f1f9a-5c26-4333-b6c9-3f6500068fa2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:53.844598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f1f9a-5c26-4333-b6c9-3f6500068fa2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:53.962415 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac31764-bc4c-4a51-aa06-aff49e6d6009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:53.963104 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac31764-bc4c-4a51-aa06-aff49e6d6009 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:53.963387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac31764-bc4c-4a51-aa06-aff49e6d6009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:53.963666 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac31764-bc4c-4a51-aa06-aff49e6d6009 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:53.964396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac31764-bc4c-4a51-aa06-aff49e6d6009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:53.966319 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac31764-bc4c-4a51-aa06-aff49e6d6009 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:54.029783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d309e9f-e421-4094-8603-41aa82557baa None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.030146 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d309e9f-e421-4094-8603-41aa82557baa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.030374 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d309e9f-e421-4094-8603-41aa82557baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.063325 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 779/1544] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:05:53 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:54.064722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41050ba0-c9d9-461c-813c-908e103b6965 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.065014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41050ba0-c9d9-461c-813c-908e103b6965 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.065141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5d309e9f-e421-4094-8603-41aa82557baa None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:54.065327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41050ba0-c9d9-461c-813c-908e103b6965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.066298 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5d309e9f-e421-4094-8603-41aa82557baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:54.081219 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 766/1545] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:05:54.082554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab3022-c276-40d6-8d31-68bafa1f62d3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.082846 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab3022-c276-40d6-8d31-68bafa1f62d3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.083132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab3022-c276-40d6-8d31-68bafa1f62d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.106164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-41050ba0-c9d9-461c-813c-908e103b6965 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:54.107397 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-41050ba0-c9d9-461c-813c-908e103b6965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:54.122165 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 780/1546] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:54.123165 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41050ba0-c9d9-461c-813c-908e103b6965 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:54.125083 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c0ab3022-c276-40d6-8d31-68bafa1f62d3 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:54.126325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c0ab3022-c276-40d6-8d31-68bafa1f62d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:54.138530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41050ba0-c9d9-461c-813c-908e103b6965 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:54.145210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 767/1547] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:54.146743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ad1ab-92e4-4513-839c-1aaa16f2d366 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.147041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ad1ab-92e4-4513-839c-1aaa16f2d366 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.147326 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ad1ab-92e4-4513-839c-1aaa16f2d366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.150266 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab248b4-1fc9-4772-b9e5-0052fdb1c113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:54.150952 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab248b4-1fc9-4772-b9e5-0052fdb1c113 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.151239 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab248b4-1fc9-4772-b9e5-0052fdb1c113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.151516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab248b4-1fc9-4772-b9e5-0052fdb1c113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.152274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab248b4-1fc9-4772-b9e5-0052fdb1c113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:54.153889 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab248b4-1fc9-4772-b9e5-0052fdb1c113 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:54.176340 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 781/1548] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:54.177699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc04f91-7827-4046-91c0-37790a27fca9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.177997 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc04f91-7827-4046-91c0-37790a27fca9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.178287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc04f91-7827-4046-91c0-37790a27fca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.187034 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-470ad1ab-92e4-4513-839c-1aaa16f2d366 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:54.188274 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-470ad1ab-92e4-4513-839c-1aaa16f2d366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:54.198539 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 768/1549] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:54.200081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574019b0-50c2-4179-98a3-01fe5bcb484d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.200384 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574019b0-50c2-4179-98a3-01fe5bcb484d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.200670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574019b0-50c2-4179-98a3-01fe5bcb484d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.207555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9fc04f91-7827-4046-91c0-37790a27fca9 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:54.209763 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9fc04f91-7827-4046-91c0-37790a27fca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:54.220821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 782/1550] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:54.222194 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaf6a3-60cb-4bbd-8a22-989a12cb9cf9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.222491 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaf6a3-60cb-4bbd-8a22-989a12cb9cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.222772 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaf6a3-60cb-4bbd-8a22-989a12cb9cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.228580 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-574019b0-50c2-4179-98a3-01fe5bcb484d None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:54.231256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-574019b0-50c2-4179-98a3-01fe5bcb484d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:54.242408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 769/1551] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:54.243332 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574019b0-50c2-4179-98a3-01fe5bcb484d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:54.247800 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-68aaf6a3-60cb-4bbd-8a22-989a12cb9cf9 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:54.249452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-68aaf6a3-60cb-4bbd-8a22-989a12cb9cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:54.253161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574019b0-50c2-4179-98a3-01fe5bcb484d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:54.258180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae50d5-54ae-4413-bec0-a6eeae2c3ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:54.258338 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 783/1552] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:54.258961 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae50d5-54ae-4413-bec0-a6eeae2c3ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.259248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae50d5-54ae-4413-bec0-a6eeae2c3ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.259523 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae50d5-54ae-4413-bec0-a6eeae2c3ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.259634 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7ff25-2c13-42ba-b940-b57675bc1baa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.259858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7ff25-2c13-42ba-b940-b57675bc1baa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.260251 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7ff25-2c13-42ba-b940-b57675bc1baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.260428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae50d5-54ae-4413-bec0-a6eeae2c3ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:54.262318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae50d5-54ae-4413-bec0-a6eeae2c3ecc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:54.272930 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 770/1553] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:54.274135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae50d5-54ae-4413-bec0-a6eeae2c3ecc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:54.279962 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7ba7ff25-2c13-42ba-b940-b57675bc1baa None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:54.281307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7ba7ff25-2c13-42ba-b940-b57675bc1baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:54.283621 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae50d5-54ae-4413-bec0-a6eeae2c3ecc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:54.288080 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2946ad-43fa-4d37-b3b4-fb9cde343a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:54.288747 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2946ad-43fa-4d37-b3b4-fb9cde343a4c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.289037 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2946ad-43fa-4d37-b3b4-fb9cde343a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.289453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2946ad-43fa-4d37-b3b4-fb9cde343a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.289576 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 784/1554] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:54.290103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2946ad-43fa-4d37-b3b4-fb9cde343a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:05:54.290232 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7ff25-2c13-42ba-b940-b57675bc1baa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:54.290424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2946ad-43fa-4d37-b3b4-fb9cde343a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:54.291428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-ac2946ad-43fa-4d37-b3b4-fb9cde343a4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:05:54.291428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: warnings.warn(msg) Jun 02 16:05:54.291428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: Jun 02 16:05:54.292326 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2946ad-43fa-4d37-b3b4-fb9cde343a4c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:54.304880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 771/1555] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:05:54.305795 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7ff25-2c13-42ba-b940-b57675bc1baa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:54.305926 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f39a62-b349-4843-b3b1-da4f20be6191 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.306221 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f39a62-b349-4843-b3b1-da4f20be6191 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.306501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f39a62-b349-4843-b3b1-da4f20be6191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.310376 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19533314-e88b-466e-98f0-0a6820307c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:54.311029 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19533314-e88b-466e-98f0-0a6820307c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.311317 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19533314-e88b-466e-98f0-0a6820307c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.311602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19533314-e88b-466e-98f0-0a6820307c26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.312349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19533314-e88b-466e-98f0-0a6820307c26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:05:54.312661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19533314-e88b-466e-98f0-0a6820307c26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:54.314437 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19533314-e88b-466e-98f0-0a6820307c26 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:54.324387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d1f39a62-b349-4843-b3b1-da4f20be6191 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:54.325579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d1f39a62-b349-4843-b3b1-da4f20be6191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:54.326641 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 785/1556] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:05:54.327864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59b778-9288-4979-a084-2e76c2c6fcde None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.328185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59b778-9288-4979-a084-2e76c2c6fcde None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.328469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59b778-9288-4979-a084-2e76c2c6fcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.333625 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 772/1557] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:54.334878 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3580fa-d881-4ded-99ce-83a7110c4417 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.335207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3580fa-d881-4ded-99ce-83a7110c4417 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.335485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3580fa-d881-4ded-99ce-83a7110c4417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.349963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ca59b778-9288-4979-a084-2e76c2c6fcde None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:54.351307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ca59b778-9288-4979-a084-2e76c2c6fcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:54.354338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ef3580fa-d881-4ded-99ce-83a7110c4417 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:54.355505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ef3580fa-d881-4ded-99ce-83a7110c4417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:54.359362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 786/1558] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:54.360051 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59b778-9288-4979-a084-2e76c2c6fcde None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:54.363189 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 773/1559] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:54.367914 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3580fa-d881-4ded-99ce-83a7110c4417 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:54.370767 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59b778-9288-4979-a084-2e76c2c6fcde None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:54.375822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c90dba-b8ad-482d-9ed2-576217738c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:54.376513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90dba-b8ad-482d-9ed2-576217738c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.376804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90dba-b8ad-482d-9ed2-576217738c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.377086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90dba-b8ad-482d-9ed2-576217738c83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.377293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3580fa-d881-4ded-99ce-83a7110c4417 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:54.377814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c90dba-b8ad-482d-9ed2-576217738c83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:05:54.378128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c90dba-b8ad-482d-9ed2-576217738c83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:54.379958 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c90dba-b8ad-482d-9ed2-576217738c83 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:54.381813 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236202c-4701-47c9-a98d-358899b606ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:54.383280 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236202c-4701-47c9-a98d-358899b606ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.383566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236202c-4701-47c9-a98d-358899b606ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.383841 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236202c-4701-47c9-a98d-358899b606ec admin admin] PATH_INFO: `/v3/projects/f7de75604a464c98b29f653454d9546c/users/77c0d3a0f1d2448e8e9745ba04837cd1/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.399817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 787/1560] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:05:54.399817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff290cfa-3b3e-474b-af52-ccb946cae1bb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.399817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff290cfa-3b3e-474b-af52-ccb946cae1bb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.399817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff290cfa-3b3e-474b-af52-ccb946cae1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.400316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236202c-4701-47c9-a98d-358899b606ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7de75604a464c98b29f653454d9546c, user_id=77c0d3a0f1d2448e8e9745ba04837cd1, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:54.401611 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236202c-4701-47c9-a98d-358899b606ec admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:54.416571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ff290cfa-3b3e-474b-af52-ccb946cae1bb None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:54.417850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ff290cfa-3b3e-474b-af52-ccb946cae1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:54.426073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 788/1561] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:54.426820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff290cfa-3b3e-474b-af52-ccb946cae1bb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:54.436647 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff290cfa-3b3e-474b-af52-ccb946cae1bb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:54.441370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27d5e0-78ba-4162-9358-983908c7f653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:54.442004 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d5e0-78ba-4162-9358-983908c7f653 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.442311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d5e0-78ba-4162-9358-983908c7f653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.442566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27d5e0-78ba-4162-9358-983908c7f653 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.443251 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27d5e0-78ba-4162-9358-983908c7f653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:54.444379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-ed27d5e0-78ba-4162-9358-983908c7f653 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:05:54.444379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: warnings.warn(msg) Jun 02 16:05:54.444379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: Jun 02 16:05:54.449045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27d5e0-78ba-4162-9358-983908c7f653 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:54.449234 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 774/1562] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:05:54 2022] PUT /identity/v3/projects/f7de75604a464c98b29f653454d9546c/users/77c0d3a0f1d2448e8e9745ba04837cd1/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:05:54.449339 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236202c-4701-47c9-a98d-358899b606ec admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:54.517858 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236202c-4701-47c9-a98d-358899b606ec admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:54.522220 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 789/1563] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:54.522607 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f89f49-246b-4b0a-9503-bb0aa797b9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:54.526341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f89f49-246b-4b0a-9503-bb0aa797b9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.526341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f89f49-246b-4b0a-9503-bb0aa797b9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.526545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15fa0e-9ca0-4242-82a6-76533a34b211 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.526648 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f89f49-246b-4b0a-9503-bb0aa797b9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.526739 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15fa0e-9ca0-4242-82a6-76533a34b211 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.526739 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15fa0e-9ca0-4242-82a6-76533a34b211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.526912 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f89f49-246b-4b0a-9503-bb0aa797b9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:54.526912 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f89f49-246b-4b0a-9503-bb0aa797b9e8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:54.543377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ec15fa0e-9ca0-4242-82a6-76533a34b211 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:54.544617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ec15fa0e-9ca0-4242-82a6-76533a34b211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:54.570175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:54.604189 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 775/1564] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:54.604831 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 790/1565] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:54.605211 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f89f49-246b-4b0a-9503-bb0aa797b9e8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:54.606407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ddbcb-e967-4ba7-b7b9-b728ccb02601 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.606695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ddbcb-e967-4ba7-b7b9-b728ccb02601 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.606982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ddbcb-e967-4ba7-b7b9-b728ccb02601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.625719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3a1ddbcb-e967-4ba7-b7b9-b728ccb02601 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:54.626971 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3a1ddbcb-e967-4ba7-b7b9-b728ccb02601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:54.637025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:54.673422 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f89f49-246b-4b0a-9503-bb0aa797b9e8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:54.678899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e626abe-0748-4d1b-b547-446fecd2b965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:54.679809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e626abe-0748-4d1b-b547-446fecd2b965 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.679962 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e626abe-0748-4d1b-b547-446fecd2b965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.680253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e626abe-0748-4d1b-b547-446fecd2b965 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.680983 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e626abe-0748-4d1b-b547-446fecd2b965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:05:54.681291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e626abe-0748-4d1b-b547-446fecd2b965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:54.682905 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e626abe-0748-4d1b-b547-446fecd2b965 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:54.689182 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 791/1566] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:54.690492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ddbcb-e967-4ba7-b7b9-b728ccb02601 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:54.702457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 776/1567] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:05:54.702457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e626abe-0748-4d1b-b547-446fecd2b965 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:54.706677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e626abe-0748-4d1b-b547-446fecd2b965 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:54.708312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ddbcb-e967-4ba7-b7b9-b728ccb02601 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:54.712162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20264f54-8ca8-4225-a0f2-a57e4e21b9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:54.715741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20264f54-8ca8-4225-a0f2-a57e4e21b9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.715741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20264f54-8ca8-4225-a0f2-a57e4e21b9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.715741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20264f54-8ca8-4225-a0f2-a57e4e21b9fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.716170 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52725364-5fc7-4677-ae3d-7d9647f5c971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:54.716286 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20264f54-8ca8-4225-a0f2-a57e4e21b9fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:05:54.716381 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52725364-5fc7-4677-ae3d-7d9647f5c971 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.716480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20264f54-8ca8-4225-a0f2-a57e4e21b9fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:54.716571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52725364-5fc7-4677-ae3d-7d9647f5c971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.716571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52725364-5fc7-4677-ae3d-7d9647f5c971 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.716571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52725364-5fc7-4677-ae3d-7d9647f5c971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:54.716822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20264f54-8ca8-4225-a0f2-a57e4e21b9fe admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:54.717311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52725364-5fc7-4677-ae3d-7d9647f5c971 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:54.727850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 777/1568] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:05:54.729234 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b893051-b20d-4c63-85f2-59df08a1b764 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.729525 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b893051-b20d-4c63-85f2-59df08a1b764 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.729807 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b893051-b20d-4c63-85f2-59df08a1b764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.758766 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4b893051-b20d-4c63-85f2-59df08a1b764 None None] MFA Rules not processed for user `77c0d3a0f1d2448e8e9745ba04837cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:54.760036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4b893051-b20d-4c63-85f2-59df08a1b764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:54.789035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 792/1569] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:54.789035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52725364-5fc7-4677-ae3d-7d9647f5c971 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:54.829043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 778/1570] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:54.830255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b893051-b20d-4c63-85f2-59df08a1b764 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:54.843048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b893051-b20d-4c63-85f2-59df08a1b764 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:54.847698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3fdee-9823-4225-b457-cb0799606acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:54.848400 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3fdee-9823-4225-b457-cb0799606acd admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.848683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3fdee-9823-4225-b457-cb0799606acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.848964 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3fdee-9823-4225-b457-cb0799606acd admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.849653 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3fdee-9823-4225-b457-cb0799606acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:54.850698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-65e3fdee-9823-4225-b457-cb0799606acd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:05:54.850698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: warnings.warn(msg) Jun 02 16:05:54.850698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: Jun 02 16:05:54.851904 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3fdee-9823-4225-b457-cb0799606acd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:54.855212 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52725364-5fc7-4677-ae3d-7d9647f5c971 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:54.860084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58710006-4fad-4375-a3db-2b5b56da2ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:54.860762 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58710006-4fad-4375-a3db-2b5b56da2ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.861393 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58710006-4fad-4375-a3db-2b5b56da2ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.861676 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58710006-4fad-4375-a3db-2b5b56da2ff6 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.862529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58710006-4fad-4375-a3db-2b5b56da2ff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:54.864629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58710006-4fad-4375-a3db-2b5b56da2ff6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:54.953840 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 779/1571] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:54.953840 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3fdee-9823-4225-b457-cb0799606acd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:54.961715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3fdee-9823-4225-b457-cb0799606acd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:54.966466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce2df1-9f19-4ac5-b1d1-01fd272a956f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:54.967100 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce2df1-9f19-4ac5-b1d1-01fd272a956f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.967383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce2df1-9f19-4ac5-b1d1-01fd272a956f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.967662 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce2df1-9f19-4ac5-b1d1-01fd272a956f admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.968408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce2df1-9f19-4ac5-b1d1-01fd272a956f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:05:54.968736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce2df1-9f19-4ac5-b1d1-01fd272a956f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:54.970602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce2df1-9f19-4ac5-b1d1-01fd272a956f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:54.978689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 793/1572] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:54.979584 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58710006-4fad-4375-a3db-2b5b56da2ff6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:54.984820 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 780/1573] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:05:54.986301 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce2df1-9f19-4ac5-b1d1-01fd272a956f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:54.990209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58710006-4fad-4375-a3db-2b5b56da2ff6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:54.995897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adee7e7-d7fa-4bbc-a3aa-3534d9f22933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:54.996668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adee7e7-d7fa-4bbc-a3aa-3534d9f22933 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:54.996957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adee7e7-d7fa-4bbc-a3aa-3534d9f22933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:54.997128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce2df1-9f19-4ac5-b1d1-01fd272a956f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:54.997237 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adee7e7-d7fa-4bbc-a3aa-3534d9f22933 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:54.997959 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adee7e7-d7fa-4bbc-a3aa-3534d9f22933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:05:54.998270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adee7e7-d7fa-4bbc-a3aa-3534d9f22933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.000089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adee7e7-d7fa-4bbc-a3aa-3534d9f22933 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.001852 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c67dd-6745-4ae7-bb93-dbe2bfcdd0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.002512 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c67dd-6745-4ae7-bb93-dbe2bfcdd0ad admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.002799 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c67dd-6745-4ae7-bb93-dbe2bfcdd0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.003074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c67dd-6745-4ae7-bb93-dbe2bfcdd0ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.003809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c67dd-6745-4ae7-bb93-dbe2bfcdd0ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.005695 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c67dd-6745-4ae7-bb93-dbe2bfcdd0ad admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.014770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 794/1574] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:05:55.015933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adee7e7-d7fa-4bbc-a3aa-3534d9f22933 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.031506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adee7e7-d7fa-4bbc-a3aa-3534d9f22933 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.036184 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205c9fa-b36e-4378-82c8-96671115eee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.038491 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205c9fa-b36e-4378-82c8-96671115eee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.038491 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205c9fa-b36e-4378-82c8-96671115eee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.038491 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205c9fa-b36e-4378-82c8-96671115eee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.038491 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205c9fa-b36e-4378-82c8-96671115eee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.040025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205c9fa-b36e-4378-82c8-96671115eee0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.093316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 781/1575] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:05:54 2022] POST /identity/v3/projects => generated 403 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:55.094133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c67dd-6745-4ae7-bb93-dbe2bfcdd0ad admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.122441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 795/1576] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:05:55 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:55.123273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205c9fa-b36e-4378-82c8-96671115eee0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.129227 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:55.144728 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:55.159347 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c67dd-6745-4ae7-bb93-dbe2bfcdd0ad admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.186745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205c9fa-b36e-4378-82c8-96671115eee0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.191410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba927a-5d99-4442-8e08-dff3674307b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.192128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba927a-5d99-4442-8e08-dff3674307b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.192415 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba927a-5d99-4442-8e08-dff3674307b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.192696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba927a-5d99-4442-8e08-dff3674307b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.193403 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba927a-5d99-4442-8e08-dff3674307b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.195892 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba927a-5d99-4442-8e08-dff3674307b9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.218112 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85143ad-3af7-42ee-a4b4-766a9b105ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.218738 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85143ad-3af7-42ee-a4b4-766a9b105ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.219028 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85143ad-3af7-42ee-a4b4-766a9b105ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.219345 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85143ad-3af7-42ee-a4b4-766a9b105ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.220105 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85143ad-3af7-42ee-a4b4-766a9b105ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.222065 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85143ad-3af7-42ee-a4b4-766a9b105ae2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.266609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 796/1577] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:05:55 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:55.267661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba927a-5d99-4442-8e08-dff3674307b9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.309017 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 782/1578] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:05:55 2022] POST /identity/v3/users => generated 284 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:55.309017 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85143ad-3af7-42ee-a4b4-766a9b105ae2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.317185 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85143ad-3af7-42ee-a4b4-766a9b105ae2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.330804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba927a-5d99-4442-8e08-dff3674307b9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.335515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587d320-3486-48ec-a305-2da12486a286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.336221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587d320-3486-48ec-a305-2da12486a286 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.336507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587d320-3486-48ec-a305-2da12486a286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.338370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587d320-3486-48ec-a305-2da12486a286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.338370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587d320-3486-48ec-a305-2da12486a286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.339307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587d320-3486-48ec-a305-2da12486a286 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.349389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 797/1579] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:55.350179 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587d320-3486-48ec-a305-2da12486a286 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.362693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587d320-3486-48ec-a305-2da12486a286 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.371876 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7dc9-654b-4138-b2a5-19ae0fc7aafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.372570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7dc9-654b-4138-b2a5-19ae0fc7aafd admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.372861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7dc9-654b-4138-b2a5-19ae0fc7aafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.373153 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7dc9-654b-4138-b2a5-19ae0fc7aafd admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.373851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff7dc9-654b-4138-b2a5-19ae0fc7aafd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.375757 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff7dc9-654b-4138-b2a5-19ae0fc7aafd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.376182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fa277-88ca-44c0-8f33-64ee4718cb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.376882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fa277-88ca-44c0-8f33-64ee4718cb79 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.377174 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fa277-88ca-44c0-8f33-64ee4718cb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.377457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fa277-88ca-44c0-8f33-64ee4718cb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.378180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fa277-88ca-44c0-8f33-64ee4718cb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.379782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fa277-88ca-44c0-8f33-64ee4718cb79 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.389838 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 783/1580] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:55.390883 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fa277-88ca-44c0-8f33-64ee4718cb79 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.400182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fa277-88ca-44c0-8f33-64ee4718cb79 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.404646 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf271d9-01c9-41ff-a400-aabc9a3c584e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.405259 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf271d9-01c9-41ff-a400-aabc9a3c584e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.405549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf271d9-01c9-41ff-a400-aabc9a3c584e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.405831 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf271d9-01c9-41ff-a400-aabc9a3c584e admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.406498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf271d9-01c9-41ff-a400-aabc9a3c584e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.408391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf271d9-01c9-41ff-a400-aabc9a3c584e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.477485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 798/1581] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:05:55 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:55.478235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7dc9-654b-4138-b2a5-19ae0fc7aafd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.489079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 784/1582] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:05:55 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:55.490278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf271d9-01c9-41ff-a400-aabc9a3c584e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.542073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7dc9-654b-4138-b2a5-19ae0fc7aafd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.548233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:55.549621 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:55.551912 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf271d9-01c9-41ff-a400-aabc9a3c584e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.557280 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf52264-b55a-48de-8622-026c87ea8be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.557946 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf52264-b55a-48de-8622-026c87ea8be9 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.558234 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf52264-b55a-48de-8622-026c87ea8be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.558512 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf52264-b55a-48de-8622-026c87ea8be9 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.559197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf52264-b55a-48de-8622-026c87ea8be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.561203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf52264-b55a-48de-8622-026c87ea8be9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.597941 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399a8b8-b6fe-4722-a7e6-302f8a501c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.598622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399a8b8-b6fe-4722-a7e6-302f8a501c46 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.598931 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399a8b8-b6fe-4722-a7e6-302f8a501c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.599197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399a8b8-b6fe-4722-a7e6-302f8a501c46 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.599888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399a8b8-b6fe-4722-a7e6-302f8a501c46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.602475 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399a8b8-b6fe-4722-a7e6-302f8a501c46 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.624356 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 785/1583] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:05:55 2022] POST /identity/v3/users => generated 295 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:55.625250 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf52264-b55a-48de-8622-026c87ea8be9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.634684 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf52264-b55a-48de-8622-026c87ea8be9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.644437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a6c36-1f9b-494e-b704-56efe46e7b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.644437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a6c36-1f9b-494e-b704-56efe46e7b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.644437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a6c36-1f9b-494e-b704-56efe46e7b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.644437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a6c36-1f9b-494e-b704-56efe46e7b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.644843 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a6c36-1f9b-494e-b704-56efe46e7b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.644843 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a6c36-1f9b-494e-b704-56efe46e7b39 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.697347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 799/1584] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:05:55 2022] POST /identity/v3/users => generated 302 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:55.698174 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399a8b8-b6fe-4722-a7e6-302f8a501c46 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.707228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399a8b8-b6fe-4722-a7e6-302f8a501c46 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.712335 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5daf6e-be58-40b5-b111-5cfa21079dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.713334 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5daf6e-be58-40b5-b111-5cfa21079dec admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.713334 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5daf6e-be58-40b5-b111-5cfa21079dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.713564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5daf6e-be58-40b5-b111-5cfa21079dec admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.714191 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5daf6e-be58-40b5-b111-5cfa21079dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.715768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5daf6e-be58-40b5-b111-5cfa21079dec admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.721801 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 786/1585] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:05:55 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:55.722631 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a6c36-1f9b-494e-b704-56efe46e7b39 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.725524 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 800/1586] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:55.726947 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5daf6e-be58-40b5-b111-5cfa21079dec admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.733300 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a6c36-1f9b-494e-b704-56efe46e7b39 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.736172 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5daf6e-be58-40b5-b111-5cfa21079dec admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.738089 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d88a22-d612-478e-a8ba-ffeb88a21feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.738747 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d88a22-d612-478e-a8ba-ffeb88a21feb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.739041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d88a22-d612-478e-a8ba-ffeb88a21feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.739326 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d88a22-d612-478e-a8ba-ffeb88a21feb admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.740074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d88a22-d612-478e-a8ba-ffeb88a21feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.741675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d88a22-d612-478e-a8ba-ffeb88a21feb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.741965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdcbef-967c-4706-ba6a-9fffad019235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.742620 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdcbef-967c-4706-ba6a-9fffad019235 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.742908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdcbef-967c-4706-ba6a-9fffad019235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.743189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdcbef-967c-4706-ba6a-9fffad019235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.743898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdcbef-967c-4706-ba6a-9fffad019235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.745643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdcbef-967c-4706-ba6a-9fffad019235 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.752667 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 787/1587] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:55.753495 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d88a22-d612-478e-a8ba-ffeb88a21feb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.759542 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 801/1588] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:55.759542 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdcbef-967c-4706-ba6a-9fffad019235 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.763633 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d88a22-d612-478e-a8ba-ffeb88a21feb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.767768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdcbef-967c-4706-ba6a-9fffad019235 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.770356 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff34b5-6f50-4a2f-8dfe-836ec23c5583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.771014 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff34b5-6f50-4a2f-8dfe-836ec23c5583 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.771302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff34b5-6f50-4a2f-8dfe-836ec23c5583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.771579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff34b5-6f50-4a2f-8dfe-836ec23c5583 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.772291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff34b5-6f50-4a2f-8dfe-836ec23c5583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.772996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48309dc7-17da-49aa-9259-45b4657cead3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.773726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48309dc7-17da-49aa-9259-45b4657cead3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.774012 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48309dc7-17da-49aa-9259-45b4657cead3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.774288 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48309dc7-17da-49aa-9259-45b4657cead3 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.774802 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff34b5-6f50-4a2f-8dfe-836ec23c5583 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.774986 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48309dc7-17da-49aa-9259-45b4657cead3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.776883 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48309dc7-17da-49aa-9259-45b4657cead3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.859286 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 788/1589] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:05:55 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:55.860217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff34b5-6f50-4a2f-8dfe-836ec23c5583 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.869809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff34b5-6f50-4a2f-8dfe-836ec23c5583 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.874428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751ba38-5021-4b64-8da1-4bf166c310f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.875113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751ba38-5021-4b64-8da1-4bf166c310f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.875403 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751ba38-5021-4b64-8da1-4bf166c310f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.875807 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751ba38-5021-4b64-8da1-4bf166c310f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.876557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751ba38-5021-4b64-8da1-4bf166c310f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.878161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751ba38-5021-4b64-8da1-4bf166c310f1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.882329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 802/1590] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:05:55 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:55.883231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48309dc7-17da-49aa-9259-45b4657cead3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.893505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 789/1591] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:55.893505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751ba38-5021-4b64-8da1-4bf166c310f1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.896106 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48309dc7-17da-49aa-9259-45b4657cead3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.901277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68791a1e-d9c9-41cc-9637-ae8e8b3e6d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.901870 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751ba38-5021-4b64-8da1-4bf166c310f1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.901994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68791a1e-d9c9-41cc-9637-ae8e8b3e6d74 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.902234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68791a1e-d9c9-41cc-9637-ae8e8b3e6d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.902589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68791a1e-d9c9-41cc-9637-ae8e8b3e6d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.903225 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68791a1e-d9c9-41cc-9637-ae8e8b3e6d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.904966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68791a1e-d9c9-41cc-9637-ae8e8b3e6d74 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.906761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5781d8b-24c5-4510-8731-12629c703f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.907737 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5781d8b-24c5-4510-8731-12629c703f8c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.908051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5781d8b-24c5-4510-8731-12629c703f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.908358 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5781d8b-24c5-4510-8731-12629c703f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.909052 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5781d8b-24c5-4510-8731-12629c703f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.910615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5781d8b-24c5-4510-8731-12629c703f8c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.915490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 803/1592] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:55.916308 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68791a1e-d9c9-41cc-9637-ae8e8b3e6d74 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.924142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 790/1593] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:55.924924 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5781d8b-24c5-4510-8731-12629c703f8c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.925737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68791a1e-d9c9-41cc-9637-ae8e8b3e6d74 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.930688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e69b91-3889-4cec-a25f-5b1b75c2d85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.931326 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e69b91-3889-4cec-a25f-5b1b75c2d85b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.931609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e69b91-3889-4cec-a25f-5b1b75c2d85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.931883 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e69b91-3889-4cec-a25f-5b1b75c2d85b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.932646 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e69b91-3889-4cec-a25f-5b1b75c2d85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.934227 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e69b91-3889-4cec-a25f-5b1b75c2d85b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.936254 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5781d8b-24c5-4510-8731-12629c703f8c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.940824 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930e3b2-bb06-4285-915b-f97a804dc75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.941691 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930e3b2-bb06-4285-915b-f97a804dc75b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.941982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930e3b2-bb06-4285-915b-f97a804dc75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.942263 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930e3b2-bb06-4285-915b-f97a804dc75b admin admin] PATH_INFO: `/v3/projects/013e943c1aea4902b5a3b8f271fdc98c/users/fb70aacb7cfb41cea6a65a084e705ecf/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.945907 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 804/1594] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:55.945907 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e69b91-3889-4cec-a25f-5b1b75c2d85b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:55.957166 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930e3b2-bb06-4285-915b-f97a804dc75b admin admin] RBAC: Authorizing `identity:create_grant(project_id=013e943c1aea4902b5a3b8f271fdc98c, user_id=fb70aacb7cfb41cea6a65a084e705ecf, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.957864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e69b91-3889-4cec-a25f-5b1b75c2d85b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:55.959811 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930e3b2-bb06-4285-915b-f97a804dc75b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:55.963306 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c33fce-efff-434b-a47f-88367dd5263d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:55.964314 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c33fce-efff-434b-a47f-88367dd5263d admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:55.964499 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c33fce-efff-434b-a47f-88367dd5263d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:55.964776 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c33fce-efff-434b-a47f-88367dd5263d admin admin] PATH_INFO: `/v3/projects/3d34b78aa10a465bbdf15d704b57855a/users/2a972defd2a841768633fac694002d32/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:55.979063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c33fce-efff-434b-a47f-88367dd5263d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d34b78aa10a465bbdf15d704b57855a, user_id=2a972defd2a841768633fac694002d32, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:55.980163 dv-cinder-797608-27-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-35c33fce-efff-434b-a47f-88367dd5263d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:05:55.980163 dv-cinder-797608-27-smb devstack@keystone.service[80315]: warnings.warn(msg) Jun 02 16:05:55.980163 dv-cinder-797608-27-smb devstack@keystone.service[80315]: Jun 02 16:05:55.982064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c33fce-efff-434b-a47f-88367dd5263d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:56.048283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 791/1595] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:05:55 2022] PUT /identity/v3/projects/013e943c1aea4902b5a3b8f271fdc98c/users/fb70aacb7cfb41cea6a65a084e705ecf/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:05:56.049156 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930e3b2-bb06-4285-915b-f97a804dc75b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:56.059099 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 805/1596] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:05:55 2022] PUT /identity/v3/projects/3d34b78aa10a465bbdf15d704b57855a/users/2a972defd2a841768633fac694002d32/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:05:56.060509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c33fce-efff-434b-a47f-88367dd5263d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:56.111834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930e3b2-bb06-4285-915b-f97a804dc75b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:56.122022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c33fce-efff-434b-a47f-88367dd5263d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:56.126551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2931c-105c-4f5e-9c79-449e70be929b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:56.127210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2931c-105c-4f5e-9c79-449e70be929b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.127495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2931c-105c-4f5e-9c79-449e70be929b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.127773 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2931c-105c-4f5e-9c79-449e70be929b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.128520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2931c-105c-4f5e-9c79-449e70be929b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:56.130120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2931c-105c-4f5e-9c79-449e70be929b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:56.140237 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 806/1597] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:56.141285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2931c-105c-4f5e-9c79-449e70be929b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:56.150937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2931c-105c-4f5e-9c79-449e70be929b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:56.155499 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a620e-aabe-461e-a216-2ecb18846106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:56.156171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a620e-aabe-461e-a216-2ecb18846106 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.156457 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a620e-aabe-461e-a216-2ecb18846106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.156734 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a620e-aabe-461e-a216-2ecb18846106 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.157435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a620e-aabe-461e-a216-2ecb18846106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:56.158990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a620e-aabe-461e-a216-2ecb18846106 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:56.164167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:56.170519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 807/1598] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:56.170519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a620e-aabe-461e-a216-2ecb18846106 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:56.170743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fade1cd-ddf7-4000-9e88-b885cf56de70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:56.177178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fade1cd-ddf7-4000-9e88-b885cf56de70 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.177178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fade1cd-ddf7-4000-9e88-b885cf56de70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.177178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fade1cd-ddf7-4000-9e88-b885cf56de70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.177178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fade1cd-ddf7-4000-9e88-b885cf56de70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:56.177178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fade1cd-ddf7-4000-9e88-b885cf56de70 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:56.177178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:56.179756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a620e-aabe-461e-a216-2ecb18846106 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:56.184352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b82d2-7da4-4fa1-b5c8-2f0b790942ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:56.184991 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b82d2-7da4-4fa1-b5c8-2f0b790942ef admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.185279 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b82d2-7da4-4fa1-b5c8-2f0b790942ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.185557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b82d2-7da4-4fa1-b5c8-2f0b790942ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.186269 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b82d2-7da4-4fa1-b5c8-2f0b790942ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:56.186716 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 792/1599] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:56.187302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fade1cd-ddf7-4000-9e88-b885cf56de70 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:56.187978 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b82d2-7da4-4fa1-b5c8-2f0b790942ef admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:56.197478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fade1cd-ddf7-4000-9e88-b885cf56de70 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:56.201062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 808/1600] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:56.201062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b82d2-7da4-4fa1-b5c8-2f0b790942ef admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:56.205668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fef1e-f945-455a-90e4-90d8ad7e7917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:56.205668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fef1e-f945-455a-90e4-90d8ad7e7917 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.205668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fef1e-f945-455a-90e4-90d8ad7e7917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.205668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fef1e-f945-455a-90e4-90d8ad7e7917 admin admin] PATH_INFO: `/v3/projects/84e0cd3ea6e249e88a18a89d269ba8a6/users/13b426034e9145c7b48cb8099ab1c83b/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.210696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b82d2-7da4-4fa1-b5c8-2f0b790942ef admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:56.215278 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea44ef6-fcc0-449b-9eee-78225d235086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:56.216180 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea44ef6-fcc0-449b-9eee-78225d235086 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.216475 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea44ef6-fcc0-449b-9eee-78225d235086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.216746 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea44ef6-fcc0-449b-9eee-78225d235086 admin admin] PATH_INFO: `/v3/projects/cd83e009a756435a935ceaa3d22fdd92/users/83265e9131af4bd28fb2eb98399e0441/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.220281 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fef1e-f945-455a-90e4-90d8ad7e7917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e0cd3ea6e249e88a18a89d269ba8a6, user_id=13b426034e9145c7b48cb8099ab1c83b, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:56.223146 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fef1e-f945-455a-90e4-90d8ad7e7917 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:56.230869 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea44ef6-fcc0-449b-9eee-78225d235086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd83e009a756435a935ceaa3d22fdd92, user_id=83265e9131af4bd28fb2eb98399e0441, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:56.233537 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea44ef6-fcc0-449b-9eee-78225d235086 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:56.321401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 793/1601] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:05:56 2022] PUT /identity/v3/projects/84e0cd3ea6e249e88a18a89d269ba8a6/users/13b426034e9145c7b48cb8099ab1c83b/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:05:56.322861 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c007af-c631-4990-af8b-760f5dfb69b6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.323157 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c007af-c631-4990-af8b-760f5dfb69b6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.323440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c007af-c631-4990-af8b-760f5dfb69b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.334544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 809/1602] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:05:56 2022] PUT /identity/v3/projects/cd83e009a756435a935ceaa3d22fdd92/users/83265e9131af4bd28fb2eb98399e0441/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:05:56.336786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489b0bb-e4ac-4ab5-a0bb-051298be9046 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.337166 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489b0bb-e4ac-4ab5-a0bb-051298be9046 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.337510 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489b0bb-e4ac-4ab5-a0bb-051298be9046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.349908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c2c007af-c631-4990-af8b-760f5dfb69b6 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:56.351289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c2c007af-c631-4990-af8b-760f5dfb69b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:56.354811 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1489b0bb-e4ac-4ab5-a0bb-051298be9046 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:56.356859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1489b0bb-e4ac-4ab5-a0bb-051298be9046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:56.412237 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 794/1603] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:56.415071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c007af-c631-4990-af8b-760f5dfb69b6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:56.422385 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c007af-c631-4990-af8b-760f5dfb69b6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:56.424291 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 810/1604] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:56.424466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489b0bb-e4ac-4ab5-a0bb-051298be9046 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:56.430142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac767de-4c32-4067-9e7e-398ba8ce0d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:56.431139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac767de-4c32-4067-9e7e-398ba8ce0d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.431139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac767de-4c32-4067-9e7e-398ba8ce0d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.431343 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac767de-4c32-4067-9e7e-398ba8ce0d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.432118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac767de-4c32-4067-9e7e-398ba8ce0d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:56.433717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac767de-4c32-4067-9e7e-398ba8ce0d10 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:56.435131 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489b0bb-e4ac-4ab5-a0bb-051298be9046 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:56.440047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded40a34-0200-439d-b862-f73c6b4bdc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:56.440932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded40a34-0200-439d-b862-f73c6b4bdc0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.441340 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded40a34-0200-439d-b862-f73c6b4bdc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.441627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded40a34-0200-439d-b862-f73c6b4bdc0f admin admin] PATH_INFO: `/v3/projects/c1c05fb09f254ceaa36692a0c5b96013/users/3913e5416fd742509fe6b431261e2620/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.447631 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 795/1605] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:56.447631 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac767de-4c32-4067-9e7e-398ba8ce0d10 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:56.455509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac767de-4c32-4067-9e7e-398ba8ce0d10 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:56.456248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded40a34-0200-439d-b862-f73c6b4bdc0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c05fb09f254ceaa36692a0c5b96013, user_id=3913e5416fd742509fe6b431261e2620, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:56.458918 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded40a34-0200-439d-b862-f73c6b4bdc0f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:56.460556 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47c4ee-33e8-4937-8ff5-af690eefba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:56.461194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47c4ee-33e8-4937-8ff5-af690eefba77 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.461477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47c4ee-33e8-4937-8ff5-af690eefba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.461753 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47c4ee-33e8-4937-8ff5-af690eefba77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.462457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47c4ee-33e8-4937-8ff5-af690eefba77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:56.464059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47c4ee-33e8-4937-8ff5-af690eefba77 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:56.473773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 796/1606] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:56.474523 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47c4ee-33e8-4937-8ff5-af690eefba77 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:56.484470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47c4ee-33e8-4937-8ff5-af690eefba77 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:56.494315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5205f60-3fcb-4b76-9bef-c8769d458753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:56.494315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5205f60-3fcb-4b76-9bef-c8769d458753 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.494315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5205f60-3fcb-4b76-9bef-c8769d458753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.494315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5205f60-3fcb-4b76-9bef-c8769d458753 admin admin] PATH_INFO: `/v3/projects/e7277fbc6476486399f69560868d7efe/users/7cabdda6aa6649e98f218bfbf5dd5812/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.505112 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5205f60-3fcb-4b76-9bef-c8769d458753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7277fbc6476486399f69560868d7efe, user_id=7cabdda6aa6649e98f218bfbf5dd5812, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:56.508620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5205f60-3fcb-4b76-9bef-c8769d458753 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:56.544936 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 811/1607] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:05:56 2022] PUT /identity/v3/projects/c1c05fb09f254ceaa36692a0c5b96013/users/3913e5416fd742509fe6b431261e2620/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:05:56.545777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded40a34-0200-439d-b862-f73c6b4bdc0f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:56.567706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 797/1608] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:05:56 2022] PUT /identity/v3/projects/e7277fbc6476486399f69560868d7efe/users/7cabdda6aa6649e98f218bfbf5dd5812/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:05:56.569093 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326429ed-d6cf-46b6-b6f0-b186c4ae1115 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.569413 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326429ed-d6cf-46b6-b6f0-b186c4ae1115 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.570402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326429ed-d6cf-46b6-b6f0-b186c4ae1115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.596416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-326429ed-d6cf-46b6-b6f0-b186c4ae1115 None None] MFA Rules not processed for user `83265e9131af4bd28fb2eb98399e0441`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:56.597607 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-326429ed-d6cf-46b6-b6f0-b186c4ae1115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:56.617299 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded40a34-0200-439d-b862-f73c6b4bdc0f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:56.661336 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:56.665148 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 798/1609] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:56.666006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326429ed-d6cf-46b6-b6f0-b186c4ae1115 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:56.673992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f26276-21b7-498f-a4ff-c9b2a7223ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:56.674503 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f26276-21b7-498f-a4ff-c9b2a7223ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.674797 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f26276-21b7-498f-a4ff-c9b2a7223ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.675081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f26276-21b7-498f-a4ff-c9b2a7223ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.676066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f26276-21b7-498f-a4ff-c9b2a7223ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:56.677812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f26276-21b7-498f-a4ff-c9b2a7223ef6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:56.686123 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:56.691407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 812/1610] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:56.691407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f26276-21b7-498f-a4ff-c9b2a7223ef6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:56.719997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326429ed-d6cf-46b6-b6f0-b186c4ae1115 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:56.723620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f13b6a-307c-4121-a252-1067b60dd8b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:56.724298 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f13b6a-307c-4121-a252-1067b60dd8b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.724605 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f13b6a-307c-4121-a252-1067b60dd8b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.726062 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f13b6a-307c-4121-a252-1067b60dd8b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.734847 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f13b6a-307c-4121-a252-1067b60dd8b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:56.740610 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f13b6a-307c-4121-a252-1067b60dd8b5 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:56.745616 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f26276-21b7-498f-a4ff-c9b2a7223ef6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:56.746799 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 799/1611] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:05:56.747640 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f13b6a-307c-4121-a252-1067b60dd8b5 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:56.749412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f24f8-00b1-4ec5-b287-13a8a37e0c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:56.750064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f24f8-00b1-4ec5-b287-13a8a37e0c69 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.750366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f24f8-00b1-4ec5-b287-13a8a37e0c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.750638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f24f8-00b1-4ec5-b287-13a8a37e0c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.756713 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f13b6a-307c-4121-a252-1067b60dd8b5 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:56.761788 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f24f8-00b1-4ec5-b287-13a8a37e0c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:56.763017 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d67a2e-fa38-4f89-8bd6-d9d3ba92a936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:56.763250 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f24f8-00b1-4ec5-b287-13a8a37e0c69 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:56.763904 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d67a2e-fa38-4f89-8bd6-d9d3ba92a936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.764248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d67a2e-fa38-4f89-8bd6-d9d3ba92a936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.764522 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d67a2e-fa38-4f89-8bd6-d9d3ba92a936 admin admin] PATH_INFO: `/v3/projects/6d3a860bca7b4064a33db0bbe8380c0a/users/51247285170642698dd2c4567d7bd6cb/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.777411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 813/1612] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:05:56.778453 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f24f8-00b1-4ec5-b287-13a8a37e0c69 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:56.780617 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d67a2e-fa38-4f89-8bd6-d9d3ba92a936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3a860bca7b4064a33db0bbe8380c0a, user_id=51247285170642698dd2c4567d7bd6cb, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:56.783398 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d67a2e-fa38-4f89-8bd6-d9d3ba92a936 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:56.787655 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f24f8-00b1-4ec5-b287-13a8a37e0c69 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:56.792307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1e7f5-6f9a-4907-9a65-edd21a97d59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:56.793180 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1e7f5-6f9a-4907-9a65-edd21a97d59f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.793464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1e7f5-6f9a-4907-9a65-edd21a97d59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.793746 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1e7f5-6f9a-4907-9a65-edd21a97d59f admin admin] PATH_INFO: `/v3/projects/19ef47eb9ce944639041b3a0a25754a6/users/8b3b2642956d492aad62dba8194a13d5/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.808953 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1e7f5-6f9a-4907-9a65-edd21a97d59f admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ef47eb9ce944639041b3a0a25754a6, user_id=8b3b2642956d492aad62dba8194a13d5, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:56.811579 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1e7f5-6f9a-4907-9a65-edd21a97d59f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:56.905039 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 800/1613] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:05:56 2022] PUT /identity/v3/projects/6d3a860bca7b4064a33db0bbe8380c0a/users/51247285170642698dd2c4567d7bd6cb/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:05:56.906213 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7091a-0f41-49fd-ad2f-36372e38643f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.906522 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7091a-0f41-49fd-ad2f-36372e38643f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.906813 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7091a-0f41-49fd-ad2f-36372e38643f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.909027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 814/1614] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:05:56 2022] PUT /identity/v3/projects/19ef47eb9ce944639041b3a0a25754a6/users/8b3b2642956d492aad62dba8194a13d5/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:05:56.921669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ad1e2-5e1b-49bd-a573-fedb9ed05cb2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:56.921982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ad1e2-5e1b-49bd-a573-fedb9ed05cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:56.922269 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ad1e2-5e1b-49bd-a573-fedb9ed05cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:56.931688 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-65f7091a-0f41-49fd-ad2f-36372e38643f None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:56.932944 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-65f7091a-0f41-49fd-ad2f-36372e38643f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:56.952484 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4c6ad1e2-5e1b-49bd-a573-fedb9ed05cb2 None None] MFA Rules not processed for user `7cabdda6aa6649e98f218bfbf5dd5812`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:56.953918 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4c6ad1e2-5e1b-49bd-a573-fedb9ed05cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:57.006258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 801/1615] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:57.007654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7091a-0f41-49fd-ad2f-36372e38643f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:57.030479 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 815/1616] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:57.032615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ad1e2-5e1b-49bd-a573-fedb9ed05cb2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:57.043813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ad1e2-5e1b-49bd-a573-fedb9ed05cb2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:57.048787 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474338f-1083-40be-bba7-fbf49abfe598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:57.050036 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474338f-1083-40be-bba7-fbf49abfe598 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:57.050036 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474338f-1083-40be-bba7-fbf49abfe598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:57.050224 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474338f-1083-40be-bba7-fbf49abfe598 admin admin] PATH_INFO: `/v3/projects/84e0cd3ea6e249e88a18a89d269ba8a6/users/13b426034e9145c7b48cb8099ab1c83b/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:57.052253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474338f-1083-40be-bba7-fbf49abfe598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e0cd3ea6e249e88a18a89d269ba8a6, user_id=13b426034e9145c7b48cb8099ab1c83b, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:57.055485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474338f-1083-40be-bba7-fbf49abfe598 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:57.067957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 816/1617] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:05:57 2022] PUT /identity/v3/projects/84e0cd3ea6e249e88a18a89d269ba8a6/users/13b426034e9145c7b48cb8099ab1c83b/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:05:57.069549 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d32af1-46fb-4cfc-a5e7-46d67056ba43 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:57.069908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d32af1-46fb-4cfc-a5e7-46d67056ba43 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:57.070262 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d32af1-46fb-4cfc-a5e7-46d67056ba43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:57.070756 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7091a-0f41-49fd-ad2f-36372e38643f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:57.090072 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-76d32af1-46fb-4cfc-a5e7-46d67056ba43 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:57.091311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-76d32af1-46fb-4cfc-a5e7-46d67056ba43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:57.123687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5be78b-d8c1-49de-8a89-011bd44bb26e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:57.124833 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5be78b-d8c1-49de-8a89-011bd44bb26e service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:57.125126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5be78b-d8c1-49de-8a89-011bd44bb26e service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:57.129645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5be78b-d8c1-49de-8a89-011bd44bb26e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:57.129754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:57.133972 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:57.164790 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 817/1618] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:57.166231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f1901-0cc4-4f94-9fdf-879301be9632 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:57.166537 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f1901-0cc4-4f94-9fdf-879301be9632 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:57.169964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f1901-0cc4-4f94-9fdf-879301be9632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:57.196567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-493f1901-0cc4-4f94-9fdf-879301be9632 None None] MFA Rules not processed for user `8b3b2642956d492aad62dba8194a13d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:57.197813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-493f1901-0cc4-4f94-9fdf-879301be9632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:57.216989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5be78b-d8c1-49de-8a89-011bd44bb26e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:57.218624 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5be78b-d8c1-49de-8a89-011bd44bb26e service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:57.230330 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 802/1619] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:05:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:05:57.231249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5be78b-d8c1-49de-8a89-011bd44bb26e service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:57.273970 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 818/1620] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:57.274966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f1901-0cc4-4f94-9fdf-879301be9632 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:57.288866 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f1901-0cc4-4f94-9fdf-879301be9632 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:57.300039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f5e79-8210-4e7d-875c-94ccf4b7f2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:57.300733 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f5e79-8210-4e7d-875c-94ccf4b7f2eb admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:57.302064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f5e79-8210-4e7d-875c-94ccf4b7f2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:57.302351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f5e79-8210-4e7d-875c-94ccf4b7f2eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:57.303047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f5e79-8210-4e7d-875c-94ccf4b7f2eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:57.305538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f5e79-8210-4e7d-875c-94ccf4b7f2eb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:57.313227 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5be78b-d8c1-49de-8a89-011bd44bb26e service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:57.318249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234af34-fb2b-4d36-900d-781813dcb720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:57.319006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234af34-fb2b-4d36-900d-781813dcb720 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:57.319372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234af34-fb2b-4d36-900d-781813dcb720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:57.320210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234af34-fb2b-4d36-900d-781813dcb720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:57.332100 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234af34-fb2b-4d36-900d-781813dcb720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:57.334311 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234af34-fb2b-4d36-900d-781813dcb720 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:57.344604 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 803/1621] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:05:57.345910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a19cb-c46c-4a33-b431-323655e5d5a9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:57.347137 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a19cb-c46c-4a33-b431-323655e5d5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:57.347137 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a19cb-c46c-4a33-b431-323655e5d5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:57.386748 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6d4a19cb-c46c-4a33-b431-323655e5d5a9 None None] MFA Rules not processed for user `13b426034e9145c7b48cb8099ab1c83b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:57.405504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 819/1622] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:05:57 2022] POST /identity/v3/projects => generated 405 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:57.405971 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6d4a19cb-c46c-4a33-b431-323655e5d5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:57.406077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f5e79-8210-4e7d-875c-94ccf4b7f2eb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:57.486144 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f5e79-8210-4e7d-875c-94ccf4b7f2eb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:57.490898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b5d54-8f66-4ad0-8cad-4b5801517635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:57.496426 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 804/1623] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:57.496587 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b5d54-8f66-4ad0-8cad-4b5801517635 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:57.496587 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b5d54-8f66-4ad0-8cad-4b5801517635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:57.496773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a19cb-c46c-4a33-b431-323655e5d5a9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:57.496865 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b5d54-8f66-4ad0-8cad-4b5801517635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:57.578150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b5d54-8f66-4ad0-8cad-4b5801517635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:57.580177 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b5d54-8f66-4ad0-8cad-4b5801517635 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:57.581822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:57.585701 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:57.592601 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 820/1624] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:05:57.593704 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b5d54-8f66-4ad0-8cad-4b5801517635 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:57.622988 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a19cb-c46c-4a33-b431-323655e5d5a9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:57.628116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b5d54-8f66-4ad0-8cad-4b5801517635 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:57.628251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4faadb-6554-4667-b671-825dea323d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:57.628992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4faadb-6554-4667-b671-825dea323d4b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:57.629282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4faadb-6554-4667-b671-825dea323d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:57.629570 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4faadb-6554-4667-b671-825dea323d4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:57.629696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c70adf-12d1-44ce-8639-2e92750b7001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:57.630325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4faadb-6554-4667-b671-825dea323d4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:57.630623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c70adf-12d1-44ce-8639-2e92750b7001 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:57.631008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c70adf-12d1-44ce-8639-2e92750b7001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:57.631451 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c70adf-12d1-44ce-8639-2e92750b7001 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:57.632812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c70adf-12d1-44ce-8639-2e92750b7001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:57.633008 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4faadb-6554-4667-b671-825dea323d4b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:57.636496 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c70adf-12d1-44ce-8639-2e92750b7001 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:57.783576 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 821/1625] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:05:57 2022] POST /identity/v3/users => generated 309 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:57.783785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 805/1626] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:05:57 2022] POST /identity/v3/projects => generated 373 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:57.784735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4faadb-6554-4667-b671-825dea323d4b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:57.786921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c70adf-12d1-44ce-8639-2e92750b7001 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:57.800643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c70adf-12d1-44ce-8639-2e92750b7001 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:57.868072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4faadb-6554-4667-b671-825dea323d4b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:57.873301 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf9e80-d4dd-4f98-ad3c-12957940a1ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:57.874556 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf9e80-d4dd-4f98-ad3c-12957940a1ec service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:57.874676 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf9e80-d4dd-4f98-ad3c-12957940a1ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:57.874877 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf9e80-d4dd-4f98-ad3c-12957940a1ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:57.895519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ac2b6-37a3-47f1-892b-28e3073e5d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:57.898118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ac2b6-37a3-47f1-892b-28e3073e5d63 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:57.898118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ac2b6-37a3-47f1-892b-28e3073e5d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:57.898118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ac2b6-37a3-47f1-892b-28e3073e5d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:57.898497 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ac2b6-37a3-47f1-892b-28e3073e5d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:57.900677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ac2b6-37a3-47f1-892b-28e3073e5d63 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:57.919448 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 822/1627] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:05:57.920701 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ac2b6-37a3-47f1-892b-28e3073e5d63 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:57.936397 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ac2b6-37a3-47f1-892b-28e3073e5d63 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:57.945390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee75a6-5227-4330-a6a4-2775673410f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:57.946143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee75a6-5227-4330-a6a4-2775673410f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:57.946545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee75a6-5227-4330-a6a4-2775673410f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:57.946884 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee75a6-5227-4330-a6a4-2775673410f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:57.947641 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee75a6-5227-4330-a6a4-2775673410f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:57.951858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee75a6-5227-4330-a6a4-2775673410f0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:58.003373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf9e80-d4dd-4f98-ad3c-12957940a1ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:58.004478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf9e80-d4dd-4f98-ad3c-12957940a1ec service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:58.017755 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 806/1628] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:05:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:05:58.018687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf9e80-d4dd-4f98-ad3c-12957940a1ec service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:58.030457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf9e80-d4dd-4f98-ad3c-12957940a1ec service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:58.035618 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba680c0-f644-4113-b6e8-65df6d0fd7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:58.036814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 823/1629] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:05:57 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:05:58.040651 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee75a6-5227-4330-a6a4-2775673410f0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:58.054853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba680c0-f644-4113-b6e8-65df6d0fd7dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:58.055066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba680c0-f644-4113-b6e8-65df6d0fd7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:58.056501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba680c0-f644-4113-b6e8-65df6d0fd7dc admin admin] PATH_INFO: `/v3/projects/2ae5445db002401692beb103a9c2bc4a/users/523851ec28034994902c74925018d018/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:58.062020 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee75a6-5227-4330-a6a4-2775673410f0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:58.074852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210e057-86a6-4804-ab83-d12df92de58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:58.075422 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210e057-86a6-4804-ab83-d12df92de58b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:58.075710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210e057-86a6-4804-ab83-d12df92de58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:58.076022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210e057-86a6-4804-ab83-d12df92de58b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:58.076784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210e057-86a6-4804-ab83-d12df92de58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:58.080831 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210e057-86a6-4804-ab83-d12df92de58b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:58.086821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba680c0-f644-4113-b6e8-65df6d0fd7dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae5445db002401692beb103a9c2bc4a, user_id=523851ec28034994902c74925018d018, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:58.092689 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba680c0-f644-4113-b6e8-65df6d0fd7dc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:58.103042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 824/1630] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:05:58.107067 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210e057-86a6-4804-ab83-d12df92de58b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:58.118609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210e057-86a6-4804-ab83-d12df92de58b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:58.124082 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6c1d-a50b-4cb8-8684-d2031b04add9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:58.125263 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6c1d-a50b-4cb8-8684-d2031b04add9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:58.126684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6c1d-a50b-4cb8-8684-d2031b04add9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:58.126684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6c1d-a50b-4cb8-8684-d2031b04add9 admin admin] PATH_INFO: `/v3/projects/45c98b7f9dd14b0186fd91963aea0ab1/users/1f20362949084e948d693d4146205225/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:58.145120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c6c1d-a50b-4cb8-8684-d2031b04add9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c98b7f9dd14b0186fd91963aea0ab1, user_id=1f20362949084e948d693d4146205225, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:58.148481 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c6c1d-a50b-4cb8-8684-d2031b04add9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:58.221994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 807/1631] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:05:58 2022] PUT /identity/v3/projects/2ae5445db002401692beb103a9c2bc4a/users/523851ec28034994902c74925018d018/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:05:58.226831 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba680c0-f644-4113-b6e8-65df6d0fd7dc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:58.245513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 825/1632] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:05:58 2022] PUT /identity/v3/projects/45c98b7f9dd14b0186fd91963aea0ab1/users/1f20362949084e948d693d4146205225/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:05:58.247461 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6c1d-a50b-4cb8-8684-d2031b04add9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:58.318172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:58.352103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba680c0-f644-4113-b6e8-65df6d0fd7dc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:58.354444 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6c1d-a50b-4cb8-8684-d2031b04add9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:58.363388 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f19303-1a9d-45db-a0dc-ede2707eb1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:58.368196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f19303-1a9d-45db-a0dc-ede2707eb1dd admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:58.368196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f19303-1a9d-45db-a0dc-ede2707eb1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:58.368196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f19303-1a9d-45db-a0dc-ede2707eb1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:58.368196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f19303-1a9d-45db-a0dc-ede2707eb1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:58.370139 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f19303-1a9d-45db-a0dc-ede2707eb1dd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:58.376502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13009c1e-d608-46a4-873a-c72c21c672e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:58.379802 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13009c1e-d608-46a4-873a-c72c21c672e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:58.379802 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13009c1e-d608-46a4-873a-c72c21c672e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:58.379802 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13009c1e-d608-46a4-873a-c72c21c672e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:58.379802 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13009c1e-d608-46a4-873a-c72c21c672e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:58.380733 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13009c1e-d608-46a4-873a-c72c21c672e3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:58.384936 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 826/1633] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:58.389617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f19303-1a9d-45db-a0dc-ede2707eb1dd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:58.399144 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 808/1634] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:05:58.403509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13009c1e-d608-46a4-873a-c72c21c672e3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:58.414914 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f19303-1a9d-45db-a0dc-ede2707eb1dd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:58.421949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13009c1e-d608-46a4-873a-c72c21c672e3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:58.426249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a3629-1ad8-4ec5-ac7f-8377a0c502bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:58.427435 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e7f89-449c-40ee-b36b-4c0076876295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:58.428445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e7f89-449c-40ee-b36b-4c0076876295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:58.428885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e7f89-449c-40ee-b36b-4c0076876295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:58.429316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e7f89-449c-40ee-b36b-4c0076876295 admin admin] PATH_INFO: `/v3/projects/2ae5445db002401692beb103a9c2bc4a/users/523851ec28034994902c74925018d018/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:58.430462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a3629-1ad8-4ec5-ac7f-8377a0c502bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:58.431035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a3629-1ad8-4ec5-ac7f-8377a0c502bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:58.431551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a3629-1ad8-4ec5-ac7f-8377a0c502bc admin admin] PATH_INFO: `/v3/projects/45c98b7f9dd14b0186fd91963aea0ab1/users/1f20362949084e948d693d4146205225/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:58.431762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e7f89-449c-40ee-b36b-4c0076876295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae5445db002401692beb103a9c2bc4a, user_id=523851ec28034994902c74925018d018, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:58.435025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e7f89-449c-40ee-b36b-4c0076876295 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:58.437850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a3629-1ad8-4ec5-ac7f-8377a0c502bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c98b7f9dd14b0186fd91963aea0ab1, user_id=1f20362949084e948d693d4146205225, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:58.442620 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a3629-1ad8-4ec5-ac7f-8377a0c502bc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:58.472499 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 809/1636] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:05:58 2022] PUT /identity/v3/projects/2ae5445db002401692beb103a9c2bc4a/users/523851ec28034994902c74925018d018/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:05:58.476589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 827/1636] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:05:58 2022] PUT /identity/v3/projects/45c98b7f9dd14b0186fd91963aea0ab1/users/1f20362949084e948d693d4146205225/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:05:58.483646 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7ec8c-3142-4484-a7ed-99b7d5f70e4a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:58.484238 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7ec8c-3142-4484-a7ed-99b7d5f70e4a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:58.484743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7ec8c-3142-4484-a7ed-99b7d5f70e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:58.486222 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddfd23-4fa3-49e4-9eb8-43bc9e419ce3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:58.487040 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddfd23-4fa3-49e4-9eb8-43bc9e419ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:58.487285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddfd23-4fa3-49e4-9eb8-43bc9e419ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:58.516706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:58.535135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d0b7ec8c-3142-4484-a7ed-99b7d5f70e4a None None] MFA Rules not processed for user `1f20362949084e948d693d4146205225`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:58.538671 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d0b7ec8c-3142-4484-a7ed-99b7d5f70e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:58.556792 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-deddfd23-4fa3-49e4-9eb8-43bc9e419ce3 None None] MFA Rules not processed for user `523851ec28034994902c74925018d018`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:58.557895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-deddfd23-4fa3-49e4-9eb8-43bc9e419ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:58.652545 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 810/1637] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:58.666476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7ec8c-3142-4484-a7ed-99b7d5f70e4a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:58.676887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 828/1638] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:58 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:58.707629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddfd23-4fa3-49e4-9eb8-43bc9e419ce3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:58.775774 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7ec8c-3142-4484-a7ed-99b7d5f70e4a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:58.780195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6ed7c-735d-431d-a130-935e2d8a9f0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:58.781302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6ed7c-735d-431d-a130-935e2d8a9f0d service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:58.781592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6ed7c-735d-431d-a130-935e2d8a9f0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:58.781882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6ed7c-735d-431d-a130-935e2d8a9f0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:58.782019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddfd23-4fa3-49e4-9eb8-43bc9e419ce3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:58.786131 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4698e8-dbf6-43ad-9a6c-8444f3249041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:58.786784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4698e8-dbf6-43ad-9a6c-8444f3249041 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:58.787070 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4698e8-dbf6-43ad-9a6c-8444f3249041 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:58.787351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4698e8-dbf6-43ad-9a6c-8444f3249041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:58.797185 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6ed7c-735d-431d-a130-935e2d8a9f0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:58.800468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6ed7c-735d-431d-a130-935e2d8a9f0d service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:58.806073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4698e8-dbf6-43ad-9a6c-8444f3249041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:58.807555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4698e8-dbf6-43ad-9a6c-8444f3249041 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:58.825105 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 811/1639] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:05:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:05:58.836891 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 829/1640] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:05:58 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:05:59.156436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6ed7c-735d-431d-a130-935e2d8a9f0d service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:59.169308 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4698e8-dbf6-43ad-9a6c-8444f3249041 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:59.186209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4698e8-dbf6-43ad-9a6c-8444f3249041 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:59.190195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3158f-2aad-4c70-86c0-5880fd5bf753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:59.190862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3158f-2aad-4c70-86c0-5880fd5bf753 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:59.428523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3158f-2aad-4c70-86c0-5880fd5bf753 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:59.428523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3158f-2aad-4c70-86c0-5880fd5bf753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:59.434910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:59.434910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6ed7c-735d-431d-a130-935e2d8a9f0d service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:59.434910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f561fe2-dd71-447e-b9c2-c7178fe19f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:59.434910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f561fe2-dd71-447e-b9c2-c7178fe19f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:59.436067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f561fe2-dd71-447e-b9c2-c7178fe19f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:59.436067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f561fe2-dd71-447e-b9c2-c7178fe19f39 admin admin] PATH_INFO: `/v3/users/7cabdda6aa6649e98f218bfbf5dd5812` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:59.436067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f561fe2-dd71-447e-b9c2-c7178fe19f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cabdda6aa6649e98f218bfbf5dd5812)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:59.436067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f561fe2-dd71-447e-b9c2-c7178fe19f39 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:59.438119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3158f-2aad-4c70-86c0-5880fd5bf753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:59.438119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3158f-2aad-4c70-86c0-5880fd5bf753 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:59.438119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 830/1641] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:05:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:05:59.654178 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcd204-1127-4459-a4a6-649632c76421 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:59.654767 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcd204-1127-4459-a4a6-649632c76421 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:59.655352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcd204-1127-4459-a4a6-649632c76421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:59.656230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2f561fe2-dd71-447e-b9c2-c7178fe19f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cabdda6aa6649e98f218bfbf5dd5812'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:05:59.683661 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2f561fe2-dd71-447e-b9c2-c7178fe19f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cabdda6aa6649e98f218bfbf5dd5812'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:05:59.686927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2f561fe2-dd71-447e-b9c2-c7178fe19f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cabdda6aa6649e98f218bfbf5dd5812'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:05:59.696886 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-94dcd204-1127-4459-a4a6-649632c76421 None None] MFA Rules not processed for user `51247285170642698dd2c4567d7bd6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:59.697896 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-94dcd204-1127-4459-a4a6-649632c76421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:59.705908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2f561fe2-dd71-447e-b9c2-c7178fe19f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cabdda6aa6649e98f218bfbf5dd5812'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:05:59.706916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2f561fe2-dd71-447e-b9c2-c7178fe19f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cabdda6aa6649e98f218bfbf5dd5812'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:05:59.722536 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:05:59.788418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 812/1642] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:05:59 2022] DELETE /identity/v3/users/7cabdda6aa6649e98f218bfbf5dd5812 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:05:59.788418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd9bb8-f25c-4d54-8d77-73c044e782e1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:59.788418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd9bb8-f25c-4d54-8d77-73c044e782e1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:59.788418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd9bb8-f25c-4d54-8d77-73c044e782e1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:59.797509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 813/1643] 10.222.0.50 () {54 vars in 961 bytes} [Thu Jun 2 16:05:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:05:59.798813 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd9bb8-f25c-4d54-8d77-73c044e782e1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:05:59.802380 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-badd9bb8-f25c-4d54-8d77-73c044e782e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:59.812918 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 831/1644] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:05:59.814829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37548f-cbcb-4cea-b30a-fd19c2657146 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:59.817694 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37548f-cbcb-4cea-b30a-fd19c2657146 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:59.818151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37548f-cbcb-4cea-b30a-fd19c2657146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:59.858205 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8f37548f-cbcb-4cea-b30a-fd19c2657146 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:05:59.859434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8f37548f-cbcb-4cea-b30a-fd19c2657146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:05:59.909841 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd9bb8-f25c-4d54-8d77-73c044e782e1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:05:59.917230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b518c2-2314-459d-911b-10a873c5aab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:05:59.918514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b518c2-2314-459d-911b-10a873c5aab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:59.918905 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b518c2-2314-459d-911b-10a873c5aab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:59.919286 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b518c2-2314-459d-911b-10a873c5aab5 admin admin] PATH_INFO: `/v3/users/77c0d3a0f1d2448e8e9745ba04837cd1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:05:59.921532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b518c2-2314-459d-911b-10a873c5aab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c0d3a0f1d2448e8e9745ba04837cd1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:05:59.924170 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b518c2-2314-459d-911b-10a873c5aab5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:05:59.980688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 832/1645] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:05:59.982326 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a109fc3-93f5-4f72-8e1c-92a74052716a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:05:59.982629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a109fc3-93f5-4f72-8e1c-92a74052716a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:05:59.983035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a109fc3-93f5-4f72-8e1c-92a74052716a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:00.017590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8a109fc3-93f5-4f72-8e1c-92a74052716a None None] MFA Rules not processed for user `2e53683ae2b34947a1550de269b74d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:00.019238 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8a109fc3-93f5-4f72-8e1c-92a74052716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:00.105309 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 833/1646] 10.222.0.50 () {58 vars in 1058 bytes} [Thu Jun 2 16:05:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:00.106943 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1d663-1cfe-4807-98fa-8b0635c604b8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:00.107345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1d663-1cfe-4807-98fa-8b0635c604b8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:00.107798 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1d663-1cfe-4807-98fa-8b0635c604b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:00.176070 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c7f1d663-1cfe-4807-98fa-8b0635c604b8 None None] MFA Rules not processed for user `51247285170642698dd2c4567d7bd6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:00.178268 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c7f1d663-1cfe-4807-98fa-8b0635c604b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:00.283578 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-92b518c2-2314-459d-911b-10a873c5aab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c0d3a0f1d2448e8e9745ba04837cd1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:00.316136 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-92b518c2-2314-459d-911b-10a873c5aab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c0d3a0f1d2448e8e9745ba04837cd1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:00.317731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-92b518c2-2314-459d-911b-10a873c5aab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c0d3a0f1d2448e8e9745ba04837cd1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:00.330482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-92b518c2-2314-459d-911b-10a873c5aab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c0d3a0f1d2448e8e9745ba04837cd1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:00.331274 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-92b518c2-2314-459d-911b-10a873c5aab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c0d3a0f1d2448e8e9745ba04837cd1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:00.332639 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 834/1647] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:00.333518 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1d663-1cfe-4807-98fa-8b0635c604b8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:00.338237 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c7f1d663-1cfe-4807-98fa-8b0635c604b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:00.433811 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 814/1648] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:05:59 2022] DELETE /identity/v3/users/77c0d3a0f1d2448e8e9745ba04837cd1 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:00.438418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371b6c9-b682-452e-9ade-cc876b2cd956 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:00.438718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371b6c9-b682-452e-9ade-cc876b2cd956 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:00.439007 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371b6c9-b682-452e-9ade-cc876b2cd956 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:00.440613 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 815/1649] 10.222.0.50 () {54 vars in 912 bytes} [Thu Jun 2 16:06:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:06:00.441627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259968e-d7a7-4111-bece-bcbc5deb37fb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:00.441976 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259968e-d7a7-4111-bece-bcbc5deb37fb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:00.442261 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259968e-d7a7-4111-bece-bcbc5deb37fb None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:00.449362 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 816/1650] 10.222.0.50 () {54 vars in 961 bytes} [Thu Jun 2 16:06:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:06:00.450717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d0820-6594-4ada-9465-7a9829018358 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:00.451173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d0820-6594-4ada-9465-7a9829018358 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:00.451465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d0820-6594-4ada-9465-7a9829018358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:00.452561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1d663-1cfe-4807-98fa-8b0635c604b8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:00.476504 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-729d0820-6594-4ada-9465-7a9829018358 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:00.477508 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-729d0820-6594-4ada-9465-7a9829018358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:00.540108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc0c3f-3721-4e5c-9859-0d31da509e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:00.540780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc0c3f-3721-4e5c-9859-0d31da509e48 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:00.541130 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc0c3f-3721-4e5c-9859-0d31da509e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:00.541535 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc0c3f-3721-4e5c-9859-0d31da509e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:00.543442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-efbc0c3f-3721-4e5c-9859-0d31da509e48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:00.575780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 817/1651] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:00.581581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f84d76-3a1c-40c8-b260-a4104e04bd52 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:00.581897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f84d76-3a1c-40c8-b260-a4104e04bd52 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:00.582185 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f84d76-3a1c-40c8-b260-a4104e04bd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:00.615372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-16f84d76-3a1c-40c8-b260-a4104e04bd52 None None] MFA Rules not processed for user `2e53683ae2b34947a1550de269b74d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:00.617764 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-16f84d76-3a1c-40c8-b260-a4104e04bd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:00.652575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:00.692387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc0c3f-3721-4e5c-9859-0d31da509e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:00.694953 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc0c3f-3721-4e5c-9859-0d31da509e48 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:00.720929 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 818/1652] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Jun 2 16:06:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:00.722991 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57dd6be-6a31-4420-b0a9-78e1409eee69 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:00.723513 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57dd6be-6a31-4420-b0a9-78e1409eee69 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:00.724175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57dd6be-6a31-4420-b0a9-78e1409eee69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:00.725245 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 835/1653] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:00.726679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc0c3f-3721-4e5c-9859-0d31da509e48 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:00.728515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-efbc0c3f-3721-4e5c-9859-0d31da509e48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:00.752256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc0c3f-3721-4e5c-9859-0d31da509e48 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:00.757870 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a8bd0-73bc-4e37-9f74-01e96479fa98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:00.758716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a8bd0-73bc-4e37-9f74-01e96479fa98 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:00.759118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a8bd0-73bc-4e37-9f74-01e96479fa98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:00.759668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b57dd6be-6a31-4420-b0a9-78e1409eee69 None None] MFA Rules not processed for user `2e53683ae2b34947a1550de269b74d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:00.760417 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a8bd0-73bc-4e37-9f74-01e96479fa98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:00.762424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b57dd6be-6a31-4420-b0a9-78e1409eee69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:00.781379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a8bd0-73bc-4e37-9f74-01e96479fa98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:00.781379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a8bd0-73bc-4e37-9f74-01e96479fa98 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:00.786900 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 819/1654] 10.222.0.50 () {58 vars in 1058 bytes} [Thu Jun 2 16:06:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:00.789843 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57dd6be-6a31-4420-b0a9-78e1409eee69 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:00.792869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b57dd6be-6a31-4420-b0a9-78e1409eee69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:00.802374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 836/1655] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:00.803442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a8bd0-73bc-4e37-9f74-01e96479fa98 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:00.819401 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a8bd0-73bc-4e37-9f74-01e96479fa98 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:00.825784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d91d5-8350-4e3e-a347-1b2a01616ede service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:00.826667 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d91d5-8350-4e3e-a347-1b2a01616ede service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:00.827074 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d91d5-8350-4e3e-a347-1b2a01616ede service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:00.827454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d91d5-8350-4e3e-a347-1b2a01616ede service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:00.830122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d12d91d5-8350-4e3e-a347-1b2a01616ede service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:00.893532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57dd6be-6a31-4420-b0a9-78e1409eee69 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:00.899121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ecdc7-c3bd-4af7-9f1b-c69edc9e9ac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:00.900391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ecdc7-c3bd-4af7-9f1b-c69edc9e9ac1 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:00.900971 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ecdc7-c3bd-4af7-9f1b-c69edc9e9ac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:00.901405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ecdc7-c3bd-4af7-9f1b-c69edc9e9ac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:00.908015 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d91d5-8350-4e3e-a347-1b2a01616ede service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:00.909811 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d91d5-8350-4e3e-a347-1b2a01616ede service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:00.915713 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ecdc7-c3bd-4af7-9f1b-c69edc9e9ac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:00.918455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ecdc7-c3bd-4af7-9f1b-c69edc9e9ac1 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:00.919777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 837/1656] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:00.951006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 820/1657] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:01.047529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:01.240580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7e371-34a5-42f2-a8f4-0b4fa703df28 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:01.241737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7e371-34a5-42f2-a8f4-0b4fa703df28 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:01.242257 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7e371-34a5-42f2-a8f4-0b4fa703df28 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:01.244594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 838/1658] 10.222.0.50 () {54 vars in 912 bytes} [Thu Jun 2 16:06:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:06:01.251115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a4ecf-c59f-4c3f-bf3c-ff9b48bb5753 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:01.251700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a4ecf-c59f-4c3f-bf3c-ff9b48bb5753 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:01.252140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a4ecf-c59f-4c3f-bf3c-ff9b48bb5753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:01.275875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8e5a4ecf-c59f-4c3f-bf3c-ff9b48bb5753 None None] MFA Rules not processed for user `2e53683ae2b34947a1550de269b74d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:01.277628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8e5a4ecf-c59f-4c3f-bf3c-ff9b48bb5753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:01.300335 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 821/1659] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Jun 2 16:06:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:01.319743 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7e371-34a5-42f2-a8f4-0b4fa703df28 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:01.321604 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c0a7e371-34a5-42f2-a8f4-0b4fa703df28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:01.424983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7e371-34a5-42f2-a8f4-0b4fa703df28 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:01.432467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbada4cd-3f06-4375-9421-26df32316032 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5157588644972a6a4554b3a9f1d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:01.437079 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbada4cd-3f06-4375-9421-26df32316032 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:01.437374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbada4cd-3f06-4375-9421-26df32316032 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:01.437661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbada4cd-3f06-4375-9421-26df32316032 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:01.454165 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbada4cd-3f06-4375-9421-26df32316032 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:01.455895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbada4cd-3f06-4375-9421-26df32316032 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:01.486856 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 839/1660] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:01.628589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:02.095108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcad71-8205-4bc9-9218-bde10a9268d0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:02.095699 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcad71-8205-4bc9-9218-bde10a9268d0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:02.096140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcad71-8205-4bc9-9218-bde10a9268d0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:02.098696 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 822/1661] 10.222.0.50 () {54 vars in 912 bytes} [Thu Jun 2 16:06:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:06:02.106863 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbcde1-234d-45b1-af9f-7e9b982b38cf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:02.107697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbcde1-234d-45b1-af9f-7e9b982b38cf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:02.107697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbcde1-234d-45b1-af9f-7e9b982b38cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:02.197388 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6ecbcde1-234d-45b1-af9f-7e9b982b38cf None None] MFA Rules not processed for user `c3ec010ab4c5414a8782cecf202fbcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:02.199232 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6ecbcde1-234d-45b1-af9f-7e9b982b38cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:02.209933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 840/1662] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Jun 2 16:06:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:02.260848 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcad71-8205-4bc9-9218-bde10a9268d0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:02.263636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6adcad71-8205-4bc9-9218-bde10a9268d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:02.282137 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcad71-8205-4bc9-9218-bde10a9268d0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:02.286109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5522eb-b50c-40b6-abfb-6e935d65897c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:02.286771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5522eb-b50c-40b6-abfb-6e935d65897c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:02.287064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5522eb-b50c-40b6-abfb-6e935d65897c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:02.287405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5522eb-b50c-40b6-abfb-6e935d65897c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:02.307148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbcde1-234d-45b1-af9f-7e9b982b38cf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:02.309840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6ecbcde1-234d-45b1-af9f-7e9b982b38cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:02.318722 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5522eb-b50c-40b6-abfb-6e935d65897c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:02.323917 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5522eb-b50c-40b6-abfb-6e935d65897c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:02.331422 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbcde1-234d-45b1-af9f-7e9b982b38cf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:02.339006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be759c12-e0ee-4806-a7d1-d683c95a5312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:02.345041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be759c12-e0ee-4806-a7d1-d683c95a5312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:02.345487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be759c12-e0ee-4806-a7d1-d683c95a5312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:02.345878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be759c12-e0ee-4806-a7d1-d683c95a5312 admin admin] PATH_INFO: `/v3/projects/e7277fbc6476486399f69560868d7efe` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:02.347417 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be759c12-e0ee-4806-a7d1-d683c95a5312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7277fbc6476486399f69560868d7efe)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:02.350779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be759c12-e0ee-4806-a7d1-d683c95a5312 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:02.361270 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 823/1663] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:02.570565 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-be759c12-e0ee-4806-a7d1-d683c95a5312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7277fbc6476486399f69560868d7efe', 'request_id': 'req-be759c12-e0ee-4806-a7d1-d683c95a5312'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:02.658825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-be759c12-e0ee-4806-a7d1-d683c95a5312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7277fbc6476486399f69560868d7efe', 'request_id': 'req-be759c12-e0ee-4806-a7d1-d683c95a5312'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:02.679452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-be759c12-e0ee-4806-a7d1-d683c95a5312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7277fbc6476486399f69560868d7efe', 'request_id': 'req-be759c12-e0ee-4806-a7d1-d683c95a5312'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:02.680909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5522eb-b50c-40b6-abfb-6e935d65897c service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:02.681842 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cd5522eb-b50c-40b6-abfb-6e935d65897c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:02.696928 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-be759c12-e0ee-4806-a7d1-d683c95a5312 admin admin] The token cache is being invalidate because project e7277fbc6476486399f69560868d7efe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:02.697428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-be759c12-e0ee-4806-a7d1-d683c95a5312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:02.698264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-be759c12-e0ee-4806-a7d1-d683c95a5312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:02.700739 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 841/1664] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:02 2022] DELETE /identity/v3/projects/e7277fbc6476486399f69560868d7efe => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:02.719056 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be759c12-e0ee-4806-a7d1-d683c95a5312 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:02.724225 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-be759c12-e0ee-4806-a7d1-d683c95a5312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:02.746462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5522eb-b50c-40b6-abfb-6e935d65897c service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:02.921848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:02.928663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be759c12-e0ee-4806-a7d1-d683c95a5312 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:02.930181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05780350-21cc-40c8-9292-1d3c445a023f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:02.932789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05780350-21cc-40c8-9292-1d3c445a023f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:02.933098 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05780350-21cc-40c8-9292-1d3c445a023f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:02.934026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05780350-21cc-40c8-9292-1d3c445a023f admin admin] PATH_INFO: `/v3/projects/f7de75604a464c98b29f653454d9546c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:02.935719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02d183-1b73-4005-966a-8ebf7232d0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:02.936476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05780350-21cc-40c8-9292-1d3c445a023f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7de75604a464c98b29f653454d9546c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:02.938304 dv-cinder-797608-27-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-05780350-21cc-40c8-9292-1d3c445a023f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:06:02.938304 dv-cinder-797608-27-smb devstack@keystone.service[80316]: warnings.warn(msg) Jun 02 16:06:02.938304 dv-cinder-797608-27-smb devstack@keystone.service[80316]: Jun 02 16:06:02.939220 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d183-1b73-4005-966a-8ebf7232d0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:02.939620 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d183-1b73-4005-966a-8ebf7232d0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:02.940142 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02d183-1b73-4005-966a-8ebf7232d0e1 admin admin] PATH_INFO: `/v3/users/523851ec28034994902c74925018d018` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:02.941573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02d183-1b73-4005-966a-8ebf7232d0e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=523851ec28034994902c74925018d018)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:02.942689 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05780350-21cc-40c8-9292-1d3c445a023f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:02.943013 dv-cinder-797608-27-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-5b02d183-1b73-4005-966a-8ebf7232d0e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 16:06:02.943013 dv-cinder-797608-27-smb devstack@keystone.service[80315]: warnings.warn(msg) Jun 02 16:06:02.943013 dv-cinder-797608-27-smb devstack@keystone.service[80315]: Jun 02 16:06:02.946394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02d183-1b73-4005-966a-8ebf7232d0e1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:03.186414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-05780350-21cc-40c8-9292-1d3c445a023f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7de75604a464c98b29f653454d9546c', 'request_id': 'req-05780350-21cc-40c8-9292-1d3c445a023f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:03.204063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-05780350-21cc-40c8-9292-1d3c445a023f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7de75604a464c98b29f653454d9546c', 'request_id': 'req-05780350-21cc-40c8-9292-1d3c445a023f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:03.264217 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5b02d183-1b73-4005-966a-8ebf7232d0e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '523851ec28034994902c74925018d018'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:03.266025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5b02d183-1b73-4005-966a-8ebf7232d0e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '523851ec28034994902c74925018d018'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:03.345133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-05780350-21cc-40c8-9292-1d3c445a023f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7de75604a464c98b29f653454d9546c', 'request_id': 'req-05780350-21cc-40c8-9292-1d3c445a023f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:03.373881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-05780350-21cc-40c8-9292-1d3c445a023f admin admin] The token cache is being invalidate because project f7de75604a464c98b29f653454d9546c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:03.374421 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-05780350-21cc-40c8-9292-1d3c445a023f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:03.375323 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-05780350-21cc-40c8-9292-1d3c445a023f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:03.377905 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 824/1665] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:02 2022] DELETE /identity/v3/projects/f7de75604a464c98b29f653454d9546c => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:03.383447 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05780350-21cc-40c8-9292-1d3c445a023f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:03.385108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-05780350-21cc-40c8-9292-1d3c445a023f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:03.431681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:03.464677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5b02d183-1b73-4005-966a-8ebf7232d0e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '523851ec28034994902c74925018d018'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:03.491643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5b02d183-1b73-4005-966a-8ebf7232d0e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '523851ec28034994902c74925018d018'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:03.492690 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5b02d183-1b73-4005-966a-8ebf7232d0e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '523851ec28034994902c74925018d018'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:03.530482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05780350-21cc-40c8-9292-1d3c445a023f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:03.543586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a31c5-a619-492c-b92e-36e8e4ef354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:03.547187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a31c5-a619-492c-b92e-36e8e4ef354a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:03.547187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a31c5-a619-492c-b92e-36e8e4ef354a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:03.548282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a31c5-a619-492c-b92e-36e8e4ef354a admin admin] PATH_INFO: `/v3/users/13b426034e9145c7b48cb8099ab1c83b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:03.552439 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a31c5-a619-492c-b92e-36e8e4ef354a admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b426034e9145c7b48cb8099ab1c83b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:03.558033 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a31c5-a619-492c-b92e-36e8e4ef354a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:03.571475 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 842/1666] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:02 2022] DELETE /identity/v3/users/523851ec28034994902c74925018d018 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:03.600710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bdf51-ad7d-4c13-aea8-c760b77411be None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:03.601006 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bdf51-ad7d-4c13-aea8-c760b77411be None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:03.601292 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bdf51-ad7d-4c13-aea8-c760b77411be None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:03.602966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 843/1667] 10.222.0.50 () {54 vars in 960 bytes} [Thu Jun 2 16:06:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 16:06:03.611495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513a460-9379-4143-92d4-ad4bb92085cd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:03.611761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513a460-9379-4143-92d4-ad4bb92085cd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:03.612077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513a460-9379-4143-92d4-ad4bb92085cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:03.660858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0513a460-9379-4143-92d4-ad4bb92085cd None None] MFA Rules not processed for user `8d60a2abffc04ba59b65d5fca5e318a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:03.662103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0513a460-9379-4143-92d4-ad4bb92085cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:03.777897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b20a31c5-a619-492c-b92e-36e8e4ef354a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b426034e9145c7b48cb8099ab1c83b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:03.795362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 844/1668] 10.222.0.50 () {58 vars in 1057 bytes} [Thu Jun 2 16:06:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:03.805548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513a460-9379-4143-92d4-ad4bb92085cd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:03.806688 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b20a31c5-a619-492c-b92e-36e8e4ef354a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b426034e9145c7b48cb8099ab1c83b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:03.807478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b20a31c5-a619-492c-b92e-36e8e4ef354a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b426034e9145c7b48cb8099ab1c83b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:03.818920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b20a31c5-a619-492c-b92e-36e8e4ef354a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b426034e9145c7b48cb8099ab1c83b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:03.820849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b20a31c5-a619-492c-b92e-36e8e4ef354a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b426034e9145c7b48cb8099ab1c83b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:03.830120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513a460-9379-4143-92d4-ad4bb92085cd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:03.837607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16b841-489c-4e53-b806-dd8611d8239c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60a2abffc04ba59b65d5fca5e318a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:03.838514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16b841-489c-4e53-b806-dd8611d8239c service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:03.838935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16b841-489c-4e53-b806-dd8611d8239c service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:03.839430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16b841-489c-4e53-b806-dd8611d8239c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:03.842156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ad16b841-489c-4e53-b806-dd8611d8239c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:03.868423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16b841-489c-4e53-b806-dd8611d8239c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:03.871897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16b841-489c-4e53-b806-dd8611d8239c service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:03.920398 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 845/1669] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:06:03.966297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 825/1670] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:03 2022] DELETE /identity/v3/users/13b426034e9145c7b48cb8099ab1c83b => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:04.333786 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:05.032632 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16b841-489c-4e53-b806-dd8611d8239c service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:05.035358 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ad16b841-489c-4e53-b806-dd8611d8239c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:05.058703 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a31c5-a619-492c-b92e-36e8e4ef354a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:05.060188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b20a31c5-a619-492c-b92e-36e8e4ef354a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:05.236388 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16b841-489c-4e53-b806-dd8611d8239c service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:05.331793 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a31c5-a619-492c-b92e-36e8e4ef354a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:05.342250 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef69aee-9ce9-4b47-9f87-e2e03f8c7488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:05.343293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef69aee-9ce9-4b47-9f87-e2e03f8c7488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:05.343576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef69aee-9ce9-4b47-9f87-e2e03f8c7488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:05.343850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef69aee-9ce9-4b47-9f87-e2e03f8c7488 admin admin] PATH_INFO: `/v3/projects/2ae5445db002401692beb103a9c2bc4a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:05.346880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef69aee-9ce9-4b47-9f87-e2e03f8c7488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae5445db002401692beb103a9c2bc4a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:05.361685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef69aee-9ce9-4b47-9f87-e2e03f8c7488 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:05.393871 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbb38d-90a3-4fca-9b19-cb5d8189d233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:05.394805 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbb38d-90a3-4fca-9b19-cb5d8189d233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:05.395238 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbb38d-90a3-4fca-9b19-cb5d8189d233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:05.395523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbb38d-90a3-4fca-9b19-cb5d8189d233 admin admin] PATH_INFO: `/v3/projects/84e0cd3ea6e249e88a18a89d269ba8a6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:05.398410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbb38d-90a3-4fca-9b19-cb5d8189d233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e0cd3ea6e249e88a18a89d269ba8a6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:05.405658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbb38d-90a3-4fca-9b19-cb5d8189d233 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:05.419705 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:05.548932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fef69aee-9ce9-4b47-9f87-e2e03f8c7488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae5445db002401692beb103a9c2bc4a', 'request_id': 'req-fef69aee-9ce9-4b47-9f87-e2e03f8c7488'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:05.574999 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fef69aee-9ce9-4b47-9f87-e2e03f8c7488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae5445db002401692beb103a9c2bc4a', 'request_id': 'req-fef69aee-9ce9-4b47-9f87-e2e03f8c7488'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:05.577542 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4abbb38d-90a3-4fca-9b19-cb5d8189d233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e0cd3ea6e249e88a18a89d269ba8a6', 'request_id': 'req-4abbb38d-90a3-4fca-9b19-cb5d8189d233'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:05.675469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fef69aee-9ce9-4b47-9f87-e2e03f8c7488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae5445db002401692beb103a9c2bc4a', 'request_id': 'req-fef69aee-9ce9-4b47-9f87-e2e03f8c7488'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:05.690295 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fef69aee-9ce9-4b47-9f87-e2e03f8c7488 admin admin] The token cache is being invalidate because project 2ae5445db002401692beb103a9c2bc4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:05.691542 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fef69aee-9ce9-4b47-9f87-e2e03f8c7488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:05.692938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fef69aee-9ce9-4b47-9f87-e2e03f8c7488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:05.701293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 826/1671] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:05 2022] DELETE /identity/v3/projects/2ae5445db002401692beb103a9c2bc4a => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:05.706327 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec5694-7576-4113-b32b-cf5c8fcfe8f9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:05.713145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec5694-7576-4113-b32b-cf5c8fcfe8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:05.713145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec5694-7576-4113-b32b-cf5c8fcfe8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:05.760904 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a7ec5694-7576-4113-b32b-cf5c8fcfe8f9 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:05.760904 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a7ec5694-7576-4113-b32b-cf5c8fcfe8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:05.769845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4abbb38d-90a3-4fca-9b19-cb5d8189d233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e0cd3ea6e249e88a18a89d269ba8a6', 'request_id': 'req-4abbb38d-90a3-4fca-9b19-cb5d8189d233'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:05.795364 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4abbb38d-90a3-4fca-9b19-cb5d8189d233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e0cd3ea6e249e88a18a89d269ba8a6', 'request_id': 'req-4abbb38d-90a3-4fca-9b19-cb5d8189d233'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:05.823543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4abbb38d-90a3-4fca-9b19-cb5d8189d233 admin admin] The token cache is being invalidate because project 84e0cd3ea6e249e88a18a89d269ba8a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:05.823818 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4abbb38d-90a3-4fca-9b19-cb5d8189d233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:05.824555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4abbb38d-90a3-4fca-9b19-cb5d8189d233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:05.827779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 846/1672] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:05 2022] DELETE /identity/v3/projects/84e0cd3ea6e249e88a18a89d269ba8a6 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:05.831633 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503854-fdd5-46d3-944e-79dbc1217e86 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:05.831924 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503854-fdd5-46d3-944e-79dbc1217e86 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:05.832229 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503854-fdd5-46d3-944e-79dbc1217e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:05.878249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-24503854-fdd5-46d3-944e-79dbc1217e86 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:05.881228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-24503854-fdd5-46d3-944e-79dbc1217e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:05.918031 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 827/1673] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:05.927794 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d7f4e-2d4a-4f65-9586-40b7d74e487e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:05.928680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d7f4e-2d4a-4f65-9586-40b7d74e487e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:05.928975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d7f4e-2d4a-4f65-9586-40b7d74e487e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:05.965716 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-175d7f4e-2d4a-4f65-9586-40b7d74e487e None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:05.967871 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-175d7f4e-2d4a-4f65-9586-40b7d74e487e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:05.999161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 828/1674] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:06.002661 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d7f4e-2d4a-4f65-9586-40b7d74e487e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:06.031721 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d7f4e-2d4a-4f65-9586-40b7d74e487e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:06.054482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4de74f-148e-46dc-9101-8fce6997c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:06.057965 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4de74f-148e-46dc-9101-8fce6997c84a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:06.057965 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4de74f-148e-46dc-9101-8fce6997c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:06.057965 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4de74f-148e-46dc-9101-8fce6997c84a admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:06.060269 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 847/1675] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:06.067427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4de74f-148e-46dc-9101-8fce6997c84a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:06.067615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4de74f-148e-46dc-9101-8fce6997c84a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:06.071907 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae345f-d2fc-48d5-b71d-c7b63193e3b3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:06.072393 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae345f-d2fc-48d5-b71d-c7b63193e3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:06.072684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae345f-d2fc-48d5-b71d-c7b63193e3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:06.077070 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4de74f-148e-46dc-9101-8fce6997c84a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:06.130074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 829/1676] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:06.136568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4de74f-148e-46dc-9101-8fce6997c84a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:06.145156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-10ae345f-d2fc-48d5-b71d-c7b63193e3b3 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:06.153584 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-10ae345f-d2fc-48d5-b71d-c7b63193e3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:06.169533 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4de74f-148e-46dc-9101-8fce6997c84a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:06.184890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b14dc-2c1d-409d-aaf0-8efe76e72209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:06.187833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 848/1677] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:06.188109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b14dc-2c1d-409d-aaf0-8efe76e72209 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:06.188678 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b14dc-2c1d-409d-aaf0-8efe76e72209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:06.189655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b14dc-2c1d-409d-aaf0-8efe76e72209 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:06.190582 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b14dc-2c1d-409d-aaf0-8efe76e72209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:06.194399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae345f-d2fc-48d5-b71d-c7b63193e3b3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:06.197145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b14dc-2c1d-409d-aaf0-8efe76e72209 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:06.218226 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae345f-d2fc-48d5-b71d-c7b63193e3b3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:06.229052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa027af-8978-43aa-949f-fb2de1c4db24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:06.234039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa027af-8978-43aa-949f-fb2de1c4db24 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:06.234039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa027af-8978-43aa-949f-fb2de1c4db24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:06.234039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa027af-8978-43aa-949f-fb2de1c4db24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:06.234039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa027af-8978-43aa-949f-fb2de1c4db24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:06.234039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa027af-8978-43aa-949f-fb2de1c4db24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:06.237026 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa027af-8978-43aa-949f-fb2de1c4db24 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:06.262496 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 849/1678] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:06.270967 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa027af-8978-43aa-949f-fb2de1c4db24 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:06.303762 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa027af-8978-43aa-949f-fb2de1c4db24 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:06.338287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 830/1679] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:06 2022] POST /identity/v3/projects => generated 367 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:06.341594 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b14dc-2c1d-409d-aaf0-8efe76e72209 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:06.347358 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a72af-bdb6-41a2-8a21-4a29f6f9ec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:06.348074 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a72af-bdb6-41a2-8a21-4a29f6f9ec5b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:06.349429 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a72af-bdb6-41a2-8a21-4a29f6f9ec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:06.349429 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a72af-bdb6-41a2-8a21-4a29f6f9ec5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:06.349429 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a72af-bdb6-41a2-8a21-4a29f6f9ec5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:06.367444 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a72af-bdb6-41a2-8a21-4a29f6f9ec5b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:06.496834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 850/1680] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:06 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:06.499295 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a72af-bdb6-41a2-8a21-4a29f6f9ec5b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:06.586165 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b14dc-2c1d-409d-aaf0-8efe76e72209 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:06.681074 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a72af-bdb6-41a2-8a21-4a29f6f9ec5b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:06.691879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe21dbc-fba8-4376-85f1-ed68dc0d0e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:06.692604 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe21dbc-fba8-4376-85f1-ed68dc0d0e89 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:06.692896 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe21dbc-fba8-4376-85f1-ed68dc0d0e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:06.693179 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe21dbc-fba8-4376-85f1-ed68dc0d0e89 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:06.694424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe21dbc-fba8-4376-85f1-ed68dc0d0e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:06.696819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe21dbc-fba8-4376-85f1-ed68dc0d0e89 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:06.699940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:06.730640 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae86bc-d227-4f1c-877e-dc3357e9e2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:06.732173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae86bc-d227-4f1c-877e-dc3357e9e2ea admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:06.739559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae86bc-d227-4f1c-877e-dc3357e9e2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:06.739559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae86bc-d227-4f1c-877e-dc3357e9e2ea admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:06.739559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae86bc-d227-4f1c-877e-dc3357e9e2ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:06.739559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae86bc-d227-4f1c-877e-dc3357e9e2ea admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:06.840393 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 851/1681] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:06 2022] POST /identity/v3/users => generated 288 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:06.842321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe21dbc-fba8-4376-85f1-ed68dc0d0e89 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:06.862537 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe21dbc-fba8-4376-85f1-ed68dc0d0e89 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:06.889127 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 831/1682] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:06 2022] POST /identity/v3/users => generated 284 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:06:06.889310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb083eda-eb55-4094-8f3f-fdf68796f241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:06.889653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb083eda-eb55-4094-8f3f-fdf68796f241 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:06.889897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb083eda-eb55-4094-8f3f-fdf68796f241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:06.890185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb083eda-eb55-4094-8f3f-fdf68796f241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:06.892207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae86bc-d227-4f1c-877e-dc3357e9e2ea admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:06.894707 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb083eda-eb55-4094-8f3f-fdf68796f241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:06.913328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb083eda-eb55-4094-8f3f-fdf68796f241 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:06.919463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae86bc-d227-4f1c-877e-dc3357e9e2ea admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:06.942981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca780797-d3a0-4fd1-976f-693f8d6c7b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:06.943846 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca780797-d3a0-4fd1-976f-693f8d6c7b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:06.944250 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca780797-d3a0-4fd1-976f-693f8d6c7b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:06.944744 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca780797-d3a0-4fd1-976f-693f8d6c7b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:06.945556 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca780797-d3a0-4fd1-976f-693f8d6c7b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:06.946988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 852/1683] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:06:06.950847 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca780797-d3a0-4fd1-976f-693f8d6c7b4d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:06.950976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb083eda-eb55-4094-8f3f-fdf68796f241 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:06.968899 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb083eda-eb55-4094-8f3f-fdf68796f241 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:06.973417 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 832/1684] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:06.978822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca780797-d3a0-4fd1-976f-693f8d6c7b4d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:06.999200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d5847-28d0-4ed5-b5d9-2e95b6324602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:06.999925 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d5847-28d0-4ed5-b5d9-2e95b6324602 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:07.003845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d5847-28d0-4ed5-b5d9-2e95b6324602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:07.003845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d5847-28d0-4ed5-b5d9-2e95b6324602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:07.003845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d5847-28d0-4ed5-b5d9-2e95b6324602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:07.011047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d5847-28d0-4ed5-b5d9-2e95b6324602 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:07.023925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca780797-d3a0-4fd1-976f-693f8d6c7b4d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:07.057112 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95e173-8ab0-4c07-b87e-10fe617361a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:07.057811 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95e173-8ab0-4c07-b87e-10fe617361a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:07.061204 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95e173-8ab0-4c07-b87e-10fe617361a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:07.061204 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95e173-8ab0-4c07-b87e-10fe617361a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:07.061204 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95e173-8ab0-4c07-b87e-10fe617361a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:07.061204 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95e173-8ab0-4c07-b87e-10fe617361a3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:07.074584 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 853/1685] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:07.075565 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d5847-28d0-4ed5-b5d9-2e95b6324602 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:07.115009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d5847-28d0-4ed5-b5d9-2e95b6324602 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:07.143288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 833/1686] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:07.144276 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95e173-8ab0-4c07-b87e-10fe617361a3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:07.160406 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7a232-16d7-4aa1-9ce8-4a58e77ee53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:07.160406 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7a232-16d7-4aa1-9ce8-4a58e77ee53f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:07.160406 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7a232-16d7-4aa1-9ce8-4a58e77ee53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:07.160406 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7a232-16d7-4aa1-9ce8-4a58e77ee53f admin admin] PATH_INFO: `/v3/projects/530ceebbbab6438aa921240a147709b2/users/8376ea747b37408b87b9e4c3b94dacdf/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:07.180904 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95e173-8ab0-4c07-b87e-10fe617361a3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:07.214736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c9d36-2515-465a-85ad-a2341ecefaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:07.215657 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c9d36-2515-465a-85ad-a2341ecefaec admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:07.216147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c9d36-2515-465a-85ad-a2341ecefaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:07.216432 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c9d36-2515-465a-85ad-a2341ecefaec admin admin] PATH_INFO: `/v3/projects/52ec393d30424a9e872e873390aafe45/users/6bffec0ef26646c8942b4c4b8e4b7f68/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:07.234627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7a232-16d7-4aa1-9ce8-4a58e77ee53f admin admin] RBAC: Authorizing `identity:create_grant(project_id=530ceebbbab6438aa921240a147709b2, user_id=8376ea747b37408b87b9e4c3b94dacdf, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:07.261880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7a232-16d7-4aa1-9ce8-4a58e77ee53f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:07.290694 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c9d36-2515-465a-85ad-a2341ecefaec admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ec393d30424a9e872e873390aafe45, user_id=6bffec0ef26646c8942b4c4b8e4b7f68, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:07.293599 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c9d36-2515-465a-85ad-a2341ecefaec admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:07.360457 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 854/1687] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:07 2022] PUT /identity/v3/projects/530ceebbbab6438aa921240a147709b2/users/8376ea747b37408b87b9e4c3b94dacdf/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:07.373108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ab023-2964-4d94-8b0d-87b7361df5dd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:07.373595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ab023-2964-4d94-8b0d-87b7361df5dd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:07.374124 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ab023-2964-4d94-8b0d-87b7361df5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:07.422115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 834/1688] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:07 2022] PUT /identity/v3/projects/52ec393d30424a9e872e873390aafe45/users/6bffec0ef26646c8942b4c4b8e4b7f68/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:07.423903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d8bf-362a-4fd8-b019-d5134b77bed7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:07.424225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d8bf-362a-4fd8-b019-d5134b77bed7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:07.424510 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86d8bf-362a-4fd8-b019-d5134b77bed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:07.457996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5e4ab023-2964-4d94-8b0d-87b7361df5dd None None] MFA Rules not processed for user `8376ea747b37408b87b9e4c3b94dacdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:07.459716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5e4ab023-2964-4d94-8b0d-87b7361df5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:07.477047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:07.519437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1a86d8bf-362a-4fd8-b019-d5134b77bed7 None None] MFA Rules not processed for user `6bffec0ef26646c8942b4c4b8e4b7f68`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:07.520897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1a86d8bf-362a-4fd8-b019-d5134b77bed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:07.700269 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 835/1689] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:07.710912 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86d8bf-362a-4fd8-b019-d5134b77bed7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:07.714865 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 855/1690] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:07.719022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ab023-2964-4d94-8b0d-87b7361df5dd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:07.855951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86d8bf-362a-4fd8-b019-d5134b77bed7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:07.867577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ab023-2964-4d94-8b0d-87b7361df5dd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:07.878414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213eb6-211a-4a6d-9802-23fbbd24d48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:07.880798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213eb6-211a-4a6d-9802-23fbbd24d48f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:07.882667 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213eb6-211a-4a6d-9802-23fbbd24d48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:07.884085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213eb6-211a-4a6d-9802-23fbbd24d48f admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:07.885568 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939ba7d-9476-4378-a748-eea4e44106e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:07.885870 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36213eb6-211a-4a6d-9802-23fbbd24d48f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:07.888627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36213eb6-211a-4a6d-9802-23fbbd24d48f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:07.889379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939ba7d-9476-4378-a748-eea4e44106e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:07.889685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939ba7d-9476-4378-a748-eea4e44106e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:07.891185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939ba7d-9476-4378-a748-eea4e44106e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:07.891913 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939ba7d-9476-4378-a748-eea4e44106e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:07.898364 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1939ba7d-9476-4378-a748-eea4e44106e7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:08.034037 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 836/1691] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:07 2022] POST /identity/v3/projects => generated 369 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:08.038178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213eb6-211a-4a6d-9802-23fbbd24d48f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:08.093992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 856/1692] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:07 2022] POST /identity/v3/projects => generated 375 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:06:08.100350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939ba7d-9476-4378-a748-eea4e44106e7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:08.332789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213eb6-211a-4a6d-9802-23fbbd24d48f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:08.347544 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d743707-7751-4931-94cd-7889279d9fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:08.348293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d743707-7751-4931-94cd-7889279d9fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:08.348592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d743707-7751-4931-94cd-7889279d9fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:08.348881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d743707-7751-4931-94cd-7889279d9fd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:08.357893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939ba7d-9476-4378-a748-eea4e44106e7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:08.370405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d743707-7751-4931-94cd-7889279d9fd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:08.374640 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d743707-7751-4931-94cd-7889279d9fd9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:08.378352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6199415-20e6-4d74-935c-476b8c78f083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:08.380175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6199415-20e6-4d74-935c-476b8c78f083 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:08.380474 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6199415-20e6-4d74-935c-476b8c78f083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:08.382124 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6199415-20e6-4d74-935c-476b8c78f083 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:08.382882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6199415-20e6-4d74-935c-476b8c78f083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:08.388402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6199415-20e6-4d74-935c-476b8c78f083 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:08.503130 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 837/1693] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:08 2022] POST /identity/v3/users => generated 291 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:08.504683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d743707-7751-4931-94cd-7889279d9fd9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:08.529980 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d743707-7751-4931-94cd-7889279d9fd9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:08.559363 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9047b-5dd9-427c-a2d0-e1dbdb545886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:08.560685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9047b-5dd9-427c-a2d0-e1dbdb545886 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:08.561190 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9047b-5dd9-427c-a2d0-e1dbdb545886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:08.565967 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9047b-5dd9-427c-a2d0-e1dbdb545886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:08.565967 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9047b-5dd9-427c-a2d0-e1dbdb545886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:08.566341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9047b-5dd9-427c-a2d0-e1dbdb545886 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:08.575832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 857/1694] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:08 2022] POST /identity/v3/users => generated 294 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:08.582498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6199415-20e6-4d74-935c-476b8c78f083 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:08.584693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 838/1695] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:06:08.589241 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9047b-5dd9-427c-a2d0-e1dbdb545886 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:08.607771 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6199415-20e6-4d74-935c-476b8c78f083 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:08.615305 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb048c-c669-420e-8dfc-fad958c14e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:08.616709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb048c-c669-420e-8dfc-fad958c14e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:08.617002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb048c-c669-420e-8dfc-fad958c14e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:08.617283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb048c-c669-420e-8dfc-fad958c14e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:08.627466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb048c-c669-420e-8dfc-fad958c14e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:08.627466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb048c-c669-420e-8dfc-fad958c14e86 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:08.641703 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 858/1696] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:08.646499 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb048c-c669-420e-8dfc-fad958c14e86 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:08.663892 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9047b-5dd9-427c-a2d0-e1dbdb545886 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:08.666366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb048c-c669-420e-8dfc-fad958c14e86 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:08.675876 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08ddfb-69a9-43d8-a508-0af56be430e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:08.681331 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08ddfb-69a9-43d8-a508-0af56be430e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:08.681686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08ddfb-69a9-43d8-a508-0af56be430e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:08.682032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08ddfb-69a9-43d8-a508-0af56be430e8 admin admin] PATH_INFO: `/v3/projects/fccbddedc2a247a99d14d3e100c8ccc1/users/3b46dfa20a544ae4805ba15c399fbf2a/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:08.685460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf72a2-b8fe-4307-b701-caef55cb1342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:08.690039 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf72a2-b8fe-4307-b701-caef55cb1342 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:08.698949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf72a2-b8fe-4307-b701-caef55cb1342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:08.699333 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf72a2-b8fe-4307-b701-caef55cb1342 admin admin] PATH_INFO: `/v3/projects/ee0da0015841412c9a7a167da8709863/users/404339433afa4a3eb499d1c61f1433ca/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:08.740068 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08ddfb-69a9-43d8-a508-0af56be430e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fccbddedc2a247a99d14d3e100c8ccc1, user_id=3b46dfa20a544ae4805ba15c399fbf2a, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:08.744514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d08ddfb-69a9-43d8-a508-0af56be430e8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:08.753094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf72a2-b8fe-4307-b701-caef55cb1342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee0da0015841412c9a7a167da8709863, user_id=404339433afa4a3eb499d1c61f1433ca, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:08.758066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf72a2-b8fe-4307-b701-caef55cb1342 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:08.873511 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 859/1697] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:08 2022] PUT /identity/v3/projects/fccbddedc2a247a99d14d3e100c8ccc1/users/3b46dfa20a544ae4805ba15c399fbf2a/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:08.886283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08ddfb-69a9-43d8-a508-0af56be430e8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:08.952066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 839/1698] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:08 2022] PUT /identity/v3/projects/ee0da0015841412c9a7a167da8709863/users/404339433afa4a3eb499d1c61f1433ca/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:08.955555 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf72a2-b8fe-4307-b701-caef55cb1342 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:09.091193 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:09.103832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08ddfb-69a9-43d8-a508-0af56be430e8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:09.163008 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf72a2-b8fe-4307-b701-caef55cb1342 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:09.180628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c5ea7-fc4b-48ca-8e16-a7876ed41ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:09.181331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5ea7-fc4b-48ca-8e16-a7876ed41ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:09.188229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5ea7-fc4b-48ca-8e16-a7876ed41ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:09.188611 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c5ea7-fc4b-48ca-8e16-a7876ed41ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:09.189409 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c5ea7-fc4b-48ca-8e16-a7876ed41ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:09.195027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c5ea7-fc4b-48ca-8e16-a7876ed41ee8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:09.249360 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 840/1699] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:09.251096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c5ea7-fc4b-48ca-8e16-a7876ed41ee8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:09.292107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c5ea7-fc4b-48ca-8e16-a7876ed41ee8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:09.327287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04c5a4-a6b4-403e-8a50-71bb175cc532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:09.328019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04c5a4-a6b4-403e-8a50-71bb175cc532 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:09.328490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04c5a4-a6b4-403e-8a50-71bb175cc532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:09.328991 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04c5a4-a6b4-403e-8a50-71bb175cc532 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:09.329173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc19d1-d82e-4449-ab37-98297fb11092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:09.330328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04c5a4-a6b4-403e-8a50-71bb175cc532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:09.332123 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc19d1-d82e-4449-ab37-98297fb11092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:09.332593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc19d1-d82e-4449-ab37-98297fb11092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:09.336149 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc19d1-d82e-4449-ab37-98297fb11092 admin admin] PATH_INFO: `/v3/projects/ee0da0015841412c9a7a167da8709863/users/404339433afa4a3eb499d1c61f1433ca/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:09.345078 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc19d1-d82e-4449-ab37-98297fb11092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee0da0015841412c9a7a167da8709863, user_id=404339433afa4a3eb499d1c61f1433ca, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:09.347867 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04c5a4-a6b4-403e-8a50-71bb175cc532 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:09.372463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc19d1-d82e-4449-ab37-98297fb11092 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:09.392235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 860/1700] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:09.394859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c739dd-6571-41e5-b19d-e173a19a4a42 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:09.395164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c739dd-6571-41e5-b19d-e173a19a4a42 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:09.395507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c739dd-6571-41e5-b19d-e173a19a4a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:09.411071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 841/1701] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:09 2022] PUT /identity/v3/projects/ee0da0015841412c9a7a167da8709863/users/404339433afa4a3eb499d1c61f1433ca/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:09.411927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc19d1-d82e-4449-ab37-98297fb11092 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:09.441977 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a4c739dd-6571-41e5-b19d-e173a19a4a42 None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:09.444678 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a4c739dd-6571-41e5-b19d-e173a19a4a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:09.595709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 861/1702] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Jun 2 16:06:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:09.597370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6532a-bec4-4f68-a93d-75b2871c1507 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:09.602309 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6532a-bec4-4f68-a93d-75b2871c1507 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:09.602776 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6532a-bec4-4f68-a93d-75b2871c1507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:09.610547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc19d1-d82e-4449-ab37-98297fb11092 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:09.628192 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ff360-95f0-46ea-a80a-5f3c2c356a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:09.629123 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ff360-95f0-46ea-a80a-5f3c2c356a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:09.635844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ff360-95f0-46ea-a80a-5f3c2c356a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:09.635844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ff360-95f0-46ea-a80a-5f3c2c356a9b admin admin] PATH_INFO: `/v3/projects/fccbddedc2a247a99d14d3e100c8ccc1/users/3b46dfa20a544ae4805ba15c399fbf2a/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:09.641320 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ff360-95f0-46ea-a80a-5f3c2c356a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fccbddedc2a247a99d14d3e100c8ccc1, user_id=3b46dfa20a544ae4805ba15c399fbf2a, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:09.646983 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ff360-95f0-46ea-a80a-5f3c2c356a9b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:09.679317 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 842/1703] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:09 2022] PUT /identity/v3/projects/fccbddedc2a247a99d14d3e100c8ccc1/users/3b46dfa20a544ae4805ba15c399fbf2a/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:09.691838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0ca6532a-bec4-4f68-a93d-75b2871c1507 None None] MFA Rules not processed for user `404339433afa4a3eb499d1c61f1433ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:09.697054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0ca6532a-bec4-4f68-a93d-75b2871c1507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:09.697409 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5fd22-c745-4f64-a8dc-99a76f855840 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:09.697706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5fd22-c745-4f64-a8dc-99a76f855840 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:09.697998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5fd22-c745-4f64-a8dc-99a76f855840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:09.749910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e7d5fd22-c745-4f64-a8dc-99a76f855840 None None] MFA Rules not processed for user `3b46dfa20a544ae4805ba15c399fbf2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:09.756892 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e7d5fd22-c745-4f64-a8dc-99a76f855840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:09.902134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 843/1704] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:09.910768 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5fd22-c745-4f64-a8dc-99a76f855840 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:09.914410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 862/1705] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:09.916644 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e7d5fd22-c745-4f64-a8dc-99a76f855840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:09.926513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6532a-bec4-4f68-a93d-75b2871c1507 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:09.928570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0ca6532a-bec4-4f68-a93d-75b2871c1507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:10.051528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5fd22-c745-4f64-a8dc-99a76f855840 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:10.057139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c628a5-14d6-4e9e-8095-10fc303045bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:10.057807 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c628a5-14d6-4e9e-8095-10fc303045bf service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:10.058096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c628a5-14d6-4e9e-8095-10fc303045bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:10.058379 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c628a5-14d6-4e9e-8095-10fc303045bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:10.087100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6532a-bec4-4f68-a93d-75b2871c1507 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:10.092404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b81b94-9e66-423f-932e-f405ccc98863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:10.093196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81b94-9e66-423f-932e-f405ccc98863 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:10.093595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81b94-9e66-423f-932e-f405ccc98863 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:10.093977 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b81b94-9e66-423f-932e-f405ccc98863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:10.108722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b81b94-9e66-423f-932e-f405ccc98863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:10.112017 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b81b94-9e66-423f-932e-f405ccc98863 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:10.124269 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:10.142148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 863/1706] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:09 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:10.144471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b81b94-9e66-423f-932e-f405ccc98863 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:10.152906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e2b81b94-9e66-423f-932e-f405ccc98863 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:10.212903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c628a5-14d6-4e9e-8095-10fc303045bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:10.215487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c628a5-14d6-4e9e-8095-10fc303045bf service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:10.250364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 844/1707] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:10.302028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b81b94-9e66-423f-932e-f405ccc98863 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:10.325611 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f7c12-6d53-442b-9b4b-5e68d5bda468 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:10.326565 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f7c12-6d53-442b-9b4b-5e68d5bda468 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:10.326956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f7c12-6d53-442b-9b4b-5e68d5bda468 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:10.327355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f7c12-6d53-442b-9b4b-5e68d5bda468 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:10.490424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f7c12-6d53-442b-9b4b-5e68d5bda468 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:10.492417 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6f7c12-6d53-442b-9b4b-5e68d5bda468 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:10.514904 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 864/1708] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 16:06:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:06:10.859075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:11.333215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75891156-c9b5-4c20-a262-932d2efe4593 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:11.333916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75891156-c9b5-4c20-a262-932d2efe4593 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:11.335287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75891156-c9b5-4c20-a262-932d2efe4593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:11.477324 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-75891156-c9b5-4c20-a262-932d2efe4593 None None] MFA Rules not processed for user `fb70aacb7cfb41cea6a65a084e705ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:11.479013 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-75891156-c9b5-4c20-a262-932d2efe4593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:11.607637 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:11.844378 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 845/1709] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:11.860259 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f7c12-6d53-442b-9b4b-5e68d5bda468 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:11.862548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4b6f7c12-6d53-442b-9b4b-5e68d5bda468 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:11.954198 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:12.010902 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e226d62-9755-48aa-a6fa-3391b5357f6a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:12.011352 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e226d62-9755-48aa-a6fa-3391b5357f6a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:12.011796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e226d62-9755-48aa-a6fa-3391b5357f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:12.171231 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5e226d62-9755-48aa-a6fa-3391b5357f6a None None] MFA Rules not processed for user `2a972defd2a841768633fac694002d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:12.171231 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5e226d62-9755-48aa-a6fa-3391b5357f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:12.309457 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f7c12-6d53-442b-9b4b-5e68d5bda468 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:12.334833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0434393-7f1b-45d3-9eae-82893637c7af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:12.335915 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0434393-7f1b-45d3-9eae-82893637c7af service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:12.336457 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0434393-7f1b-45d3-9eae-82893637c7af service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:12.336902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0434393-7f1b-45d3-9eae-82893637c7af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:12.408021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0434393-7f1b-45d3-9eae-82893637c7af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:12.420836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0434393-7f1b-45d3-9eae-82893637c7af service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:12.428420 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 846/1710] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:12.444084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c257d3-471a-4ca4-8d1f-10caf280dd1a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:12.444781 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c257d3-471a-4ca4-8d1f-10caf280dd1a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:12.445217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c257d3-471a-4ca4-8d1f-10caf280dd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:12.473452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 865/1711] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:12.523953 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-65c257d3-471a-4ca4-8d1f-10caf280dd1a None None] MFA Rules not processed for user `2a972defd2a841768633fac694002d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:12.529150 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-65c257d3-471a-4ca4-8d1f-10caf280dd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:12.553758 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 847/1712] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:12.602892 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0434393-7f1b-45d3-9eae-82893637c7af service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:12.605111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f0434393-7f1b-45d3-9eae-82893637c7af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:12.656841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0434393-7f1b-45d3-9eae-82893637c7af service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:12.692819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d48533-de96-48d4-a04b-6abb40f4d3f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:12.694808 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d48533-de96-48d4-a04b-6abb40f4d3f9 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:12.695274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d48533-de96-48d4-a04b-6abb40f4d3f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:12.695577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d48533-de96-48d4-a04b-6abb40f4d3f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:12.709035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d48533-de96-48d4-a04b-6abb40f4d3f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:12.711223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d48533-de96-48d4-a04b-6abb40f4d3f9 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:12.730595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 866/1713] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:13.781096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac9731-5daa-4f6d-b3d8-416b7a7b0b44 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:13.781096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac9731-5daa-4f6d-b3d8-416b7a7b0b44 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:13.781096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac9731-5daa-4f6d-b3d8-416b7a7b0b44 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:13.781848 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 848/1714] 10.222.0.50 () {54 vars in 912 bytes} [Thu Jun 2 16:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:06:13.792025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ff965-1218-4169-8992-777b4b70b971 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:13.792596 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ff965-1218-4169-8992-777b4b70b971 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:13.792794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ff965-1218-4169-8992-777b4b70b971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:13.798110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac9731-5daa-4f6d-b3d8-416b7a7b0b44 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:13.800282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-beac9731-5daa-4f6d-b3d8-416b7a7b0b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:13.877469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-552ff965-1218-4169-8992-777b4b70b971 None None] MFA Rules not processed for user `c3ec010ab4c5414a8782cecf202fbcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:13.883438 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-552ff965-1218-4169-8992-777b4b70b971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:14.036161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac9731-5daa-4f6d-b3d8-416b7a7b0b44 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:14.036698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 867/1715] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Jun 2 16:06:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:14.060565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd9690-078c-443d-8bd7-bbbc822450ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:14.061751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd9690-078c-443d-8bd7-bbbc822450ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:14.062215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd9690-078c-443d-8bd7-bbbc822450ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:14.063497 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd9690-078c-443d-8bd7-bbbc822450ce admin admin] PATH_INFO: `/v3/users/83265e9131af4bd28fb2eb98399e0441` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:14.066880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ff965-1218-4169-8992-777b4b70b971 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:14.068908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-552ff965-1218-4169-8992-777b4b70b971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:14.076651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd9690-078c-443d-8bd7-bbbc822450ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=83265e9131af4bd28fb2eb98399e0441)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:14.088110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd9690-078c-443d-8bd7-bbbc822450ce admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:14.102466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ff965-1218-4169-8992-777b4b70b971 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:14.122985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fa782-94c1-4d79-aac3-82bce4203be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:14.123955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fa782-94c1-4d79-aac3-82bce4203be1 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:14.124408 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fa782-94c1-4d79-aac3-82bce4203be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:14.125050 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fa782-94c1-4d79-aac3-82bce4203be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:14.146769 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fa782-94c1-4d79-aac3-82bce4203be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:14.155005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001fa782-94c1-4d79-aac3-82bce4203be1 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:14.179498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 868/1716] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:06:14.326947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-83bd9690-078c-443d-8bd7-bbbc822450ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83265e9131af4bd28fb2eb98399e0441'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:14.381953 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-83bd9690-078c-443d-8bd7-bbbc822450ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83265e9131af4bd28fb2eb98399e0441'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:14.381953 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-83bd9690-078c-443d-8bd7-bbbc822450ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83265e9131af4bd28fb2eb98399e0441'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:14.387981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-83bd9690-078c-443d-8bd7-bbbc822450ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83265e9131af4bd28fb2eb98399e0441'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:14.388889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-83bd9690-078c-443d-8bd7-bbbc822450ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83265e9131af4bd28fb2eb98399e0441'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:14.486242 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 849/1717] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:13 2022] DELETE /identity/v3/users/83265e9131af4bd28fb2eb98399e0441 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:14.491808 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cf586-97ff-497b-8e79-dc88b331ebcc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:14.492744 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cf586-97ff-497b-8e79-dc88b331ebcc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:14.493832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cf586-97ff-497b-8e79-dc88b331ebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:14.532549 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fd7cf586-97ff-497b-8e79-dc88b331ebcc None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:14.534257 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fd7cf586-97ff-497b-8e79-dc88b331ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:14.538751 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:14.613130 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6f2dc-5fae-44ab-b299-e2f75511ef68 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:14.613913 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6f2dc-5fae-44ab-b299-e2f75511ef68 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:14.614217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6f2dc-5fae-44ab-b299-e2f75511ef68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:14.660902 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f4c6f2dc-5fae-44ab-b299-e2f75511ef68 None None] MFA Rules not processed for user `c3ec010ab4c5414a8782cecf202fbcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:14.664155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f4c6f2dc-5fae-44ab-b299-e2f75511ef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:14.709794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 869/1718] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:14.715890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cf586-97ff-497b-8e79-dc88b331ebcc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:14.718608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fd7cf586-97ff-497b-8e79-dc88b331ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:14.801771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 850/1719] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jun 2 16:06:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:14.821367 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6f2dc-5fae-44ab-b299-e2f75511ef68 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:14.825706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f4c6f2dc-5fae-44ab-b299-e2f75511ef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:14.844391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6f2dc-5fae-44ab-b299-e2f75511ef68 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:14.854313 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1624e-8b40-4d94-86e5-1d6679ae5726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:14.854313 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1624e-8b40-4d94-86e5-1d6679ae5726 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:14.854313 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1624e-8b40-4d94-86e5-1d6679ae5726 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:14.854313 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1624e-8b40-4d94-86e5-1d6679ae5726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:14.864493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1624e-8b40-4d94-86e5-1d6679ae5726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:14.868296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1624e-8b40-4d94-86e5-1d6679ae5726 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:14.868733 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cf586-97ff-497b-8e79-dc88b331ebcc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:14.874384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5649e-49f0-4326-beaf-36ea457dbfd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:14.875688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5649e-49f0-4326-beaf-36ea457dbfd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:14.876542 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5649e-49f0-4326-beaf-36ea457dbfd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:14.877009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5649e-49f0-4326-beaf-36ea457dbfd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:14.884790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 851/1720] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:14.888824 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:14.910427 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5649e-49f0-4326-beaf-36ea457dbfd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:14.915518 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5649e-49f0-4326-beaf-36ea457dbfd7 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:14.929997 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 870/1721] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:15.448301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:15.660526 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:16.510917 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da768-159b-4334-8f76-c5406ab9aef6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:16.511733 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da768-159b-4334-8f76-c5406ab9aef6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:16.511733 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da768-159b-4334-8f76-c5406ab9aef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:16.561153 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-005da768-159b-4334-8f76-c5406ab9aef6 None None] MFA Rules not processed for user `2a972defd2a841768633fac694002d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:16.562543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-005da768-159b-4334-8f76-c5406ab9aef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:16.771886 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 852/1722] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:16.795547 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5649e-49f0-4326-beaf-36ea457dbfd7 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:16.800304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-38b5649e-49f0-4326-beaf-36ea457dbfd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:16.845369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5649e-49f0-4326-beaf-36ea457dbfd7 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:16.885770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52714b2b-85d2-46cb-b7dc-fa4cd0d3a664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:16.887062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52714b2b-85d2-46cb-b7dc-fa4cd0d3a664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:16.891906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52714b2b-85d2-46cb-b7dc-fa4cd0d3a664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:16.899472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52714b2b-85d2-46cb-b7dc-fa4cd0d3a664 admin admin] PATH_INFO: `/v3/projects/cd83e009a756435a935ceaa3d22fdd92` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:16.910437 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52714b2b-85d2-46cb-b7dc-fa4cd0d3a664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd83e009a756435a935ceaa3d22fdd92)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:16.919095 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52714b2b-85d2-46cb-b7dc-fa4cd0d3a664 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:17.143234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:17.165805 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005da768-159b-4334-8f76-c5406ab9aef6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:17.174726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-005da768-159b-4334-8f76-c5406ab9aef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:17.211248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-52714b2b-85d2-46cb-b7dc-fa4cd0d3a664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd83e009a756435a935ceaa3d22fdd92', 'request_id': 'req-52714b2b-85d2-46cb-b7dc-fa4cd0d3a664'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:17.374554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005da768-159b-4334-8f76-c5406ab9aef6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:17.379737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-52714b2b-85d2-46cb-b7dc-fa4cd0d3a664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd83e009a756435a935ceaa3d22fdd92', 'request_id': 'req-52714b2b-85d2-46cb-b7dc-fa4cd0d3a664'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:17.392285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-52714b2b-85d2-46cb-b7dc-fa4cd0d3a664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd83e009a756435a935ceaa3d22fdd92', 'request_id': 'req-52714b2b-85d2-46cb-b7dc-fa4cd0d3a664'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:17.413766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-52714b2b-85d2-46cb-b7dc-fa4cd0d3a664 admin admin] The token cache is being invalidate because project cd83e009a756435a935ceaa3d22fdd92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:17.414432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-52714b2b-85d2-46cb-b7dc-fa4cd0d3a664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:17.417348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-52714b2b-85d2-46cb-b7dc-fa4cd0d3a664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:17.420066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 871/1723] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:16 2022] DELETE /identity/v3/projects/cd83e009a756435a935ceaa3d22fdd92 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:17.431979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef724d-d6cd-44ee-a108-7395427ca6c0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:17.432319 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef724d-d6cd-44ee-a108-7395427ca6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:17.432565 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef724d-d6cd-44ee-a108-7395427ca6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:17.491236 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7741d-5d7e-4161-809c-65a71160dd53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:17.491913 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7741d-5d7e-4161-809c-65a71160dd53 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:17.492225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7741d-5d7e-4161-809c-65a71160dd53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:17.492509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7741d-5d7e-4161-809c-65a71160dd53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:17.497190 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-08f7741d-5d7e-4161-809c-65a71160dd53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:17.501711 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-aaef724d-d6cd-44ee-a108-7395427ca6c0 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:17.503228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-aaef724d-d6cd-44ee-a108-7395427ca6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:17.716212 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 872/1724] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:17.717744 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245e692-efc0-4349-9801-e3686f140dd2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:17.718049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245e692-efc0-4349-9801-e3686f140dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:17.718339 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245e692-efc0-4349-9801-e3686f140dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:17.722711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7741d-5d7e-4161-809c-65a71160dd53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:17.724736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7741d-5d7e-4161-809c-65a71160dd53 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:17.764348 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 853/1725] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:06:17.766371 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661a62d-b242-4a77-8c30-d53e39c37413 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:17.776525 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661a62d-b242-4a77-8c30-d53e39c37413 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:17.779262 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661a62d-b242-4a77-8c30-d53e39c37413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:17.829451 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3245e692-efc0-4349-9801-e3686f140dd2 None None] MFA Rules not processed for user `3913e5416fd742509fe6b431261e2620`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:17.832988 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f661a62d-b242-4a77-8c30-d53e39c37413 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:17.835047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f661a62d-b242-4a77-8c30-d53e39c37413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:17.839104 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3245e692-efc0-4349-9801-e3686f140dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:17.872388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 854/1726] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:17.876243 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661a62d-b242-4a77-8c30-d53e39c37413 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:17.910292 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661a62d-b242-4a77-8c30-d53e39c37413 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:17.928481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce7c99-0046-4b03-9d0b-32b0c5d54a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:17.929425 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce7c99-0046-4b03-9d0b-32b0c5d54a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:17.929855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce7c99-0046-4b03-9d0b-32b0c5d54a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:17.930264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce7c99-0046-4b03-9d0b-32b0c5d54a74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:17.931140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce7c99-0046-4b03-9d0b-32b0c5d54a74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:17.932287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce7c99-0046-4b03-9d0b-32b0c5d54a74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:17.934085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce7c99-0046-4b03-9d0b-32b0c5d54a74 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:17.968194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 855/1727] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:17.972136 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce7c99-0046-4b03-9d0b-32b0c5d54a74 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:18.010831 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce7c99-0046-4b03-9d0b-32b0c5d54a74 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:18.029813 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d1e53-c2c0-4c60-bc07-c4f0a734c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:18.032845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d1e53-c2c0-4c60-bc07-c4f0a734c1ec admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:18.033393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d1e53-c2c0-4c60-bc07-c4f0a734c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:18.033978 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d1e53-c2c0-4c60-bc07-c4f0a734c1ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:18.037407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d1e53-c2c0-4c60-bc07-c4f0a734c1ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:18.048744 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d1e53-c2c0-4c60-bc07-c4f0a734c1ec admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:18.096284 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 873/1728] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:18.190647 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 856/1729] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:17 2022] POST /identity/v3/projects => generated 363 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:18.194593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245e692-efc0-4349-9801-e3686f140dd2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:18.217308 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245e692-efc0-4349-9801-e3686f140dd2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:18.361702 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d1e53-c2c0-4c60-bc07-c4f0a734c1ec admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:18.363670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e71d1e53-c2c0-4c60-bc07-c4f0a734c1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:18.490983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac3db4-3249-4bf8-9250-767f91b19c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:18.491702 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac3db4-3249-4bf8-9250-767f91b19c9a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:18.492016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac3db4-3249-4bf8-9250-767f91b19c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:18.502555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac3db4-3249-4bf8-9250-767f91b19c9a admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:18.503344 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac3db4-3249-4bf8-9250-767f91b19c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:18.510241 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac3db4-3249-4bf8-9250-767f91b19c9a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:18.645445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d1e53-c2c0-4c60-bc07-c4f0a734c1ec admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:18.674272 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16f20c-5a62-49c3-a3cd-3f619a3f447a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:18.675098 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16f20c-5a62-49c3-a3cd-3f619a3f447a service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:18.675310 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16f20c-5a62-49c3-a3cd-3f619a3f447a service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:18.683794 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16f20c-5a62-49c3-a3cd-3f619a3f447a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:18.848826 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16f20c-5a62-49c3-a3cd-3f619a3f447a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:18.851907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16f20c-5a62-49c3-a3cd-3f619a3f447a service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:18.866934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 857/1730] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:06:19.393254 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16f20c-5a62-49c3-a3cd-3f619a3f447a service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:19.403956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 874/1731] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:18 2022] POST /identity/v3/users => generated 282 bytes in 1207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:19.427837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16f20c-5a62-49c3-a3cd-3f619a3f447a service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:19.453376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0a64f-837e-4614-b207-1d33e7342c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:19.454185 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0a64f-837e-4614-b207-1d33e7342c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:19.454357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0a64f-837e-4614-b207-1d33e7342c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:19.454652 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0a64f-837e-4614-b207-1d33e7342c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:19.457572 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0a64f-837e-4614-b207-1d33e7342c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:19.465184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0a64f-837e-4614-b207-1d33e7342c1a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:19.510902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac3db4-3249-4bf8-9250-767f91b19c9a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:19.522290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac3db4-3249-4bf8-9250-767f91b19c9a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:19.529260 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 858/1732] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:19.545214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082d507-9b6b-469b-8a51-ceefd5d55e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:19.546103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082d507-9b6b-469b-8a51-ceefd5d55e85 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:19.547326 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082d507-9b6b-469b-8a51-ceefd5d55e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:19.547965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082d507-9b6b-469b-8a51-ceefd5d55e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:19.552613 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:19.553720 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082d507-9b6b-469b-8a51-ceefd5d55e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:19.555569 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082d507-9b6b-469b-8a51-ceefd5d55e85 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:19.626877 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0a64f-837e-4614-b207-1d33e7342c1a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:19.640965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 875/1733] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:19 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:19.644694 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0a64f-837e-4614-b207-1d33e7342c1a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:19.671849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede03e6-f9b3-4f32-b2ed-24a6ff9dcfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:19.673076 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede03e6-f9b3-4f32-b2ed-24a6ff9dcfd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:19.673558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede03e6-f9b3-4f32-b2ed-24a6ff9dcfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:19.674013 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede03e6-f9b3-4f32-b2ed-24a6ff9dcfd5 admin admin] PATH_INFO: `/v3/projects/1e2dc311893f4ef498de38bb555411f5/users/9c82ae6908964c969e9e70af974672d6/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:19.744981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede03e6-f9b3-4f32-b2ed-24a6ff9dcfd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2dc311893f4ef498de38bb555411f5, user_id=9c82ae6908964c969e9e70af974672d6, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:19.760558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede03e6-f9b3-4f32-b2ed-24a6ff9dcfd5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:19.871862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53da5b-6d5c-4e94-aff7-6a889d761bfe None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:19.872892 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53da5b-6d5c-4e94-aff7-6a889d761bfe None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:19.873177 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53da5b-6d5c-4e94-aff7-6a889d761bfe None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:19.875558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 876/1734] 10.222.0.50 () {54 vars in 921 bytes} [Thu Jun 2 16:06:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 16:06:19.894819 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 859/1735] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:19 2022] PUT /identity/v3/projects/1e2dc311893f4ef498de38bb555411f5/users/9c82ae6908964c969e9e70af974672d6/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:19.913034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c831e6-bd6a-4634-a0be-fd8f64c8fddf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:19.913615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c831e6-bd6a-4634-a0be-fd8f64c8fddf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:19.914063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c831e6-bd6a-4634-a0be-fd8f64c8fddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:19.962318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4f12-323e-4c85-a9bf-421cd32ccd74 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:19.963007 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4f12-323e-4c85-a9bf-421cd32ccd74 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:19.963465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4f12-323e-4c85-a9bf-421cd32ccd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:20.029965 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-972f4f12-323e-4c85-a9bf-421cd32ccd74 None None] MFA Rules not processed for user `2e53683ae2b34947a1550de269b74d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:20.031218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-972f4f12-323e-4c85-a9bf-421cd32ccd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:20.042385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-14c831e6-bd6a-4634-a0be-fd8f64c8fddf None None] MFA Rules not processed for user `9c82ae6908964c969e9e70af974672d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:20.048346 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-14c831e6-bd6a-4634-a0be-fd8f64c8fddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:20.209599 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 860/1736] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Jun 2 16:06:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:20.338830 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:20.369869 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 877/1737] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:19 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:20.379514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f4f12-323e-4c85-a9bf-421cd32ccd74 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:20.515763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f4f12-323e-4c85-a9bf-421cd32ccd74 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:20.529194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e7c6e-ed26-487a-a99f-735de014d4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:20.529890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e7c6e-ed26-487a-a99f-735de014d4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:20.530182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e7c6e-ed26-487a-a99f-735de014d4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:20.530474 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e7c6e-ed26-487a-a99f-735de014d4a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:20.531178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e7c6e-ed26-487a-a99f-735de014d4a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:20.533273 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e7c6e-ed26-487a-a99f-735de014d4a2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:20.645805 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c831e6-bd6a-4634-a0be-fd8f64c8fddf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:20.654805 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-14c831e6-bd6a-4634-a0be-fd8f64c8fddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:20.677856 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 861/1738] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:20 2022] POST /identity/v3/projects => generated 363 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:20.679125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e7c6e-ed26-487a-a99f-735de014d4a2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:20.715715 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c831e6-bd6a-4634-a0be-fd8f64c8fddf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:20.835512 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:20.915923 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914adb55-a396-44fa-b14e-91b986b63457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:20.916880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914adb55-a396-44fa-b14e-91b986b63457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:20.917175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914adb55-a396-44fa-b14e-91b986b63457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:20.917455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914adb55-a396-44fa-b14e-91b986b63457 admin admin] PATH_INFO: `/v3/users/6bffec0ef26646c8942b4c4b8e4b7f68` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:20.919850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914adb55-a396-44fa-b14e-91b986b63457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bffec0ef26646c8942b4c4b8e4b7f68)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:20.926747 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914adb55-a396-44fa-b14e-91b986b63457 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:20.981286 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e7c6e-ed26-487a-a99f-735de014d4a2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:21.001588 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f98d27-7872-4ce7-a552-b868b381b19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:21.002806 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f98d27-7872-4ce7-a552-b868b381b19d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:21.003509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f98d27-7872-4ce7-a552-b868b381b19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:21.004609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f98d27-7872-4ce7-a552-b868b381b19d admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:21.010547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f98d27-7872-4ce7-a552-b868b381b19d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:21.016425 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f98d27-7872-4ce7-a552-b868b381b19d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:21.171586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 862/1739] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:20 2022] POST /identity/v3/users => generated 288 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:21.176679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f98d27-7872-4ce7-a552-b868b381b19d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:21.180107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-75f98d27-7872-4ce7-a552-b868b381b19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:21.232430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-914adb55-a396-44fa-b14e-91b986b63457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bffec0ef26646c8942b4c4b8e4b7f68'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:21.235555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-914adb55-a396-44fa-b14e-91b986b63457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bffec0ef26646c8942b4c4b8e4b7f68'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:21.349666 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-914adb55-a396-44fa-b14e-91b986b63457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bffec0ef26646c8942b4c4b8e4b7f68'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:21.361172 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-914adb55-a396-44fa-b14e-91b986b63457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bffec0ef26646c8942b4c4b8e4b7f68'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:21.362184 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-914adb55-a396-44fa-b14e-91b986b63457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bffec0ef26646c8942b4c4b8e4b7f68'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:21.428699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 878/1740] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:20 2022] DELETE /identity/v3/users/6bffec0ef26646c8942b4c4b8e4b7f68 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:21.434193 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f98d27-7872-4ce7-a552-b868b381b19d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:21.434520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914adb55-a396-44fa-b14e-91b986b63457 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:21.434520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-914adb55-a396-44fa-b14e-91b986b63457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:21.584709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914adb55-a396-44fa-b14e-91b986b63457 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:21.593175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b693ed-ecc3-45b9-a40b-27f1cfa332e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:21.594332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b693ed-ecc3-45b9-a40b-27f1cfa332e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:21.594914 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b693ed-ecc3-45b9-a40b-27f1cfa332e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:21.595249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b693ed-ecc3-45b9-a40b-27f1cfa332e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:21.597441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b693ed-ecc3-45b9-a40b-27f1cfa332e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:21.600547 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b693ed-ecc3-45b9-a40b-27f1cfa332e9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:21.634905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 879/1741] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:21.640611 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beedf8f-c03f-4168-b948-02b33d1c94d7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:21.641015 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beedf8f-c03f-4168-b948-02b33d1c94d7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:21.641406 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beedf8f-c03f-4168-b948-02b33d1c94d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:21.644957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80d341-0c69-4e4d-b5e3-0cb3df826ef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:21.647118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80d341-0c69-4e4d-b5e3-0cb3df826ef5 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:21.647555 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80d341-0c69-4e4d-b5e3-0cb3df826ef5 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:21.648055 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80d341-0c69-4e4d-b5e3-0cb3df826ef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:21.650580 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-de80d341-0c69-4e4d-b5e3-0cb3df826ef5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:21.668697 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80d341-0c69-4e4d-b5e3-0cb3df826ef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:21.671938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80d341-0c69-4e4d-b5e3-0cb3df826ef5 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:21.707346 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3beedf8f-c03f-4168-b948-02b33d1c94d7 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:21.709555 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 863/1742] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:21.710408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80d341-0c69-4e4d-b5e3-0cb3df826ef5 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:21.723583 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80d341-0c69-4e4d-b5e3-0cb3df826ef5 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:21.731421 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109b403-d6d1-4962-b8d7-f3354bfa0b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:21.732485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109b403-d6d1-4962-b8d7-f3354bfa0b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:21.732641 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3beedf8f-c03f-4168-b948-02b33d1c94d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:21.732834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109b403-d6d1-4962-b8d7-f3354bfa0b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:21.733050 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109b403-d6d1-4962-b8d7-f3354bfa0b33 admin admin] PATH_INFO: `/v3/projects/38798767c8534e248dd26c9a9d0fb571/users/ba3b7077c1254d1bad80f140295cc332/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:21.760005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 880/1743] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:21.760095 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109b403-d6d1-4962-b8d7-f3354bfa0b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38798767c8534e248dd26c9a9d0fb571, user_id=ba3b7077c1254d1bad80f140295cc332, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:21.778549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109b403-d6d1-4962-b8d7-f3354bfa0b33 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:21.781625 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beedf8f-c03f-4168-b948-02b33d1c94d7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:21.783113 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3beedf8f-c03f-4168-b948-02b33d1c94d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:21.936954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 864/1744] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:21 2022] PUT /identity/v3/projects/38798767c8534e248dd26c9a9d0fb571/users/ba3b7077c1254d1bad80f140295cc332/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:21.938305 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109b403-d6d1-4962-b8d7-f3354bfa0b33 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:21.957387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beedf8f-c03f-4168-b948-02b33d1c94d7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.111152 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac951b90-a9be-478a-9f08-3ae62cdfb02c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.112038 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac951b90-a9be-478a-9f08-3ae62cdfb02c service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.112348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac951b90-a9be-478a-9f08-3ae62cdfb02c service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.113260 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac951b90-a9be-478a-9f08-3ae62cdfb02c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.245769 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109b403-d6d1-4962-b8d7-f3354bfa0b33 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.301662 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a49c6-c06b-4a9d-9fb3-4e46b78314fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.307589 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a49c6-c06b-4a9d-9fb3-4e46b78314fc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.309745 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a49c6-c06b-4a9d-9fb3-4e46b78314fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.319598 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a49c6-c06b-4a9d-9fb3-4e46b78314fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.326887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a49c6-c06b-4a9d-9fb3-4e46b78314fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.335514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a49c6-c06b-4a9d-9fb3-4e46b78314fc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.340130 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac951b90-a9be-478a-9f08-3ae62cdfb02c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.341567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac951b90-a9be-478a-9f08-3ae62cdfb02c service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.386547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 865/1745] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:22.388195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 881/1746] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:22.391560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a49c6-c06b-4a9d-9fb3-4e46b78314fc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:22.414110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a49c6-c06b-4a9d-9fb3-4e46b78314fc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:22.426755 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025a3a5-302f-4cc8-8770-040838862f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:22.429897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025a3a5-302f-4cc8-8770-040838862f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.431391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025a3a5-302f-4cc8-8770-040838862f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.433298 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025a3a5-302f-4cc8-8770-040838862f1e admin admin] PATH_INFO: `/v3/projects/38798767c8534e248dd26c9a9d0fb571/users/ba3b7077c1254d1bad80f140295cc332/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.458392 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025a3a5-302f-4cc8-8770-040838862f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=38798767c8534e248dd26c9a9d0fb571, user_id=ba3b7077c1254d1bad80f140295cc332, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:22.458392 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025a3a5-302f-4cc8-8770-040838862f1e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:22.473236 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 866/1747] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:22 2022] PUT /identity/v3/projects/38798767c8534e248dd26c9a9d0fb571/users/ba3b7077c1254d1bad80f140295cc332/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:22.484995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e3f87-0ff4-4fcc-83a7-2e2ec7dc4405 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:22.485425 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e3f87-0ff4-4fcc-83a7-2e2ec7dc4405 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:22.485849 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e3f87-0ff4-4fcc-83a7-2e2ec7dc4405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:22.602967 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c80e3f87-0ff4-4fcc-83a7-2e2ec7dc4405 None None] MFA Rules not processed for user `ba3b7077c1254d1bad80f140295cc332`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:22.604437 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c80e3f87-0ff4-4fcc-83a7-2e2ec7dc4405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:22.894690 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 882/1748] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:22 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:23.120361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025a3a5-302f-4cc8-8770-040838862f1e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.124388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7025a3a5-302f-4cc8-8770-040838862f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:23.414062 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025a3a5-302f-4cc8-8770-040838862f1e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.420315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c372fa-40d5-4b33-9cf8-feb97e0f5704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.422303 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c372fa-40d5-4b33-9cf8-feb97e0f5704 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.422303 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c372fa-40d5-4b33-9cf8-feb97e0f5704 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.422303 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c372fa-40d5-4b33-9cf8-feb97e0f5704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.448857 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c372fa-40d5-4b33-9cf8-feb97e0f5704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.451401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c372fa-40d5-4b33-9cf8-feb97e0f5704 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.478543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 867/1749] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:23 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:23.825292 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e3f87-0ff4-4fcc-83a7-2e2ec7dc4405 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:23.851097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e3f87-0ff4-4fcc-83a7-2e2ec7dc4405 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:23.864256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf487f-d8e3-402d-b681-3065806615cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:23.864256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf487f-d8e3-402d-b681-3065806615cc service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:23.864256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf487f-d8e3-402d-b681-3065806615cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:23.864256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf487f-d8e3-402d-b681-3065806615cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:23.866740 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0dbf487f-d8e3-402d-b681-3065806615cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:23.921632 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:23.952707 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf487f-d8e3-402d-b681-3065806615cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:23.956341 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf487f-d8e3-402d-b681-3065806615cc service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:23.990526 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 883/1750] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:23 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:24.426950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:25.016359 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c372fa-40d5-4b33-9cf8-feb97e0f5704 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:25.019762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-19c372fa-40d5-4b33-9cf8-feb97e0f5704 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:25.199224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c372fa-40d5-4b33-9cf8-feb97e0f5704 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:25.215241 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ff575-22a9-4c63-a98f-56f8c50216d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:25.230186 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff575-22a9-4c63-a98f-56f8c50216d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.231049 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff575-22a9-4c63-a98f-56f8c50216d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.231151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ff575-22a9-4c63-a98f-56f8c50216d6 admin admin] PATH_INFO: `/v3/projects/52ec393d30424a9e872e873390aafe45` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.241730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ff575-22a9-4c63-a98f-56f8c50216d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ec393d30424a9e872e873390aafe45)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:25.243701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ff575-22a9-4c63-a98f-56f8c50216d6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:25.390013 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788efe3-311d-409e-b9ea-8f6669d39796 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.390755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788efe3-311d-409e-b9ea-8f6669d39796 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.390836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788efe3-311d-409e-b9ea-8f6669d39796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.429395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d788efe3-311d-409e-b9ea-8f6669d39796 None None] MFA Rules not processed for user `3913e5416fd742509fe6b431261e2620`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:25.431549 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d788efe3-311d-409e-b9ea-8f6669d39796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:25.532281 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6b1ff575-22a9-4c63-a98f-56f8c50216d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ec393d30424a9e872e873390aafe45', 'request_id': 'req-6b1ff575-22a9-4c63-a98f-56f8c50216d6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:25.534046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 884/1751] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:25.570108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6b1ff575-22a9-4c63-a98f-56f8c50216d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ec393d30424a9e872e873390aafe45', 'request_id': 'req-6b1ff575-22a9-4c63-a98f-56f8c50216d6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:25.692882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6b1ff575-22a9-4c63-a98f-56f8c50216d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ec393d30424a9e872e873390aafe45', 'request_id': 'req-6b1ff575-22a9-4c63-a98f-56f8c50216d6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:25.725160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6b1ff575-22a9-4c63-a98f-56f8c50216d6 admin admin] The token cache is being invalidate because project 52ec393d30424a9e872e873390aafe45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:25.725160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6b1ff575-22a9-4c63-a98f-56f8c50216d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:25.727296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6b1ff575-22a9-4c63-a98f-56f8c50216d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:25.733651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 868/1752] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:25 2022] DELETE /identity/v3/projects/52ec393d30424a9e872e873390aafe45 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:25.736464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788efe3-311d-409e-b9ea-8f6669d39796 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:25.756984 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788efe3-311d-409e-b9ea-8f6669d39796 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:25.946524 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f44d5-5133-40ba-92f8-a8bb0ad0388f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:25.947479 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f44d5-5133-40ba-92f8-a8bb0ad0388f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:25.960882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f44d5-5133-40ba-92f8-a8bb0ad0388f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:25.961914 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f44d5-5133-40ba-92f8-a8bb0ad0388f admin admin] PATH_INFO: `/v3/users/404339433afa4a3eb499d1c61f1433ca` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:25.964334 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f44d5-5133-40ba-92f8-a8bb0ad0388f admin admin] RBAC: Authorizing `identity:delete_user(user_id=404339433afa4a3eb499d1c61f1433ca)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:25.968431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f44d5-5133-40ba-92f8-a8bb0ad0388f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:26.093987 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:26.323256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6d3f44d5-5133-40ba-92f8-a8bb0ad0388f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '404339433afa4a3eb499d1c61f1433ca'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:26.325358 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6d3f44d5-5133-40ba-92f8-a8bb0ad0388f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '404339433afa4a3eb499d1c61f1433ca'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:27.074384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6d3f44d5-5133-40ba-92f8-a8bb0ad0388f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '404339433afa4a3eb499d1c61f1433ca'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:27.117067 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6d3f44d5-5133-40ba-92f8-a8bb0ad0388f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '404339433afa4a3eb499d1c61f1433ca'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:27.119302 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6d3f44d5-5133-40ba-92f8-a8bb0ad0388f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '404339433afa4a3eb499d1c61f1433ca'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:27.167783 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 885/1753] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:25 2022] DELETE /identity/v3/users/404339433afa4a3eb499d1c61f1433ca => generated 0 bytes in 1429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:27.246568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef0830-1126-4a0f-b168-3d3388e1a3bc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:27.247121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef0830-1126-4a0f-b168-3d3388e1a3bc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:27.247121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef0830-1126-4a0f-b168-3d3388e1a3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:27.267173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b1ef0830-1126-4a0f-b168-3d3388e1a3bc None None] MFA Rules not processed for user `fb70aacb7cfb41cea6a65a084e705ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:27.268757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b1ef0830-1126-4a0f-b168-3d3388e1a3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:27.341457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 869/1754] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:27.999510 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f44d5-5133-40ba-92f8-a8bb0ad0388f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:28.001368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6d3f44d5-5133-40ba-92f8-a8bb0ad0388f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:28.125889 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f44d5-5133-40ba-92f8-a8bb0ad0388f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:28.133291 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb2d92-1d49-45a0-a596-6ce5c98700d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:28.134364 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb2d92-1d49-45a0-a596-6ce5c98700d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:28.134982 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb2d92-1d49-45a0-a596-6ce5c98700d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:28.135277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb2d92-1d49-45a0-a596-6ce5c98700d3 admin admin] PATH_INFO: `/v3/projects/ee0da0015841412c9a7a167da8709863` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:28.136586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb2d92-1d49-45a0-a596-6ce5c98700d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee0da0015841412c9a7a167da8709863)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:28.138590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb2d92-1d49-45a0-a596-6ce5c98700d3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:28.681704 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bbb2d92-1d49-45a0-a596-6ce5c98700d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee0da0015841412c9a7a167da8709863', 'request_id': 'req-0bbb2d92-1d49-45a0-a596-6ce5c98700d3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:28.685452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:28.819143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bbb2d92-1d49-45a0-a596-6ce5c98700d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee0da0015841412c9a7a167da8709863', 'request_id': 'req-0bbb2d92-1d49-45a0-a596-6ce5c98700d3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:28.829903 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bbb2d92-1d49-45a0-a596-6ce5c98700d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee0da0015841412c9a7a167da8709863', 'request_id': 'req-0bbb2d92-1d49-45a0-a596-6ce5c98700d3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:28.843727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bbb2d92-1d49-45a0-a596-6ce5c98700d3 admin admin] The token cache is being invalidate because project ee0da0015841412c9a7a167da8709863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:28.844301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bbb2d92-1d49-45a0-a596-6ce5c98700d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:28.845419 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bbb2d92-1d49-45a0-a596-6ce5c98700d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:28.847407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 886/1755] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:27 2022] DELETE /identity/v3/projects/ee0da0015841412c9a7a167da8709863 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:28.862229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654ca6e-528d-438d-80b1-92b25991a4a5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:28.862701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654ca6e-528d-438d-80b1-92b25991a4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:28.862783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654ca6e-528d-438d-80b1-92b25991a4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:28.906417 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1654ca6e-528d-438d-80b1-92b25991a4a5 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:28.909926 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:28.910624 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1654ca6e-528d-438d-80b1-92b25991a4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:28.977013 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 870/1756] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:28.984655 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfcf75-b720-4b0b-ae29-58516bdc26e1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:28.984951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfcf75-b720-4b0b-ae29-58516bdc26e1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:28.985234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfcf75-b720-4b0b-ae29-58516bdc26e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.003889 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e7cfcf75-b720-4b0b-ae29-58516bdc26e1 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:29.005253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e7cfcf75-b720-4b0b-ae29-58516bdc26e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:29.014678 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 887/1757] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:29.024713 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654ca6e-528d-438d-80b1-92b25991a4a5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:29.041849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654ca6e-528d-438d-80b1-92b25991a4a5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:29.048018 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dadffc-00ee-4ca4-a2c3-d9370682893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:29.048891 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dadffc-00ee-4ca4-a2c3-d9370682893b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.049452 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dadffc-00ee-4ca4-a2c3-d9370682893b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.049853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dadffc-00ee-4ca4-a2c3-d9370682893b admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.050689 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dadffc-00ee-4ca4-a2c3-d9370682893b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:29.051101 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dadffc-00ee-4ca4-a2c3-d9370682893b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:29.054046 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dadffc-00ee-4ca4-a2c3-d9370682893b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:29.061400 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfcf75-b720-4b0b-ae29-58516bdc26e1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:29.063660 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e7cfcf75-b720-4b0b-ae29-58516bdc26e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:29.074099 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 871/1758] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:29.078463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dadffc-00ee-4ca4-a2c3-d9370682893b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:29.084666 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfcf75-b720-4b0b-ae29-58516bdc26e1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:29.092031 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1462c9-1ba0-4647-891c-fc1136c72863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:29.095019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1462c9-1ba0-4647-891c-fc1136c72863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.095475 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1462c9-1ba0-4647-891c-fc1136c72863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.095894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1462c9-1ba0-4647-891c-fc1136c72863 admin admin] PATH_INFO: `/v3/users/9c82ae6908964c969e9e70af974672d6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.097101 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dadffc-00ee-4ca4-a2c3-d9370682893b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:29.097874 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1462c9-1ba0-4647-891c-fc1136c72863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c82ae6908964c969e9e70af974672d6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:29.100630 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1462c9-1ba0-4647-891c-fc1136c72863 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:29.103062 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06585a0-1e92-4359-89a8-80b227765640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:29.104056 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06585a0-1e92-4359-89a8-80b227765640 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.104341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06585a0-1e92-4359-89a8-80b227765640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.104660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06585a0-1e92-4359-89a8-80b227765640 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.105502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06585a0-1e92-4359-89a8-80b227765640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:29.107484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06585a0-1e92-4359-89a8-80b227765640 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:29.267668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 872/1759] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:29 2022] POST /identity/v3/projects => generated 371 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:06:29.272295 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06585a0-1e92-4359-89a8-80b227765640 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:29.350491 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06585a0-1e92-4359-89a8-80b227765640 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:29.357927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc8bc6-dbe2-42af-9144-7bd710b7657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:29.358617 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc8bc6-dbe2-42af-9144-7bd710b7657e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.358908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc8bc6-dbe2-42af-9144-7bd710b7657e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.359397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc8bc6-dbe2-42af-9144-7bd710b7657e admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.360131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc8bc6-dbe2-42af-9144-7bd710b7657e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:29.362061 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc8bc6-dbe2-42af-9144-7bd710b7657e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:29.523853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 873/1760] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:29 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:06:29.531436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-df1462c9-1ba0-4647-891c-fc1136c72863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c82ae6908964c969e9e70af974672d6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:29.532330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-df1462c9-1ba0-4647-891c-fc1136c72863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c82ae6908964c969e9e70af974672d6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:29.535233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc8bc6-dbe2-42af-9144-7bd710b7657e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:29.538088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-96cc8bc6-dbe2-42af-9144-7bd710b7657e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:29.551671 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc8bc6-dbe2-42af-9144-7bd710b7657e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:29.556631 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02a15b-4119-4866-8c3e-49709f356607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:29.557449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02a15b-4119-4866-8c3e-49709f356607 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.557744 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02a15b-4119-4866-8c3e-49709f356607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.558029 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02a15b-4119-4866-8c3e-49709f356607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.559194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02a15b-4119-4866-8c3e-49709f356607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:29.561319 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02a15b-4119-4866-8c3e-49709f356607 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:29.572411 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 874/1761] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:06:29.576342 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02a15b-4119-4866-8c3e-49709f356607 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:29.587270 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02a15b-4119-4866-8c3e-49709f356607 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:29.599359 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eba368-8cf3-4fd8-b1de-b859841d0f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:29.600198 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eba368-8cf3-4fd8-b1de-b859841d0f2d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.614608 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eba368-8cf3-4fd8-b1de-b859841d0f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.614608 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eba368-8cf3-4fd8-b1de-b859841d0f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.614608 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eba368-8cf3-4fd8-b1de-b859841d0f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:29.614608 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eba368-8cf3-4fd8-b1de-b859841d0f2d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:29.617716 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 875/1762] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:29.623657 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eba368-8cf3-4fd8-b1de-b859841d0f2d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:29.637650 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eba368-8cf3-4fd8-b1de-b859841d0f2d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:29.652315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37ca97-55d3-4f51-915f-653e5bce0e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:29.653255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37ca97-55d3-4f51-915f-653e5bce0e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.653549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37ca97-55d3-4f51-915f-653e5bce0e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.653837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37ca97-55d3-4f51-915f-653e5bce0e22 admin admin] PATH_INFO: `/v3/projects/9b919a573415476b88b1761ccc01073c/users/b4fc5b03167f49509cfa8354587d3048/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.671723 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-df1462c9-1ba0-4647-891c-fc1136c72863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c82ae6908964c969e9e70af974672d6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:29.683097 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37ca97-55d3-4f51-915f-653e5bce0e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b919a573415476b88b1761ccc01073c, user_id=b4fc5b03167f49509cfa8354587d3048, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:29.683303 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-df1462c9-1ba0-4647-891c-fc1136c72863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c82ae6908964c969e9e70af974672d6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:29.683644 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-df1462c9-1ba0-4647-891c-fc1136c72863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c82ae6908964c969e9e70af974672d6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:29.694481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37ca97-55d3-4f51-915f-653e5bce0e22 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:29.710026 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 888/1763] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:29 2022] DELETE /identity/v3/users/9c82ae6908964c969e9e70af974672d6 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:29.721600 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44130464-9fa1-4de6-9f1a-60ec209552d5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.722061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44130464-9fa1-4de6-9f1a-60ec209552d5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.722173 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44130464-9fa1-4de6-9f1a-60ec209552d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.748153 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-44130464-9fa1-4de6-9f1a-60ec209552d5 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:29.748268 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-44130464-9fa1-4de6-9f1a-60ec209552d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:29.812021 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 876/1764] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:29 2022] PUT /identity/v3/projects/9b919a573415476b88b1761ccc01073c/users/b4fc5b03167f49509cfa8354587d3048/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:29.814830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b078e-f5f5-4fa8-86db-a23ae33c0977 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:29.815555 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b078e-f5f5-4fa8-86db-a23ae33c0977 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:29.816203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b078e-f5f5-4fa8-86db-a23ae33c0977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:29.843558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 889/1765] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:29.846882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fa4b078e-f5f5-4fa8-86db-a23ae33c0977 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:29.849673 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fa4b078e-f5f5-4fa8-86db-a23ae33c0977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:29.858677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44130464-9fa1-4de6-9f1a-60ec209552d5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:29.862295 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-44130464-9fa1-4de6-9f1a-60ec209552d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:29.921557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 877/1766] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:29.932346 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44130464-9fa1-4de6-9f1a-60ec209552d5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:29.932627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b078e-f5f5-4fa8-86db-a23ae33c0977 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:30.002836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b078e-f5f5-4fa8-86db-a23ae33c0977 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:30.011138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579dfaa-850d-4df8-aa7a-585a5635aa25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:30.013697 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d187d-0539-4439-a29e-abe83d4ba4d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:30.014338 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579dfaa-850d-4df8-aa7a-585a5635aa25 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:30.014338 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579dfaa-850d-4df8-aa7a-585a5635aa25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:30.015534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579dfaa-850d-4df8-aa7a-585a5635aa25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:30.017540 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d187d-0539-4439-a29e-abe83d4ba4d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:30.018395 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d187d-0539-4439-a29e-abe83d4ba4d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:30.032296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d187d-0539-4439-a29e-abe83d4ba4d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:30.033267 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579dfaa-850d-4df8-aa7a-585a5635aa25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:30.034989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579dfaa-850d-4df8-aa7a-585a5635aa25 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:30.039921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d187d-0539-4439-a29e-abe83d4ba4d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:30.042243 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d187d-0539-4439-a29e-abe83d4ba4d9 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:30.050792 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 890/1767] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:30.070447 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 878/1768] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:06:31.055955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579dfaa-850d-4df8-aa7a-585a5635aa25 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:31.059325 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6579dfaa-850d-4df8-aa7a-585a5635aa25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:31.102003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579dfaa-850d-4df8-aa7a-585a5635aa25 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:31.112587 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1525627-46c5-4a6f-85e3-63ab11411603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:31.114730 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1525627-46c5-4a6f-85e3-63ab11411603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:31.115034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1525627-46c5-4a6f-85e3-63ab11411603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:31.115329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1525627-46c5-4a6f-85e3-63ab11411603 admin admin] PATH_INFO: `/v3/projects/1e2dc311893f4ef498de38bb555411f5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:31.118934 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1525627-46c5-4a6f-85e3-63ab11411603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2dc311893f4ef498de38bb555411f5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:31.124240 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1525627-46c5-4a6f-85e3-63ab11411603 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:31.167183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:31.276765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d1525627-46c5-4a6f-85e3-63ab11411603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2dc311893f4ef498de38bb555411f5', 'request_id': 'req-d1525627-46c5-4a6f-85e3-63ab11411603'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.361220 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d1525627-46c5-4a6f-85e3-63ab11411603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2dc311893f4ef498de38bb555411f5', 'request_id': 'req-d1525627-46c5-4a6f-85e3-63ab11411603'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.372602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d1525627-46c5-4a6f-85e3-63ab11411603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2dc311893f4ef498de38bb555411f5', 'request_id': 'req-d1525627-46c5-4a6f-85e3-63ab11411603'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.387129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d1525627-46c5-4a6f-85e3-63ab11411603 admin admin] The token cache is being invalidate because project 1e2dc311893f4ef498de38bb555411f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:31.388191 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d1525627-46c5-4a6f-85e3-63ab11411603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.389077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d1525627-46c5-4a6f-85e3-63ab11411603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.391938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 891/1769] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:31 2022] DELETE /identity/v3/projects/1e2dc311893f4ef498de38bb555411f5 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:31.396568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d187d-0539-4439-a29e-abe83d4ba4d9 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:31.416532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d187d-0539-4439-a29e-abe83d4ba4d9 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:31.492863 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46f986-75dc-4864-a37e-f11ef6385249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:31.493766 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46f986-75dc-4864-a37e-f11ef6385249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:31.494733 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46f986-75dc-4864-a37e-f11ef6385249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:31.495034 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46f986-75dc-4864-a37e-f11ef6385249 admin admin] PATH_INFO: `/v3/users/ba3b7077c1254d1bad80f140295cc332` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:31.496364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46f986-75dc-4864-a37e-f11ef6385249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba3b7077c1254d1bad80f140295cc332)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:31.498393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46f986-75dc-4864-a37e-f11ef6385249 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:31.766211 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e46f986-75dc-4864-a37e-f11ef6385249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba3b7077c1254d1bad80f140295cc332'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.781416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e46f986-75dc-4864-a37e-f11ef6385249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba3b7077c1254d1bad80f140295cc332'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.782473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e46f986-75dc-4864-a37e-f11ef6385249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba3b7077c1254d1bad80f140295cc332'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.793462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e46f986-75dc-4864-a37e-f11ef6385249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba3b7077c1254d1bad80f140295cc332'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.794198 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e46f986-75dc-4864-a37e-f11ef6385249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba3b7077c1254d1bad80f140295cc332'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:31.921094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 879/1770] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:31 2022] DELETE /identity/v3/users/ba3b7077c1254d1bad80f140295cc332 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:32.012897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:32.179597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:32.413689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb599218-a67a-4c8b-a8f9-cf2dbf8df8b5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:32.414133 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb599218-a67a-4c8b-a8f9-cf2dbf8df8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:32.414449 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb599218-a67a-4c8b-a8f9-cf2dbf8df8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:32.471499 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fb599218-a67a-4c8b-a8f9-cf2dbf8df8b5 None None] MFA Rules not processed for user `b4fc5b03167f49509cfa8354587d3048`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:32.472804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fb599218-a67a-4c8b-a8f9-cf2dbf8df8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:32.544732 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 892/1771] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:32.549880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46f986-75dc-4864-a37e-f11ef6385249 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:32.551628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4e46f986-75dc-4864-a37e-f11ef6385249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:32.651137 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46f986-75dc-4864-a37e-f11ef6385249 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:32.656079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8cab9-fce3-4754-a9e5-dbecef749e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:32.656924 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8cab9-fce3-4754-a9e5-dbecef749e88 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:32.657280 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8cab9-fce3-4754-a9e5-dbecef749e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:32.657690 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8cab9-fce3-4754-a9e5-dbecef749e88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:32.658397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8cab9-fce3-4754-a9e5-dbecef749e88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:32.660355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8cab9-fce3-4754-a9e5-dbecef749e88 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:32.825128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 880/1772] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:32 2022] POST /identity/v3/projects => generated 371 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:32.829409 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb599218-a67a-4c8b-a8f9-cf2dbf8df8b5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:32.846770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb599218-a67a-4c8b-a8f9-cf2dbf8df8b5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:32.933655 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c8b66-ee7b-493c-8e6d-5bb0d7ec1e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:32.940225 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c8b66-ee7b-493c-8e6d-5bb0d7ec1e03 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:32.940225 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c8b66-ee7b-493c-8e6d-5bb0d7ec1e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:32.940225 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c8b66-ee7b-493c-8e6d-5bb0d7ec1e03 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:32.940225 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c8b66-ee7b-493c-8e6d-5bb0d7ec1e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:32.940225 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c8b66-ee7b-493c-8e6d-5bb0d7ec1e03 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:32.944720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8cab9-fce3-4754-a9e5-dbecef749e88 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:32.946946 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b5b8cab9-fce3-4754-a9e5-dbecef749e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:32.967863 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8cab9-fce3-4754-a9e5-dbecef749e88 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:32.976266 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7d380-83be-489d-aa4b-00846fd61c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:32.977568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7d380-83be-489d-aa4b-00846fd61c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:32.984772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7d380-83be-489d-aa4b-00846fd61c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:32.984772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7d380-83be-489d-aa4b-00846fd61c92 admin admin] PATH_INFO: `/v3/projects/38798767c8534e248dd26c9a9d0fb571` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:32.984772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7d380-83be-489d-aa4b-00846fd61c92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38798767c8534e248dd26c9a9d0fb571)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:32.985819 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7d380-83be-489d-aa4b-00846fd61c92 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:33.132464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 893/1773] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:32 2022] POST /identity/v3/users => generated 292 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:33.136527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c8b66-ee7b-493c-8e6d-5bb0d7ec1e03 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:33.147563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c8b66-ee7b-493c-8e6d-5bb0d7ec1e03 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:33.152379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b124498-f1e7-496a-8b1e-aa6ce6c23fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:33.153197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b124498-f1e7-496a-8b1e-aa6ce6c23fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:33.153492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b124498-f1e7-496a-8b1e-aa6ce6c23fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:33.153776 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b124498-f1e7-496a-8b1e-aa6ce6c23fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:33.154792 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b124498-f1e7-496a-8b1e-aa6ce6c23fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:33.156498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b124498-f1e7-496a-8b1e-aa6ce6c23fa6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:33.167647 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 894/1774] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:33.173632 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b124498-f1e7-496a-8b1e-aa6ce6c23fa6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:33.174913 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3bf7d380-83be-489d-aa4b-00846fd61c92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38798767c8534e248dd26c9a9d0fb571', 'request_id': 'req-3bf7d380-83be-489d-aa4b-00846fd61c92'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.183890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3bf7d380-83be-489d-aa4b-00846fd61c92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38798767c8534e248dd26c9a9d0fb571', 'request_id': 'req-3bf7d380-83be-489d-aa4b-00846fd61c92'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.184163 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b124498-f1e7-496a-8b1e-aa6ce6c23fa6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:33.250885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d950b4f-dddc-4e3e-87f5-3eebfd98f53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:33.251822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d950b4f-dddc-4e3e-87f5-3eebfd98f53a admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:33.252153 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d950b4f-dddc-4e3e-87f5-3eebfd98f53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:33.252440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d950b4f-dddc-4e3e-87f5-3eebfd98f53a admin admin] PATH_INFO: `/v3/projects/057b636838734b9fab27c5094ec61a31/users/c79651c0208548c097831828fef957db/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:33.269136 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d950b4f-dddc-4e3e-87f5-3eebfd98f53a admin admin] RBAC: Authorizing `identity:create_grant(project_id=057b636838734b9fab27c5094ec61a31, user_id=c79651c0208548c097831828fef957db, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:33.272529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d950b4f-dddc-4e3e-87f5-3eebfd98f53a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:33.333925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3bf7d380-83be-489d-aa4b-00846fd61c92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38798767c8534e248dd26c9a9d0fb571', 'request_id': 'req-3bf7d380-83be-489d-aa4b-00846fd61c92'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.355375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3bf7d380-83be-489d-aa4b-00846fd61c92 admin admin] The token cache is being invalidate because project 38798767c8534e248dd26c9a9d0fb571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:33.355977 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3bf7d380-83be-489d-aa4b-00846fd61c92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.359376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3bf7d380-83be-489d-aa4b-00846fd61c92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:33.363634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 881/1775] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:32 2022] DELETE /identity/v3/projects/38798767c8534e248dd26c9a9d0fb571 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:33.372350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf042b45-005f-49a4-a13c-e479210901a2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:33.373040 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf042b45-005f-49a4-a13c-e479210901a2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:33.373040 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf042b45-005f-49a4-a13c-e479210901a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:33.396330 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cf042b45-005f-49a4-a13c-e479210901a2 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:33.401500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cf042b45-005f-49a4-a13c-e479210901a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:33.412631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 895/1776] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:33 2022] PUT /identity/v3/projects/057b636838734b9fab27c5094ec61a31/users/c79651c0208548c097831828fef957db/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:33.414935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d950b4f-dddc-4e3e-87f5-3eebfd98f53a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:33.417629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2d950b4f-dddc-4e3e-87f5-3eebfd98f53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:33.518123 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 882/1777] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:33.530445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe6087-d1bd-464a-be19-ed487f22fce3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:33.530790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe6087-d1bd-464a-be19-ed487f22fce3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:33.531081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe6087-d1bd-464a-be19-ed487f22fce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:33.534998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d950b4f-dddc-4e3e-87f5-3eebfd98f53a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:33.544928 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef619f7-f4d9-416f-80df-a42e37e22ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:33.545690 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef619f7-f4d9-416f-80df-a42e37e22ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:33.546052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef619f7-f4d9-416f-80df-a42e37e22ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:33.546415 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef619f7-f4d9-416f-80df-a42e37e22ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:33.547362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef619f7-f4d9-416f-80df-a42e37e22ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:33.550360 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef619f7-f4d9-416f-80df-a42e37e22ca1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:33.562443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c3fe6087-d1bd-464a-be19-ed487f22fce3 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:33.563746 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c3fe6087-d1bd-464a-be19-ed487f22fce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:33.570720 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 896/1778] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:33.574666 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef619f7-f4d9-416f-80df-a42e37e22ca1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:33.576244 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 883/1779] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:33.577488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe6087-d1bd-464a-be19-ed487f22fce3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:33.588468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe6087-d1bd-464a-be19-ed487f22fce3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:33.594684 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cb6a8-1592-43cd-afdf-62fc1def723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:33.595727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cb6a8-1592-43cd-afdf-62fc1def723c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:33.596223 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cb6a8-1592-43cd-afdf-62fc1def723c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:33.596690 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cb6a8-1592-43cd-afdf-62fc1def723c admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:33.597615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cb6a8-1592-43cd-afdf-62fc1def723c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:33.598075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cb6a8-1592-43cd-afdf-62fc1def723c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:33.600773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cb6a8-1592-43cd-afdf-62fc1def723c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:33.606994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef619f7-f4d9-416f-80df-a42e37e22ca1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:33.615500 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011e64a-5607-4e42-86ef-d7bcf9a8bf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:33.615849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 884/1780] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:33.621248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011e64a-5607-4e42-86ef-d7bcf9a8bf60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:33.621248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011e64a-5607-4e42-86ef-d7bcf9a8bf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:33.621248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011e64a-5607-4e42-86ef-d7bcf9a8bf60 admin admin] PATH_INFO: `/v3/projects/057b636838734b9fab27c5094ec61a31/users/c79651c0208548c097831828fef957db/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:33.635866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cb6a8-1592-43cd-afdf-62fc1def723c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:33.643328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011e64a-5607-4e42-86ef-d7bcf9a8bf60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=057b636838734b9fab27c5094ec61a31, user_id=c79651c0208548c097831828fef957db, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:33.649960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011e64a-5607-4e42-86ef-d7bcf9a8bf60 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:33.672598 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cb6a8-1592-43cd-afdf-62fc1def723c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:33.688270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 897/1781] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:33 2022] PUT /identity/v3/projects/057b636838734b9fab27c5094ec61a31/users/c79651c0208548c097831828fef957db/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:33.844362 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aeb9d9-c4d9-4b00-a86a-4d8111f85f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:33.845835 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb9d9-c4d9-4b00-a86a-4d8111f85f45 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:33.846138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb9d9-c4d9-4b00-a86a-4d8111f85f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:33.847513 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aeb9d9-c4d9-4b00-a86a-4d8111f85f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:33.847513 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aeb9d9-c4d9-4b00-a86a-4d8111f85f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:33.849351 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aeb9d9-c4d9-4b00-a86a-4d8111f85f45 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:34.001377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 885/1782] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:33 2022] POST /identity/v3/projects => generated 391 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:34.006209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011e64a-5607-4e42-86ef-d7bcf9a8bf60 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:34.025414 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011e64a-5607-4e42-86ef-d7bcf9a8bf60 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:34.166866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2a3a1-1639-43f3-9326-615eee3aaaf4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.167201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2a3a1-1639-43f3-9326-615eee3aaaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.167452 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2a3a1-1639-43f3-9326-615eee3aaaf4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.169406 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 886/1783] 10.222.0.50 () {54 vars in 921 bytes} [Thu Jun 2 16:06:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 16:06:34.171381 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195a3a3-94a9-48b6-a96e-e8dbea2009d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:34.173123 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195a3a3-94a9-48b6-a96e-e8dbea2009d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.173631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195a3a3-94a9-48b6-a96e-e8dbea2009d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.180690 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195a3a3-94a9-48b6-a96e-e8dbea2009d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.181654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195a3a3-94a9-48b6-a96e-e8dbea2009d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:34.184056 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195a3a3-94a9-48b6-a96e-e8dbea2009d4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:34.188861 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b1d61-03e0-41bb-9294-ebcee54d2e39 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.189179 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b1d61-03e0-41bb-9294-ebcee54d2e39 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.189461 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b1d61-03e0-41bb-9294-ebcee54d2e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.219965 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-560b1d61-03e0-41bb-9294-ebcee54d2e39 None None] MFA Rules not processed for user `2e53683ae2b34947a1550de269b74d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:34.221208 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-560b1d61-03e0-41bb-9294-ebcee54d2e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:34.326305 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 887/1784] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Jun 2 16:06:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:34.342029 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b1d61-03e0-41bb-9294-ebcee54d2e39 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:34.344268 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-560b1d61-03e0-41bb-9294-ebcee54d2e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:34.363290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b1d61-03e0-41bb-9294-ebcee54d2e39 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:34.378806 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a17ecf-9e9f-4399-9ac9-45b3cac3553e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:34.380719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a17ecf-9e9f-4399-9ac9-45b3cac3553e service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.381041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a17ecf-9e9f-4399-9ac9-45b3cac3553e service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.384228 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a17ecf-9e9f-4399-9ac9-45b3cac3553e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.393795 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 898/1785] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:34 2022] POST /identity/v3/users => generated 296 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:34.394704 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195a3a3-94a9-48b6-a96e-e8dbea2009d4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:34.412311 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a17ecf-9e9f-4399-9ac9-45b3cac3553e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:34.415555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195a3a3-94a9-48b6-a96e-e8dbea2009d4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:34.416775 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a17ecf-9e9f-4399-9ac9-45b3cac3553e service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:34.429765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62798665-b153-4297-8e38-5fa61f8a0381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:34.430704 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62798665-b153-4297-8e38-5fa61f8a0381 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.431136 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62798665-b153-4297-8e38-5fa61f8a0381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.431566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62798665-b153-4297-8e38-5fa61f8a0381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.432708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62798665-b153-4297-8e38-5fa61f8a0381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:34.434978 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62798665-b153-4297-8e38-5fa61f8a0381 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:34.451795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 888/1786] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:34.457471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 899/1787] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:34.462373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a17ecf-9e9f-4399-9ac9-45b3cac3553e service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:34.481137 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a17ecf-9e9f-4399-9ac9-45b3cac3553e service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:34.494028 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63cf5a-8386-4487-accf-cb5078b74761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:34.494717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63cf5a-8386-4487-accf-cb5078b74761 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.495007 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63cf5a-8386-4487-accf-cb5078b74761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.495290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63cf5a-8386-4487-accf-cb5078b74761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.496355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63cf5a-8386-4487-accf-cb5078b74761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:34.498148 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63cf5a-8386-4487-accf-cb5078b74761 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:34.519945 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 889/1788] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:34.525323 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62798665-b153-4297-8e38-5fa61f8a0381 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:34.538248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62798665-b153-4297-8e38-5fa61f8a0381 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:34.544922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f40b96-500d-4916-aa23-65aa9eace4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:34.546104 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f40b96-500d-4916-aa23-65aa9eace4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.546454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f40b96-500d-4916-aa23-65aa9eace4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.546801 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f40b96-500d-4916-aa23-65aa9eace4bc admin admin] PATH_INFO: `/v3/projects/5c4b5d3cbc154a35a066a72ae2ff8108/users/777fd698362f4097aaa52b7ae49dccc3/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.565926 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f40b96-500d-4916-aa23-65aa9eace4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c4b5d3cbc154a35a066a72ae2ff8108, user_id=777fd698362f4097aaa52b7ae49dccc3, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:34.574610 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f40b96-500d-4916-aa23-65aa9eace4bc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:34.747405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:34.761401 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 900/1789] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:34 2022] PUT /identity/v3/projects/5c4b5d3cbc154a35a066a72ae2ff8108/users/777fd698362f4097aaa52b7ae49dccc3/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:34.777610 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42092eb9-9df6-4adf-930b-f5443bc40deb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:34.778010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42092eb9-9df6-4adf-930b-f5443bc40deb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:34.783103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42092eb9-9df6-4adf-930b-f5443bc40deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:34.810844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-42092eb9-9df6-4adf-930b-f5443bc40deb None None] MFA Rules not processed for user `777fd698362f4097aaa52b7ae49dccc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:34.812261 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-42092eb9-9df6-4adf-930b-f5443bc40deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:34.897366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 890/1790] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:34.902244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f40b96-500d-4916-aa23-65aa9eace4bc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:34.995269 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f40b96-500d-4916-aa23-65aa9eace4bc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:35.000316 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c1c2b-60a2-412b-bd52-a66b31955a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:35.001211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c1c2b-60a2-412b-bd52-a66b31955a80 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:35.001844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c1c2b-60a2-412b-bd52-a66b31955a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:35.002286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c1c2b-60a2-412b-bd52-a66b31955a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:35.003025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c1c2b-60a2-412b-bd52-a66b31955a80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:35.005174 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c1c2b-60a2-412b-bd52-a66b31955a80 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:35.114839 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 901/1791] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:34 2022] POST /identity/v3/projects => generated 393 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:35.118959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42092eb9-9df6-4adf-930b-f5443bc40deb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:35.149046 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42092eb9-9df6-4adf-930b-f5443bc40deb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:35.275161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d140fa-18d6-423f-a9a0-9cdc7089ad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:35.276164 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d140fa-18d6-423f-a9a0-9cdc7089ad1a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:35.276339 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d140fa-18d6-423f-a9a0-9cdc7089ad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:35.276795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d140fa-18d6-423f-a9a0-9cdc7089ad1a admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:35.278628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d140fa-18d6-423f-a9a0-9cdc7089ad1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:35.280934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d140fa-18d6-423f-a9a0-9cdc7089ad1a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:35.456731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 891/1792] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:35 2022] POST /identity/v3/users => generated 303 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:35.460695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c1c2b-60a2-412b-bd52-a66b31955a80 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:35.476956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c1c2b-60a2-412b-bd52-a66b31955a80 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:35.490295 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9539-b833-4858-9f20-06aafcac567a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:35.491677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9539-b833-4858-9f20-06aafcac567a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:35.492753 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9539-b833-4858-9f20-06aafcac567a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:35.493148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9539-b833-4858-9f20-06aafcac567a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:35.493999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c9539-b833-4858-9f20-06aafcac567a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:35.515555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c9539-b833-4858-9f20-06aafcac567a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:35.530086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 902/1793] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:35.534678 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d140fa-18d6-423f-a9a0-9cdc7089ad1a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:35.564401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d140fa-18d6-423f-a9a0-9cdc7089ad1a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:35.589206 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2ad81-d0e7-4548-b81c-1ae5482dfa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:35.593319 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2ad81-d0e7-4548-b81c-1ae5482dfa5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:35.593628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2ad81-d0e7-4548-b81c-1ae5482dfa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:35.593920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2ad81-d0e7-4548-b81c-1ae5482dfa5a admin admin] PATH_INFO: `/v3/projects/e5e4778fa1064a51af916e857794c0e9/users/4d60fb42230949509ff03a842a61f2b5/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:35.621280 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2ad81-d0e7-4548-b81c-1ae5482dfa5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e4778fa1064a51af916e857794c0e9, user_id=4d60fb42230949509ff03a842a61f2b5, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:35.623473 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:35.627767 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2ad81-d0e7-4548-b81c-1ae5482dfa5a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:35.728693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9539-b833-4858-9f20-06aafcac567a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:35.733048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 892/1794] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:35 2022] PUT /identity/v3/projects/e5e4778fa1064a51af916e857794c0e9/users/4d60fb42230949509ff03a842a61f2b5/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:35.743073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9539-b833-4858-9f20-06aafcac567a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:35.811437 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6588d-3522-44e6-8cb4-c36e2e08f380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:35.812440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6588d-3522-44e6-8cb4-c36e2e08f380 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:35.812929 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6588d-3522-44e6-8cb4-c36e2e08f380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:35.813391 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6588d-3522-44e6-8cb4-c36e2e08f380 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:35.814278 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6588d-3522-44e6-8cb4-c36e2e08f380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:35.816353 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6588d-3522-44e6-8cb4-c36e2e08f380 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:35.830920 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 903/1795] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:06:35.835684 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2ad81-d0e7-4548-b81c-1ae5482dfa5a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:35.847952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2ad81-d0e7-4548-b81c-1ae5482dfa5a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:35.853756 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4ce7a-0b31-4bb4-9bb1-23573588feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:35.854846 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4ce7a-0b31-4bb4-9bb1-23573588feb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:35.856172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4ce7a-0b31-4bb4-9bb1-23573588feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:35.856528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4ce7a-0b31-4bb4-9bb1-23573588feb7 admin admin] PATH_INFO: `/v3/projects/e5e4778fa1064a51af916e857794c0e9/users/4d60fb42230949509ff03a842a61f2b5/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:35.859169 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4ce7a-0b31-4bb4-9bb1-23573588feb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e4778fa1064a51af916e857794c0e9, user_id=4d60fb42230949509ff03a842a61f2b5, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:35.862015 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4ce7a-0b31-4bb4-9bb1-23573588feb7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:35.906440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 893/1796] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:35 2022] PUT /identity/v3/projects/e5e4778fa1064a51af916e857794c0e9/users/4d60fb42230949509ff03a842a61f2b5/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:35.907068 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257d256-627d-4140-9891-16359f043a5a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:35.907442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257d256-627d-4140-9891-16359f043a5a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:35.908094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257d256-627d-4140-9891-16359f043a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:35.969717 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5257d256-627d-4140-9891-16359f043a5a None None] MFA Rules not processed for user `4d60fb42230949509ff03a842a61f2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:35.972677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5257d256-627d-4140-9891-16359f043a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:36.127180 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 904/1797] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:36.137097 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4ce7a-0b31-4bb4-9bb1-23573588feb7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:36.144543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-99a4ce7a-0b31-4bb4-9bb1-23573588feb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:36.243857 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4ce7a-0b31-4bb4-9bb1-23573588feb7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:36.256585 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27903c-f2fe-4b83-b930-7bc61fae367f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:36.258452 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27903c-f2fe-4b83-b930-7bc61fae367f service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:36.258994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27903c-f2fe-4b83-b930-7bc61fae367f service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:36.259471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27903c-f2fe-4b83-b930-7bc61fae367f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:36.272404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27903c-f2fe-4b83-b930-7bc61fae367f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:36.274128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27903c-f2fe-4b83-b930-7bc61fae367f service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:36.286652 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 894/1798] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:36.435748 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257d256-627d-4140-9891-16359f043a5a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:36.451667 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257d256-627d-4140-9891-16359f043a5a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:36.460830 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb456a8-62b0-46de-b39f-5840cc2b35c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:36.462228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb456a8-62b0-46de-b39f-5840cc2b35c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:36.463845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb456a8-62b0-46de-b39f-5840cc2b35c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:36.464170 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb456a8-62b0-46de-b39f-5840cc2b35c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:36.556063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb456a8-62b0-46de-b39f-5840cc2b35c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:36.559357 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb456a8-62b0-46de-b39f-5840cc2b35c7 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:36.574024 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 905/1799] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:37.009115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:37.146337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de975cc9-43fb-4148-b385-0f8e31c9f7fa None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:37.146690 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de975cc9-43fb-4148-b385-0f8e31c9f7fa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:37.147001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de975cc9-43fb-4148-b385-0f8e31c9f7fa None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:37.148544 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 895/1800] 10.222.0.50 () {54 vars in 921 bytes} [Thu Jun 2 16:06:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:06:37.161667 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2cc27-ffeb-4b0f-ae66-1177c61e04a4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:37.161667 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2cc27-ffeb-4b0f-ae66-1177c61e04a4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:37.161667 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2cc27-ffeb-4b0f-ae66-1177c61e04a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:37.208320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-71d2cc27-ffeb-4b0f-ae66-1177c61e04a4 None None] MFA Rules not processed for user `2e53683ae2b34947a1550de269b74d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:37.214970 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-71d2cc27-ffeb-4b0f-ae66-1177c61e04a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:37.427506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 906/1801] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Jun 2 16:06:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:37.532479 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de975cc9-43fb-4148-b385-0f8e31c9f7fa None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:37.548531 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de975cc9-43fb-4148-b385-0f8e31c9f7fa None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:37.561017 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34667f7d-020c-45f3-bda0-e6a152cb7a12 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:37.561605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34667f7d-020c-45f3-bda0-e6a152cb7a12 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:37.561605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34667f7d-020c-45f3-bda0-e6a152cb7a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:37.566457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51283e-3a74-40fe-963a-e3755c8c4bcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:37.567657 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51283e-3a74-40fe-963a-e3755c8c4bcb service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:37.567949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51283e-3a74-40fe-963a-e3755c8c4bcb service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:37.568262 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51283e-3a74-40fe-963a-e3755c8c4bcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:37.577922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51283e-3a74-40fe-963a-e3755c8c4bcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:37.580438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc51283e-3a74-40fe-963a-e3755c8c4bcb service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:37.596834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-34667f7d-020c-45f3-bda0-e6a152cb7a12 None None] MFA Rules not processed for user `c79651c0208548c097831828fef957db`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:37.598993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-34667f7d-020c-45f3-bda0-e6a152cb7a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:37.610937 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 896/1802] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:37.674948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 907/1803] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:37.687384 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12447b2-8ac4-412f-b91d-15017989e251 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:37.687708 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12447b2-8ac4-412f-b91d-15017989e251 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:37.688011 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12447b2-8ac4-412f-b91d-15017989e251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:37.706913 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a12447b2-8ac4-412f-b91d-15017989e251 None None] MFA Rules not processed for user `b4fc5b03167f49509cfa8354587d3048`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:37.708716 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a12447b2-8ac4-412f-b91d-15017989e251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:37.796605 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 897/1804] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:37.809883 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34667f7d-020c-45f3-bda0-e6a152cb7a12 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:37.811613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-34667f7d-020c-45f3-bda0-e6a152cb7a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:37.840223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34667f7d-020c-45f3-bda0-e6a152cb7a12 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:37.840223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ffec5-befd-40d0-8e5a-8e786e5d59f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:37.840223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ffec5-befd-40d0-8e5a-8e786e5d59f7 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:37.840223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ffec5-befd-40d0-8e5a-8e786e5d59f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:37.840585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ffec5-befd-40d0-8e5a-8e786e5d59f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:37.846885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-da4ffec5-befd-40d0-8e5a-8e786e5d59f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:37.869355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ffec5-befd-40d0-8e5a-8e786e5d59f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:37.869355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ffec5-befd-40d0-8e5a-8e786e5d59f7 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:37.895810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 908/1805] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:38.825400 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12447b2-8ac4-412f-b91d-15017989e251 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:38.827968 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a12447b2-8ac4-412f-b91d-15017989e251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:38.925190 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12447b2-8ac4-412f-b91d-15017989e251 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:38.930159 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf50909-575d-4b67-8a39-8952ee925706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:38.931117 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf50909-575d-4b67-8a39-8952ee925706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:38.931472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf50909-575d-4b67-8a39-8952ee925706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:38.931824 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf50909-575d-4b67-8a39-8952ee925706 admin admin] PATH_INFO: `/v3/users/8376ea747b37408b87b9e4c3b94dacdf` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:38.933274 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf50909-575d-4b67-8a39-8952ee925706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8376ea747b37408b87b9e4c3b94dacdf)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:38.935200 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf50909-575d-4b67-8a39-8952ee925706 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:39.209843 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8bf50909-575d-4b67-8a39-8952ee925706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8376ea747b37408b87b9e4c3b94dacdf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:39.247407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8bf50909-575d-4b67-8a39-8952ee925706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8376ea747b37408b87b9e4c3b94dacdf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:39.248461 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8bf50909-575d-4b67-8a39-8952ee925706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8376ea747b37408b87b9e4c3b94dacdf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:39.257939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8bf50909-575d-4b67-8a39-8952ee925706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8376ea747b37408b87b9e4c3b94dacdf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:39.260525 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8bf50909-575d-4b67-8a39-8952ee925706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8376ea747b37408b87b9e4c3b94dacdf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:39.482808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 898/1806] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:38 2022] DELETE /identity/v3/users/8376ea747b37408b87b9e4c3b94dacdf => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:39.487528 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ac81a-de17-45cd-810c-b6bfc06d2888 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:39.487999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ac81a-de17-45cd-810c-b6bfc06d2888 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:39.488177 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ac81a-de17-45cd-810c-b6bfc06d2888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:39.520175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7a2ac81a-de17-45cd-810c-b6bfc06d2888 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:39.521576 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7a2ac81a-de17-45cd-810c-b6bfc06d2888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:39.584434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 909/1807] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:39.593916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf50909-575d-4b67-8a39-8952ee925706 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:39.614321 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8bf50909-575d-4b67-8a39-8952ee925706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:39.656792 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf50909-575d-4b67-8a39-8952ee925706 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:39.661846 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a17f5-bb83-4ea2-a082-2f29d0669276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:39.662893 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a17f5-bb83-4ea2-a082-2f29d0669276 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:39.663334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a17f5-bb83-4ea2-a082-2f29d0669276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:39.663762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a17f5-bb83-4ea2-a082-2f29d0669276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:39.678804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a17f5-bb83-4ea2-a082-2f29d0669276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:39.681358 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a17f5-bb83-4ea2-a082-2f29d0669276 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:39.705577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 899/1808] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:39.750948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:40.404493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ac81a-de17-45cd-810c-b6bfc06d2888 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:40.404493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7a2ac81a-de17-45cd-810c-b6bfc06d2888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:40.443309 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ac81a-de17-45cd-810c-b6bfc06d2888 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:40.460956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2264f4-41a7-4cd9-a224-d223ff19e197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:40.462872 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2264f4-41a7-4cd9-a224-d223ff19e197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:40.464564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2264f4-41a7-4cd9-a224-d223ff19e197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:40.465064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2264f4-41a7-4cd9-a224-d223ff19e197 admin admin] PATH_INFO: `/v3/projects/530ceebbbab6438aa921240a147709b2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:40.468724 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2264f4-41a7-4cd9-a224-d223ff19e197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=530ceebbbab6438aa921240a147709b2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:40.476125 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2264f4-41a7-4cd9-a224-d223ff19e197 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:40.669108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c2264f4-41a7-4cd9-a224-d223ff19e197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '530ceebbbab6438aa921240a147709b2', 'request_id': 'req-0c2264f4-41a7-4cd9-a224-d223ff19e197'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:40.840212 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c2264f4-41a7-4cd9-a224-d223ff19e197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '530ceebbbab6438aa921240a147709b2', 'request_id': 'req-0c2264f4-41a7-4cd9-a224-d223ff19e197'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:40.847397 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c2264f4-41a7-4cd9-a224-d223ff19e197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '530ceebbbab6438aa921240a147709b2', 'request_id': 'req-0c2264f4-41a7-4cd9-a224-d223ff19e197'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:40.858896 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c2264f4-41a7-4cd9-a224-d223ff19e197 admin admin] The token cache is being invalidate because project 530ceebbbab6438aa921240a147709b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:40.859181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c2264f4-41a7-4cd9-a224-d223ff19e197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:40.859894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0c2264f4-41a7-4cd9-a224-d223ff19e197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:40.861765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 910/1809] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:40 2022] DELETE /identity/v3/projects/530ceebbbab6438aa921240a147709b2 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:40.865529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a17f5-bb83-4ea2-a082-2f29d0669276 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:40.875093 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a17f5-bb83-4ea2-a082-2f29d0669276 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:40.960360 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c284c-63a3-45c1-af5c-fcbd0471752f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:40.961513 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c284c-63a3-45c1-af5c-fcbd0471752f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:40.962035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c284c-63a3-45c1-af5c-fcbd0471752f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:40.962396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c284c-63a3-45c1-af5c-fcbd0471752f admin admin] PATH_INFO: `/v3/users/3b46dfa20a544ae4805ba15c399fbf2a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:40.963819 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c284c-63a3-45c1-af5c-fcbd0471752f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b46dfa20a544ae4805ba15c399fbf2a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:40.965978 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c284c-63a3-45c1-af5c-fcbd0471752f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:41.276600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-000c284c-63a3-45c1-af5c-fcbd0471752f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b46dfa20a544ae4805ba15c399fbf2a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:41.290438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-000c284c-63a3-45c1-af5c-fcbd0471752f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b46dfa20a544ae4805ba15c399fbf2a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:41.291156 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-000c284c-63a3-45c1-af5c-fcbd0471752f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b46dfa20a544ae4805ba15c399fbf2a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:41.298247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-000c284c-63a3-45c1-af5c-fcbd0471752f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b46dfa20a544ae4805ba15c399fbf2a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:41.298904 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-000c284c-63a3-45c1-af5c-fcbd0471752f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b46dfa20a544ae4805ba15c399fbf2a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:41.412348 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 900/1810] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:40 2022] DELETE /identity/v3/users/3b46dfa20a544ae4805ba15c399fbf2a => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:42.051319 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2264f4-41a7-4cd9-a224-d223ff19e197 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:42.053329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0c2264f4-41a7-4cd9-a224-d223ff19e197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:42.072297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2264f4-41a7-4cd9-a224-d223ff19e197 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:42.159172 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da169737-3729-410f-b500-bfb8a14d1a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:42.160106 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da169737-3729-410f-b500-bfb8a14d1a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:42.160967 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da169737-3729-410f-b500-bfb8a14d1a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:42.161250 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da169737-3729-410f-b500-bfb8a14d1a1b admin admin] PATH_INFO: `/v3/projects/fccbddedc2a247a99d14d3e100c8ccc1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:42.162471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da169737-3729-410f-b500-bfb8a14d1a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fccbddedc2a247a99d14d3e100c8ccc1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:42.164625 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da169737-3729-410f-b500-bfb8a14d1a1b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:42.388508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-da169737-3729-410f-b500-bfb8a14d1a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fccbddedc2a247a99d14d3e100c8ccc1', 'request_id': 'req-da169737-3729-410f-b500-bfb8a14d1a1b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:42.543295 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-da169737-3729-410f-b500-bfb8a14d1a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fccbddedc2a247a99d14d3e100c8ccc1', 'request_id': 'req-da169737-3729-410f-b500-bfb8a14d1a1b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:42.552504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-da169737-3729-410f-b500-bfb8a14d1a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fccbddedc2a247a99d14d3e100c8ccc1', 'request_id': 'req-da169737-3729-410f-b500-bfb8a14d1a1b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:42.565922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-da169737-3729-410f-b500-bfb8a14d1a1b admin admin] The token cache is being invalidate because project fccbddedc2a247a99d14d3e100c8ccc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:42.566217 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-da169737-3729-410f-b500-bfb8a14d1a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:42.567524 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-da169737-3729-410f-b500-bfb8a14d1a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:42.569180 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 911/1811] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:42 2022] DELETE /identity/v3/projects/fccbddedc2a247a99d14d3e100c8ccc1 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:42.574499 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c75aa-7c0f-48be-89da-83cb9f3f19c2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:42.575031 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c75aa-7c0f-48be-89da-83cb9f3f19c2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:42.575212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c75aa-7c0f-48be-89da-83cb9f3f19c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:42.593402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b40c75aa-7c0f-48be-89da-83cb9f3f19c2 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:42.594698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b40c75aa-7c0f-48be-89da-83cb9f3f19c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:42.660265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 901/1812] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:42.669709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616822a1-b043-4ff8-9148-52e5877b3e22 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:42.669936 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616822a1-b043-4ff8-9148-52e5877b3e22 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:42.670218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616822a1-b043-4ff8-9148-52e5877b3e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:42.688564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-616822a1-b043-4ff8-9148-52e5877b3e22 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:42.689960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-616822a1-b043-4ff8-9148-52e5877b3e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:42.698499 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 912/1813] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:42.702757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c75aa-7c0f-48be-89da-83cb9f3f19c2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:42.713180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c75aa-7c0f-48be-89da-83cb9f3f19c2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:42.718155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d16e4b-2b83-4643-be04-8035aad61bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:42.718823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d16e4b-2b83-4643-be04-8035aad61bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:42.719114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d16e4b-2b83-4643-be04-8035aad61bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:42.719405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d16e4b-2b83-4643-be04-8035aad61bbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:42.720158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d16e4b-2b83-4643-be04-8035aad61bbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:42.720474 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d16e4b-2b83-4643-be04-8035aad61bbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:42.722079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d16e4b-2b83-4643-be04-8035aad61bbd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:42.738370 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 902/1814] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:42.739444 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616822a1-b043-4ff8-9148-52e5877b3e22 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:42.748998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616822a1-b043-4ff8-9148-52e5877b3e22 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:42.755201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38be3cc-ea09-48b3-b0bc-61212b0c94df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:42.755900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38be3cc-ea09-48b3-b0bc-61212b0c94df admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:42.756223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38be3cc-ea09-48b3-b0bc-61212b0c94df admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:42.756535 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38be3cc-ea09-48b3-b0bc-61212b0c94df admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:42.757366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38be3cc-ea09-48b3-b0bc-61212b0c94df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:42.759350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38be3cc-ea09-48b3-b0bc-61212b0c94df admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:42.873463 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 913/1815] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:42 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:06:42.877576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d16e4b-2b83-4643-be04-8035aad61bbd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:42.887883 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d16e4b-2b83-4643-be04-8035aad61bbd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:42.920483 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:42.977120 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ca05a-b1bc-4b30-ade0-239471b6b7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:42.978322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ca05a-b1bc-4b30-ade0-239471b6b7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:42.978889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ca05a-b1bc-4b30-ade0-239471b6b7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:42.979282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ca05a-b1bc-4b30-ade0-239471b6b7d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:42.980933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ca05a-b1bc-4b30-ade0-239471b6b7d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:42.984039 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ca05a-b1bc-4b30-ade0-239471b6b7d5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:43.127701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 903/1816] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:42 2022] POST /identity/v3/users => generated 283 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:43.131492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38be3cc-ea09-48b3-b0bc-61212b0c94df admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:43.143815 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38be3cc-ea09-48b3-b0bc-61212b0c94df admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:43.155623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a7b0d-fc61-4e32-886e-ab45ffe085c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:43.156593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a7b0d-fc61-4e32-886e-ab45ffe085c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:43.157109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a7b0d-fc61-4e32-886e-ab45ffe085c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:43.157723 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a7b0d-fc61-4e32-886e-ab45ffe085c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:43.158682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a7b0d-fc61-4e32-886e-ab45ffe085c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:43.160654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a7b0d-fc61-4e32-886e-ab45ffe085c7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:43.178093 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 914/1817] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:43.178184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ca05a-b1bc-4b30-ade0-239471b6b7d5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:43.178500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-565ca05a-b1bc-4b30-ade0-239471b6b7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:43.195786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a7b0d-fc61-4e32-886e-ab45ffe085c7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:43.202988 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ca05a-b1bc-4b30-ade0-239471b6b7d5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:43.208406 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d317f11-cf98-4b23-b5eb-458529d46177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:43.212933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d317f11-cf98-4b23-b5eb-458529d46177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:43.212933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d317f11-cf98-4b23-b5eb-458529d46177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:43.212933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d317f11-cf98-4b23-b5eb-458529d46177 admin admin] PATH_INFO: `/v3/users/777fd698362f4097aaa52b7ae49dccc3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:43.212933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d317f11-cf98-4b23-b5eb-458529d46177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=777fd698362f4097aaa52b7ae49dccc3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:43.213323 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a7b0d-fc61-4e32-886e-ab45ffe085c7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:43.213448 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d317f11-cf98-4b23-b5eb-458529d46177 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:43.217355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d86f16-4604-46aa-a286-877032ed702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:43.218746 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d86f16-4604-46aa-a286-877032ed702e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:43.219121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d86f16-4604-46aa-a286-877032ed702e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:43.219476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d86f16-4604-46aa-a286-877032ed702e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:43.220386 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d86f16-4604-46aa-a286-877032ed702e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:43.222151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d86f16-4604-46aa-a286-877032ed702e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:43.236113 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 915/1818] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:43.247145 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d86f16-4604-46aa-a286-877032ed702e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:43.258007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d86f16-4604-46aa-a286-877032ed702e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:43.263041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db6f2e-9769-46bd-a720-0685b913c9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:43.263934 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db6f2e-9769-46bd-a720-0685b913c9f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:43.264276 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db6f2e-9769-46bd-a720-0685b913c9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:43.264564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db6f2e-9769-46bd-a720-0685b913c9f1 admin admin] PATH_INFO: `/v3/projects/fcca4be5cd374be9ac7ab684a0575196/users/429dd8b93ffb4873b8470ebe5cda7c2e/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:43.280859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db6f2e-9769-46bd-a720-0685b913c9f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcca4be5cd374be9ac7ab684a0575196, user_id=429dd8b93ffb4873b8470ebe5cda7c2e, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:43.283591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db6f2e-9769-46bd-a720-0685b913c9f1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:43.387458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 916/1819] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:43 2022] PUT /identity/v3/projects/fcca4be5cd374be9ac7ab684a0575196/users/429dd8b93ffb4873b8470ebe5cda7c2e/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:43.398926 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfe968-b20a-4c73-9315-66ddce020541 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:43.399219 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfe968-b20a-4c73-9315-66ddce020541 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:43.399505 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfe968-b20a-4c73-9315-66ddce020541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:43.425819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-96dfe968-b20a-4c73-9315-66ddce020541 None None] MFA Rules not processed for user `429dd8b93ffb4873b8470ebe5cda7c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:43.426972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-96dfe968-b20a-4c73-9315-66ddce020541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:43.489503 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 917/1820] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:43.493736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfe968-b20a-4c73-9315-66ddce020541 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:43.574293 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2d317f11-cf98-4b23-b5eb-458529d46177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777fd698362f4097aaa52b7ae49dccc3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:43.575766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfe968-b20a-4c73-9315-66ddce020541 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:43.581602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f0974-19c6-4248-b9c6-4007c441ee0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:43.582909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f0974-19c6-4248-b9c6-4007c441ee0e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:43.583249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f0974-19c6-4248-b9c6-4007c441ee0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:43.583532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f0974-19c6-4248-b9c6-4007c441ee0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:43.584261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f0974-19c6-4248-b9c6-4007c441ee0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:43.586293 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f0974-19c6-4248-b9c6-4007c441ee0e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:43.593567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2d317f11-cf98-4b23-b5eb-458529d46177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777fd698362f4097aaa52b7ae49dccc3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:43.594509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2d317f11-cf98-4b23-b5eb-458529d46177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777fd698362f4097aaa52b7ae49dccc3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:43.603381 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2d317f11-cf98-4b23-b5eb-458529d46177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777fd698362f4097aaa52b7ae49dccc3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:43.604240 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2d317f11-cf98-4b23-b5eb-458529d46177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777fd698362f4097aaa52b7ae49dccc3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:43.726557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 904/1821] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:43 2022] DELETE /identity/v3/users/777fd698362f4097aaa52b7ae49dccc3 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:43.729533 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 918/1822] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:43 2022] POST /identity/v3/projects => generated 365 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:06:43.733826 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d317f11-cf98-4b23-b5eb-458529d46177 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:43.736299 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477cc6b-41b9-4188-91be-e00f977acb50 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:43.737336 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2d317f11-cf98-4b23-b5eb-458529d46177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:43.739493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477cc6b-41b9-4188-91be-e00f977acb50 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:43.740208 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477cc6b-41b9-4188-91be-e00f977acb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:43.786247 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d477cc6b-41b9-4188-91be-e00f977acb50 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:43.786247 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d477cc6b-41b9-4188-91be-e00f977acb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:43.919862 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d317f11-cf98-4b23-b5eb-458529d46177 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:43.961140 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 919/1823] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:43.994061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477cc6b-41b9-4188-91be-e00f977acb50 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:43.995502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d477cc6b-41b9-4188-91be-e00f977acb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:44.046045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eddbee-bfec-412c-a432-bfe26fb3e634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:44.046827 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eddbee-bfec-412c-a432-bfe26fb3e634 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:44.047119 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eddbee-bfec-412c-a432-bfe26fb3e634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:44.049796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eddbee-bfec-412c-a432-bfe26fb3e634 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:44.049796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eddbee-bfec-412c-a432-bfe26fb3e634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:44.051961 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eddbee-bfec-412c-a432-bfe26fb3e634 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:44.118731 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477cc6b-41b9-4188-91be-e00f977acb50 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:44.142372 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e0ced-11d2-46dc-8a05-41dfd2731af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:44.146327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e0ced-11d2-46dc-8a05-41dfd2731af6 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:44.146327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e0ced-11d2-46dc-8a05-41dfd2731af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:44.146327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e0ced-11d2-46dc-8a05-41dfd2731af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:44.161341 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e0ced-11d2-46dc-8a05-41dfd2731af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:44.162981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e0ced-11d2-46dc-8a05-41dfd2731af6 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:44.176037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 920/1824] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:06:44.240284 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 905/1825] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:43 2022] POST /identity/v3/users => generated 289 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:44.241115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e0ced-11d2-46dc-8a05-41dfd2731af6 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:44.253658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e0ced-11d2-46dc-8a05-41dfd2731af6 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:44.260188 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583fb85-bb3b-496d-8514-bfa2dbc5e3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:44.261036 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583fb85-bb3b-496d-8514-bfa2dbc5e3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:44.261644 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583fb85-bb3b-496d-8514-bfa2dbc5e3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:44.261822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583fb85-bb3b-496d-8514-bfa2dbc5e3b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:44.262780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583fb85-bb3b-496d-8514-bfa2dbc5e3b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:44.266986 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583fb85-bb3b-496d-8514-bfa2dbc5e3b8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:44.280152 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 921/1826] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:06:44.284306 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eddbee-bfec-412c-a432-bfe26fb3e634 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:44.299422 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eddbee-bfec-412c-a432-bfe26fb3e634 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:44.305375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422268f-5264-4b6e-992d-ea05860a35af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:44.306687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422268f-5264-4b6e-992d-ea05860a35af admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:44.307081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422268f-5264-4b6e-992d-ea05860a35af admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:44.307489 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422268f-5264-4b6e-992d-ea05860a35af admin admin] PATH_INFO: `/v3/projects/fb339bb958e14845a6a10ee8d9fb93e3/users/57c6d23c3c1f4e42bf1e66958d9ccdd2/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:44.334520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422268f-5264-4b6e-992d-ea05860a35af admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb339bb958e14845a6a10ee8d9fb93e3, user_id=57c6d23c3c1f4e42bf1e66958d9ccdd2, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:44.340936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422268f-5264-4b6e-992d-ea05860a35af admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:44.453560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 906/1827] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:44 2022] PUT /identity/v3/projects/fb339bb958e14845a6a10ee8d9fb93e3/users/57c6d23c3c1f4e42bf1e66958d9ccdd2/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:44.457935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583fb85-bb3b-496d-8514-bfa2dbc5e3b8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:44.468264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583fb85-bb3b-496d-8514-bfa2dbc5e3b8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:44.555426 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57847328-05c9-42c1-9321-b440897590ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:44.556171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57847328-05c9-42c1-9321-b440897590ba admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:44.556438 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57847328-05c9-42c1-9321-b440897590ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:44.556718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57847328-05c9-42c1-9321-b440897590ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:44.557446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57847328-05c9-42c1-9321-b440897590ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:44.559070 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57847328-05c9-42c1-9321-b440897590ba admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:44.569955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 922/1828] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:44.575706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422268f-5264-4b6e-992d-ea05860a35af admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:44.589841 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422268f-5264-4b6e-992d-ea05860a35af admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:44.594726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38fc79-1fb9-4dff-a72e-ad421f96bc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:44.595743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38fc79-1fb9-4dff-a72e-ad421f96bc5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:44.596066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38fc79-1fb9-4dff-a72e-ad421f96bc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:44.596370 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38fc79-1fb9-4dff-a72e-ad421f96bc5c admin admin] PATH_INFO: `/v3/projects/fb339bb958e14845a6a10ee8d9fb93e3/users/57c6d23c3c1f4e42bf1e66958d9ccdd2/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:44.598546 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38fc79-1fb9-4dff-a72e-ad421f96bc5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb339bb958e14845a6a10ee8d9fb93e3, user_id=57c6d23c3c1f4e42bf1e66958d9ccdd2, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:44.601302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38fc79-1fb9-4dff-a72e-ad421f96bc5c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:44.612164 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 907/1829] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:44 2022] PUT /identity/v3/projects/fb339bb958e14845a6a10ee8d9fb93e3/users/57c6d23c3c1f4e42bf1e66958d9ccdd2/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:44.622904 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37c128-c63a-4341-bf6a-5fa85f7e2d53 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:44.623297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37c128-c63a-4341-bf6a-5fa85f7e2d53 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:44.623654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37c128-c63a-4341-bf6a-5fa85f7e2d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:44.656644 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5b37c128-c63a-4341-bf6a-5fa85f7e2d53 None None] MFA Rules not processed for user `57c6d23c3c1f4e42bf1e66958d9ccdd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:44.658333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5b37c128-c63a-4341-bf6a-5fa85f7e2d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:44.735495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 923/1830] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:44.747958 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38fc79-1fb9-4dff-a72e-ad421f96bc5c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:44.749788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9a38fc79-1fb9-4dff-a72e-ad421f96bc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:44.808387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38fc79-1fb9-4dff-a72e-ad421f96bc5c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:44.812170 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d318f-3658-4dd1-ae49-349c2d53fc72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:44.812821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d318f-3658-4dd1-ae49-349c2d53fc72 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:44.813113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d318f-3658-4dd1-ae49-349c2d53fc72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:44.813396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d318f-3658-4dd1-ae49-349c2d53fc72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:44.823434 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d318f-3658-4dd1-ae49-349c2d53fc72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:44.824953 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d318f-3658-4dd1-ae49-349c2d53fc72 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:44.835176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 908/1831] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:44.942211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37c128-c63a-4341-bf6a-5fa85f7e2d53 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:44.952784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37c128-c63a-4341-bf6a-5fa85f7e2d53 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:44.958313 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5a4ea-9157-4c17-a817-4934d9ed1125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:44.960935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5a4ea-9157-4c17-a817-4934d9ed1125 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:44.960935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5a4ea-9157-4c17-a817-4934d9ed1125 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:44.960935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5a4ea-9157-4c17-a817-4934d9ed1125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:44.961697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8fa5a4ea-9157-4c17-a817-4934d9ed1125 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:45.037575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5a4ea-9157-4c17-a817-4934d9ed1125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:45.040703 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa5a4ea-9157-4c17-a817-4934d9ed1125 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:45.054684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 924/1832] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:45.302634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d318f-3658-4dd1-ae49-349c2d53fc72 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:45.304495 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e70d318f-3658-4dd1-ae49-349c2d53fc72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:45.410650 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d318f-3658-4dd1-ae49-349c2d53fc72 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:45.416673 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393de64d-a3c8-4c38-a593-1d67f9198d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:45.417872 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393de64d-a3c8-4c38-a593-1d67f9198d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:45.418256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393de64d-a3c8-4c38-a593-1d67f9198d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:45.418552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393de64d-a3c8-4c38-a593-1d67f9198d34 admin admin] PATH_INFO: `/v3/projects/5c4b5d3cbc154a35a066a72ae2ff8108` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:45.424413 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393de64d-a3c8-4c38-a593-1d67f9198d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c4b5d3cbc154a35a066a72ae2ff8108)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:45.424413 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393de64d-a3c8-4c38-a593-1d67f9198d34 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:45.574843 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-393de64d-a3c8-4c38-a593-1d67f9198d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c4b5d3cbc154a35a066a72ae2ff8108', 'request_id': 'req-393de64d-a3c8-4c38-a593-1d67f9198d34'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:45.606917 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-393de64d-a3c8-4c38-a593-1d67f9198d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c4b5d3cbc154a35a066a72ae2ff8108', 'request_id': 'req-393de64d-a3c8-4c38-a593-1d67f9198d34'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:45.696881 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:45.697435 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-393de64d-a3c8-4c38-a593-1d67f9198d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c4b5d3cbc154a35a066a72ae2ff8108', 'request_id': 'req-393de64d-a3c8-4c38-a593-1d67f9198d34'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:45.717064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-393de64d-a3c8-4c38-a593-1d67f9198d34 admin admin] The token cache is being invalidate because project 5c4b5d3cbc154a35a066a72ae2ff8108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:45.717601 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-393de64d-a3c8-4c38-a593-1d67f9198d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:45.718488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-393de64d-a3c8-4c38-a593-1d67f9198d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:45.720866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 909/1833] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:45 2022] DELETE /identity/v3/projects/5c4b5d3cbc154a35a066a72ae2ff8108 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:45.725579 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5a4ea-9157-4c17-a817-4934d9ed1125 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:45.739079 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5a4ea-9157-4c17-a817-4934d9ed1125 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:45.810477 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381149d0-dc6a-4445-beb0-fd1aaca49e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:45.811558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381149d0-dc6a-4445-beb0-fd1aaca49e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:45.811850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381149d0-dc6a-4445-beb0-fd1aaca49e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:45.812337 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381149d0-dc6a-4445-beb0-fd1aaca49e6e admin admin] PATH_INFO: `/v3/users/4d60fb42230949509ff03a842a61f2b5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:45.814009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381149d0-dc6a-4445-beb0-fd1aaca49e6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d60fb42230949509ff03a842a61f2b5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:45.816135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381149d0-dc6a-4445-beb0-fd1aaca49e6e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:46.062514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-381149d0-dc6a-4445-beb0-fd1aaca49e6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d60fb42230949509ff03a842a61f2b5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:46.063293 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-381149d0-dc6a-4445-beb0-fd1aaca49e6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d60fb42230949509ff03a842a61f2b5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:46.158534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-381149d0-dc6a-4445-beb0-fd1aaca49e6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d60fb42230949509ff03a842a61f2b5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:46.178477 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-381149d0-dc6a-4445-beb0-fd1aaca49e6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d60fb42230949509ff03a842a61f2b5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:46.179885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-381149d0-dc6a-4445-beb0-fd1aaca49e6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d60fb42230949509ff03a842a61f2b5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:46.229692 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 925/1834] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:45 2022] DELETE /identity/v3/users/4d60fb42230949509ff03a842a61f2b5 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:46.928681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393de64d-a3c8-4c38-a593-1d67f9198d34 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:46.930672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-393de64d-a3c8-4c38-a593-1d67f9198d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:46.962171 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393de64d-a3c8-4c38-a593-1d67f9198d34 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:47.037486 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672a1d0-b449-42db-9f2b-f7eb220b88e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:47.037486 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672a1d0-b449-42db-9f2b-f7eb220b88e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:47.037486 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672a1d0-b449-42db-9f2b-f7eb220b88e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:47.037486 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672a1d0-b449-42db-9f2b-f7eb220b88e6 admin admin] PATH_INFO: `/v3/projects/e5e4778fa1064a51af916e857794c0e9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:47.038250 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672a1d0-b449-42db-9f2b-f7eb220b88e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e4778fa1064a51af916e857794c0e9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:47.040207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672a1d0-b449-42db-9f2b-f7eb220b88e6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:47.200651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6672a1d0-b449-42db-9f2b-f7eb220b88e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e4778fa1064a51af916e857794c0e9', 'request_id': 'req-6672a1d0-b449-42db-9f2b-f7eb220b88e6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:47.206269 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6672a1d0-b449-42db-9f2b-f7eb220b88e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e4778fa1064a51af916e857794c0e9', 'request_id': 'req-6672a1d0-b449-42db-9f2b-f7eb220b88e6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:47.344284 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6672a1d0-b449-42db-9f2b-f7eb220b88e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e4778fa1064a51af916e857794c0e9', 'request_id': 'req-6672a1d0-b449-42db-9f2b-f7eb220b88e6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:47.374480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6672a1d0-b449-42db-9f2b-f7eb220b88e6 admin admin] The token cache is being invalidate because project e5e4778fa1064a51af916e857794c0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:47.376313 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6672a1d0-b449-42db-9f2b-f7eb220b88e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:47.377977 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6672a1d0-b449-42db-9f2b-f7eb220b88e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:47.385934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 910/1835] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:46 2022] DELETE /identity/v3/projects/e5e4778fa1064a51af916e857794c0e9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:47.388278 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ce5fc-91a1-4229-81b3-66ac580a931e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:47.389175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ce5fc-91a1-4229-81b3-66ac580a931e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:47.390815 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ce5fc-91a1-4229-81b3-66ac580a931e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:47.421419 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6b8ce5fc-91a1-4229-81b3-66ac580a931e None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:47.422664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6b8ce5fc-91a1-4229-81b3-66ac580a931e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:47.501989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 926/1836] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:47.505143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ff3a5-bc17-4b0b-8073-bcd8ac135115 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:47.508068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ff3a5-bc17-4b0b-8073-bcd8ac135115 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:47.508378 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ff3a5-bc17-4b0b-8073-bcd8ac135115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:47.553255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7f5ff3a5-bc17-4b0b-8073-bcd8ac135115 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:47.554450 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7f5ff3a5-bc17-4b0b-8073-bcd8ac135115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:47.563654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 911/1837] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:47.568099 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ce5fc-91a1-4229-81b3-66ac580a931e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:47.589308 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ce5fc-91a1-4229-81b3-66ac580a931e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:47.594162 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f56b3b-93ad-4731-a95e-4801a02c1d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:47.594841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f56b3b-93ad-4731-a95e-4801a02c1d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:47.595199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f56b3b-93ad-4731-a95e-4801a02c1d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:47.595545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f56b3b-93ad-4731-a95e-4801a02c1d6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:47.596465 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f56b3b-93ad-4731-a95e-4801a02c1d6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:47.596989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f56b3b-93ad-4731-a95e-4801a02c1d6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:47.598875 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f56b3b-93ad-4731-a95e-4801a02c1d6a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:47.615678 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 927/1838] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:47.616968 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ff3a5-bc17-4b0b-8073-bcd8ac135115 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:47.627621 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ff3a5-bc17-4b0b-8073-bcd8ac135115 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:47.632708 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b3673-dd7d-4595-a8bc-595047e43091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:47.633460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b3673-dd7d-4595-a8bc-595047e43091 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:47.633818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b3673-dd7d-4595-a8bc-595047e43091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:47.634173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b3673-dd7d-4595-a8bc-595047e43091 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:47.634953 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b3673-dd7d-4595-a8bc-595047e43091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:47.637082 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b3673-dd7d-4595-a8bc-595047e43091 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:47.768454 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 912/1839] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:47 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:06:47.772702 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f56b3b-93ad-4731-a95e-4801a02c1d6a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:47.783660 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f56b3b-93ad-4731-a95e-4801a02c1d6a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:47.866387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb84c9-52a6-4d58-9315-9d7214ba4cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:47.867064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb84c9-52a6-4d58-9315-9d7214ba4cff admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:47.867349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb84c9-52a6-4d58-9315-9d7214ba4cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:47.867650 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb84c9-52a6-4d58-9315-9d7214ba4cff admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:47.868358 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb84c9-52a6-4d58-9315-9d7214ba4cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:47.870284 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb84c9-52a6-4d58-9315-9d7214ba4cff admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:48.016785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 928/1840] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:47 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:48.018658 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b3673-dd7d-4595-a8bc-595047e43091 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:48.042399 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b3673-dd7d-4595-a8bc-595047e43091 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:48.044506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:48.054427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63a1fc-312d-4bea-859f-1cdd64087c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:48.055751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63a1fc-312d-4bea-859f-1cdd64087c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:48.056076 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63a1fc-312d-4bea-859f-1cdd64087c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:48.056364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63a1fc-312d-4bea-859f-1cdd64087c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:48.057345 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63a1fc-312d-4bea-859f-1cdd64087c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:48.059007 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63a1fc-312d-4bea-859f-1cdd64087c4a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:48.079949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 913/1841] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:48.083154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb84c9-52a6-4d58-9315-9d7214ba4cff admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:48.093717 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb84c9-52a6-4d58-9315-9d7214ba4cff admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:48.101219 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baecd4d-fdf6-41a1-9db6-c8b67be29d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:48.102534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baecd4d-fdf6-41a1-9db6-c8b67be29d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:48.103043 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baecd4d-fdf6-41a1-9db6-c8b67be29d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:48.104073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baecd4d-fdf6-41a1-9db6-c8b67be29d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:48.104528 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baecd4d-fdf6-41a1-9db6-c8b67be29d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:48.107108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baecd4d-fdf6-41a1-9db6-c8b67be29d06 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:48.126122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 929/1842] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:48.129574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63a1fc-312d-4bea-859f-1cdd64087c4a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:48.149700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63a1fc-312d-4bea-859f-1cdd64087c4a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:48.155845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b2a74-b9de-4f9f-9533-e971b0e19a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:48.156873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b2a74-b9de-4f9f-9533-e971b0e19a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:48.157226 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b2a74-b9de-4f9f-9533-e971b0e19a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:48.157807 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b2a74-b9de-4f9f-9533-e971b0e19a1a admin admin] PATH_INFO: `/v3/projects/a3a9267aeb5240869f1b592ac6ae6935/users/bad118d3e73d4207890104ac74ebacdd/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:48.175350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b2a74-b9de-4f9f-9533-e971b0e19a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a9267aeb5240869f1b592ac6ae6935, user_id=bad118d3e73d4207890104ac74ebacdd, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:48.178614 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b2a74-b9de-4f9f-9533-e971b0e19a1a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:48.293364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 914/1843] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:48 2022] PUT /identity/v3/projects/a3a9267aeb5240869f1b592ac6ae6935/users/bad118d3e73d4207890104ac74ebacdd/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:48.304632 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985cbff-ff93-4c19-8b1d-9452f8996127 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:48.305314 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985cbff-ff93-4c19-8b1d-9452f8996127 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:48.305826 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985cbff-ff93-4c19-8b1d-9452f8996127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:48.362180 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8985cbff-ff93-4c19-8b1d-9452f8996127 None None] MFA Rules not processed for user `bad118d3e73d4207890104ac74ebacdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:48.363619 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8985cbff-ff93-4c19-8b1d-9452f8996127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:48.433365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 930/1844] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:48.437927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b2a74-b9de-4f9f-9533-e971b0e19a1a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:48.506541 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b2a74-b9de-4f9f-9533-e971b0e19a1a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:48.511395 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c4313-62dc-4033-8367-48dd61bb6029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:48.512102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c4313-62dc-4033-8367-48dd61bb6029 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:48.512394 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c4313-62dc-4033-8367-48dd61bb6029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:48.512680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c4313-62dc-4033-8367-48dd61bb6029 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:48.513391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c4313-62dc-4033-8367-48dd61bb6029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:48.515573 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c4313-62dc-4033-8367-48dd61bb6029 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:48.613007 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 915/1845] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:48 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:06:48.614884 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985cbff-ff93-4c19-8b1d-9452f8996127 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:48.627901 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985cbff-ff93-4c19-8b1d-9452f8996127 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:48.684950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332a233-ef87-4f2c-a755-8e00f37775e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:48.685628 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332a233-ef87-4f2c-a755-8e00f37775e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:48.685914 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332a233-ef87-4f2c-a755-8e00f37775e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:48.686193 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332a233-ef87-4f2c-a755-8e00f37775e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:48.686885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332a233-ef87-4f2c-a755-8e00f37775e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:48.688939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332a233-ef87-4f2c-a755-8e00f37775e6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:48.817404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 931/1846] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:48 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:48.821342 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c4313-62dc-4033-8367-48dd61bb6029 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:48.833688 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c4313-62dc-4033-8367-48dd61bb6029 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:48.838549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ddb8e-9903-4b7c-a432-c66d1ab437bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:48.839611 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ddb8e-9903-4b7c-a432-c66d1ab437bd admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:48.839888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ddb8e-9903-4b7c-a432-c66d1ab437bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:48.840371 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ddb8e-9903-4b7c-a432-c66d1ab437bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:48.841272 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ddb8e-9903-4b7c-a432-c66d1ab437bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:48.843023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ddb8e-9903-4b7c-a432-c66d1ab437bd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:48.856443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 916/1847] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:48.860959 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332a233-ef87-4f2c-a755-8e00f37775e6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:48.872499 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332a233-ef87-4f2c-a755-8e00f37775e6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:48.878293 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7a899-2a6a-479a-8282-9a62e1b57217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:48.879367 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7a899-2a6a-479a-8282-9a62e1b57217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:48.882527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7a899-2a6a-479a-8282-9a62e1b57217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:48.882527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7a899-2a6a-479a-8282-9a62e1b57217 admin admin] PATH_INFO: `/v3/projects/b38b542c1cec45f985f480b31709463d/users/02a69e415e68433e83f901a74af1bcaf/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:48.899497 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7a899-2a6a-479a-8282-9a62e1b57217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38b542c1cec45f985f480b31709463d, user_id=02a69e415e68433e83f901a74af1bcaf, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:48.902561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7a899-2a6a-479a-8282-9a62e1b57217 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:49.045980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 932/1848] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:48 2022] PUT /identity/v3/projects/b38b542c1cec45f985f480b31709463d/users/02a69e415e68433e83f901a74af1bcaf/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:49.050266 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ddb8e-9903-4b7c-a432-c66d1ab437bd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:49.061541 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ddb8e-9903-4b7c-a432-c66d1ab437bd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:49.068803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:49.126907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc85c8-3f5d-47cd-8ac3-c5078e815096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:49.132680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc85c8-3f5d-47cd-8ac3-c5078e815096 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:49.132680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc85c8-3f5d-47cd-8ac3-c5078e815096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:49.132680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc85c8-3f5d-47cd-8ac3-c5078e815096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:49.132680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc85c8-3f5d-47cd-8ac3-c5078e815096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:49.132680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc85c8-3f5d-47cd-8ac3-c5078e815096 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:49.148336 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 917/1849] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:49.150151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7a899-2a6a-479a-8282-9a62e1b57217 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:49.162768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7a899-2a6a-479a-8282-9a62e1b57217 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:49.169849 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c14e60-6919-4fe8-a648-305355a53824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:49.171533 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c14e60-6919-4fe8-a648-305355a53824 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:49.171834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c14e60-6919-4fe8-a648-305355a53824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:49.172149 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c14e60-6919-4fe8-a648-305355a53824 admin admin] PATH_INFO: `/v3/projects/b38b542c1cec45f985f480b31709463d/users/02a69e415e68433e83f901a74af1bcaf/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:49.174243 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c14e60-6919-4fe8-a648-305355a53824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38b542c1cec45f985f480b31709463d, user_id=02a69e415e68433e83f901a74af1bcaf, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:49.178107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c14e60-6919-4fe8-a648-305355a53824 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:49.219304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 933/1850] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:49 2022] PUT /identity/v3/projects/b38b542c1cec45f985f480b31709463d/users/02a69e415e68433e83f901a74af1bcaf/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:49.221386 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21afcab-4713-493f-b8bc-94d9d8700c97 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:49.221686 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21afcab-4713-493f-b8bc-94d9d8700c97 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:49.221981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21afcab-4713-493f-b8bc-94d9d8700c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:49.255998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a21afcab-4713-493f-b8bc-94d9d8700c97 None None] MFA Rules not processed for user `02a69e415e68433e83f901a74af1bcaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:49.257546 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a21afcab-4713-493f-b8bc-94d9d8700c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:49.350295 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 918/1851] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:49.362008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c14e60-6919-4fe8-a648-305355a53824 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:49.380144 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a8c14e60-6919-4fe8-a648-305355a53824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:49.437214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c14e60-6919-4fe8-a648-305355a53824 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:49.441014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19e6d3-cb5b-4a7b-bf82-33889874737e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:49.441669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e6d3-cb5b-4a7b-bf82-33889874737e service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:49.441959 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e6d3-cb5b-4a7b-bf82-33889874737e service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:49.442246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e6d3-cb5b-4a7b-bf82-33889874737e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:49.451638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19e6d3-cb5b-4a7b-bf82-33889874737e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:49.453209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19e6d3-cb5b-4a7b-bf82-33889874737e service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:49.463019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 934/1852] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:49.645776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21afcab-4713-493f-b8bc-94d9d8700c97 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:49.655889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21afcab-4713-493f-b8bc-94d9d8700c97 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:49.659611 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e676ce4-09f4-4ac6-8830-e3d83f0cae75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:49.660452 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e676ce4-09f4-4ac6-8830-e3d83f0cae75 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:49.660737 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e676ce4-09f4-4ac6-8830-e3d83f0cae75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:49.661231 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e676ce4-09f4-4ac6-8830-e3d83f0cae75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:49.719692 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e676ce4-09f4-4ac6-8830-e3d83f0cae75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:49.721180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e676ce4-09f4-4ac6-8830-e3d83f0cae75 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:49.732132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 919/1853] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:50.935868 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:51.392051 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19e6d3-cb5b-4a7b-bf82-33889874737e service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:51.393660 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ab19e6d3-cb5b-4a7b-bf82-33889874737e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:51.472573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19e6d3-cb5b-4a7b-bf82-33889874737e service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:51.477492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab1658-331a-4c7b-bb6c-6c2627f73448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:51.478371 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab1658-331a-4c7b-bb6c-6c2627f73448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:51.478657 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab1658-331a-4c7b-bb6c-6c2627f73448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:51.478936 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab1658-331a-4c7b-bb6c-6c2627f73448 admin admin] PATH_INFO: `/v3/users/429dd8b93ffb4873b8470ebe5cda7c2e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:51.480143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab1658-331a-4c7b-bb6c-6c2627f73448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=429dd8b93ffb4873b8470ebe5cda7c2e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:51.482056 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab1658-331a-4c7b-bb6c-6c2627f73448 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:51.670228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-58ab1658-331a-4c7b-bb6c-6c2627f73448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429dd8b93ffb4873b8470ebe5cda7c2e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:51.670990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-58ab1658-331a-4c7b-bb6c-6c2627f73448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429dd8b93ffb4873b8470ebe5cda7c2e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:51.764083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-58ab1658-331a-4c7b-bb6c-6c2627f73448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429dd8b93ffb4873b8470ebe5cda7c2e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:51.773228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-58ab1658-331a-4c7b-bb6c-6c2627f73448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429dd8b93ffb4873b8470ebe5cda7c2e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:51.773897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-58ab1658-331a-4c7b-bb6c-6c2627f73448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429dd8b93ffb4873b8470ebe5cda7c2e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:51.796174 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 935/1854] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:51 2022] DELETE /identity/v3/users/429dd8b93ffb4873b8470ebe5cda7c2e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:51.798346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a74e3-ebc5-407d-9d11-8ec6d147ceaa None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:51.798808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a74e3-ebc5-407d-9d11-8ec6d147ceaa None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:51.799182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a74e3-ebc5-407d-9d11-8ec6d147ceaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:51.819961 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9c4a74e3-ebc5-407d-9d11-8ec6d147ceaa None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:51.821372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9c4a74e3-ebc5-407d-9d11-8ec6d147ceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:51.907054 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 920/1855] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:51.927570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab1658-331a-4c7b-bb6c-6c2627f73448 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:51.929012 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-58ab1658-331a-4c7b-bb6c-6c2627f73448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:51.992607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab1658-331a-4c7b-bb6c-6c2627f73448 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:51.996372 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b8d2f-55de-414c-9b96-6a3b499b6c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:51.997027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b8d2f-55de-414c-9b96-6a3b499b6c44 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:51.997318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b8d2f-55de-414c-9b96-6a3b499b6c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:51.997602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b8d2f-55de-414c-9b96-6a3b499b6c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:52.007296 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b8d2f-55de-414c-9b96-6a3b499b6c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:52.008992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b8d2f-55de-414c-9b96-6a3b499b6c44 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:52.021919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 936/1856] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:52.934399 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a74e3-ebc5-407d-9d11-8ec6d147ceaa None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:52.934399 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9c4a74e3-ebc5-407d-9d11-8ec6d147ceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:52.949577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a74e3-ebc5-407d-9d11-8ec6d147ceaa None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:52.956650 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebaf12-58f3-4470-bbd7-313ff22dadb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:52.958081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebaf12-58f3-4470-bbd7-313ff22dadb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:52.958681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebaf12-58f3-4470-bbd7-313ff22dadb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:52.959941 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebaf12-58f3-4470-bbd7-313ff22dadb5 admin admin] PATH_INFO: `/v3/projects/fcca4be5cd374be9ac7ab684a0575196` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:52.961632 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebaf12-58f3-4470-bbd7-313ff22dadb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcca4be5cd374be9ac7ab684a0575196)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:52.964027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebaf12-58f3-4470-bbd7-313ff22dadb5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:53.175346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aaebaf12-58f3-4470-bbd7-313ff22dadb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcca4be5cd374be9ac7ab684a0575196', 'request_id': 'req-aaebaf12-58f3-4470-bbd7-313ff22dadb5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.181444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aaebaf12-58f3-4470-bbd7-313ff22dadb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcca4be5cd374be9ac7ab684a0575196', 'request_id': 'req-aaebaf12-58f3-4470-bbd7-313ff22dadb5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.286438 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:53.365555 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aaebaf12-58f3-4470-bbd7-313ff22dadb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcca4be5cd374be9ac7ab684a0575196', 'request_id': 'req-aaebaf12-58f3-4470-bbd7-313ff22dadb5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.379281 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aaebaf12-58f3-4470-bbd7-313ff22dadb5 admin admin] The token cache is being invalidate because project fcca4be5cd374be9ac7ab684a0575196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:53.379610 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aaebaf12-58f3-4470-bbd7-313ff22dadb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.380295 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aaebaf12-58f3-4470-bbd7-313ff22dadb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.381870 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 921/1857] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:52 2022] DELETE /identity/v3/projects/fcca4be5cd374be9ac7ab684a0575196 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:53.385917 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b8d2f-55de-414c-9b96-6a3b499b6c44 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:53.396598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b8d2f-55de-414c-9b96-6a3b499b6c44 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:53.453075 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e9c83-9ff2-4d00-ac74-cd29ab8ff442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:53.453955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e9c83-9ff2-4d00-ac74-cd29ab8ff442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:53.454240 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e9c83-9ff2-4d00-ac74-cd29ab8ff442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:53.454525 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e9c83-9ff2-4d00-ac74-cd29ab8ff442 admin admin] PATH_INFO: `/v3/users/57c6d23c3c1f4e42bf1e66958d9ccdd2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:53.455713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e9c83-9ff2-4d00-ac74-cd29ab8ff442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57c6d23c3c1f4e42bf1e66958d9ccdd2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:53.457783 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e9c83-9ff2-4d00-ac74-cd29ab8ff442 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:53.551549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebaf12-58f3-4470-bbd7-313ff22dadb5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:53.553086 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-aaebaf12-58f3-4470-bbd7-313ff22dadb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:53.566609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebaf12-58f3-4470-bbd7-313ff22dadb5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:53.572066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2ba90-b65b-47f4-ab33-48b4714d7e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:53.573061 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2ba90-b65b-47f4-ab33-48b4714d7e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:53.573358 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2ba90-b65b-47f4-ab33-48b4714d7e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:53.573641 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2ba90-b65b-47f4-ab33-48b4714d7e11 admin admin] PATH_INFO: `/v3/users/bad118d3e73d4207890104ac74ebacdd` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:53.574844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2ba90-b65b-47f4-ab33-48b4714d7e11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad118d3e73d4207890104ac74ebacdd)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:53.576984 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2ba90-b65b-47f4-ab33-48b4714d7e11 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:53.700460 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-843e9c83-9ff2-4d00-ac74-cd29ab8ff442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57c6d23c3c1f4e42bf1e66958d9ccdd2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.701149 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-843e9c83-9ff2-4d00-ac74-cd29ab8ff442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57c6d23c3c1f4e42bf1e66958d9ccdd2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.816557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-843e9c83-9ff2-4d00-ac74-cd29ab8ff442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57c6d23c3c1f4e42bf1e66958d9ccdd2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.830445 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-843e9c83-9ff2-4d00-ac74-cd29ab8ff442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57c6d23c3c1f4e42bf1e66958d9ccdd2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.832332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-843e9c83-9ff2-4d00-ac74-cd29ab8ff442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57c6d23c3c1f4e42bf1e66958d9ccdd2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.843191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-88a2ba90-b65b-47f4-ab33-48b4714d7e11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad118d3e73d4207890104ac74ebacdd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.856425 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 937/1858] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:53 2022] DELETE /identity/v3/users/57c6d23c3c1f4e42bf1e66958d9ccdd2 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:53.869110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-88a2ba90-b65b-47f4-ab33-48b4714d7e11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad118d3e73d4207890104ac74ebacdd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.870016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-88a2ba90-b65b-47f4-ab33-48b4714d7e11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad118d3e73d4207890104ac74ebacdd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.883400 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-88a2ba90-b65b-47f4-ab33-48b4714d7e11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad118d3e73d4207890104ac74ebacdd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:53.884849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-88a2ba90-b65b-47f4-ab33-48b4714d7e11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad118d3e73d4207890104ac74ebacdd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:54.025586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 922/1859] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:53 2022] DELETE /identity/v3/users/bad118d3e73d4207890104ac74ebacdd => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:54.034506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9121825-80af-431b-a679-18966c6e1b76 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:54.036917 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9121825-80af-431b-a679-18966c6e1b76 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:54.037324 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9121825-80af-431b-a679-18966c6e1b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:54.059123 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b9121825-80af-431b-a679-18966c6e1b76 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:54.060474 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b9121825-80af-431b-a679-18966c6e1b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:54.144858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 938/1860] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:54.156142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2ba90-b65b-47f4-ab33-48b4714d7e11 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:54.156948 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-88a2ba90-b65b-47f4-ab33-48b4714d7e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:54.307949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2ba90-b65b-47f4-ab33-48b4714d7e11 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:54.313880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaeb22-df1f-47c8-9123-f2ef15c4b9dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:54.315217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaeb22-df1f-47c8-9123-f2ef15c4b9dd service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:54.315685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaeb22-df1f-47c8-9123-f2ef15c4b9dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:54.316214 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaeb22-df1f-47c8-9123-f2ef15c4b9dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:54.329029 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aaeb22-df1f-47c8-9123-f2ef15c4b9dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:54.330626 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aaeb22-df1f-47c8-9123-f2ef15c4b9dd service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:54.341928 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 923/1861] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:54.621371 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9121825-80af-431b-a679-18966c6e1b76 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:54.623126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b9121825-80af-431b-a679-18966c6e1b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:54.636575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9121825-80af-431b-a679-18966c6e1b76 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:54.641567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8762dc8-c84f-4cad-8e08-9e5a18d8b65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:54.642552 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8762dc8-c84f-4cad-8e08-9e5a18d8b65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:54.642841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8762dc8-c84f-4cad-8e08-9e5a18d8b65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:54.643120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8762dc8-c84f-4cad-8e08-9e5a18d8b65d admin admin] PATH_INFO: `/v3/users/8b3b2642956d492aad62dba8194a13d5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:54.645066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8762dc8-c84f-4cad-8e08-9e5a18d8b65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3b2642956d492aad62dba8194a13d5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:54.647035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8762dc8-c84f-4cad-8e08-9e5a18d8b65d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:54.895040 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b8762dc8-c84f-4cad-8e08-9e5a18d8b65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3b2642956d492aad62dba8194a13d5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:54.895710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b8762dc8-c84f-4cad-8e08-9e5a18d8b65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3b2642956d492aad62dba8194a13d5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.010909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b8762dc8-c84f-4cad-8e08-9e5a18d8b65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3b2642956d492aad62dba8194a13d5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.019856 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b8762dc8-c84f-4cad-8e08-9e5a18d8b65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3b2642956d492aad62dba8194a13d5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.022775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b8762dc8-c84f-4cad-8e08-9e5a18d8b65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3b2642956d492aad62dba8194a13d5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.041401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaeb22-df1f-47c8-9123-f2ef15c4b9dd service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:55.043715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f1aaeb22-df1f-47c8-9123-f2ef15c4b9dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:55.056688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 939/1862] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:54 2022] DELETE /identity/v3/users/8b3b2642956d492aad62dba8194a13d5 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:55.059681 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28dd25-e803-4ee8-a284-c214d3464f9f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.061100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28dd25-e803-4ee8-a284-c214d3464f9f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.061741 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28dd25-e803-4ee8-a284-c214d3464f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.067467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaeb22-df1f-47c8-9123-f2ef15c4b9dd service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:55.117321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0f28dd25-e803-4ee8-a284-c214d3464f9f None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:55.118908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0f28dd25-e803-4ee8-a284-c214d3464f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:55.213309 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75aac5f-478b-448e-b312-bfd0e5c5681b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:55.214227 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aac5f-478b-448e-b312-bfd0e5c5681b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.214848 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aac5f-478b-448e-b312-bfd0e5c5681b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.215766 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aac5f-478b-448e-b312-bfd0e5c5681b admin admin] PATH_INFO: `/v3/projects/fb339bb958e14845a6a10ee8d9fb93e3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.217386 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75aac5f-478b-448e-b312-bfd0e5c5681b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb339bb958e14845a6a10ee8d9fb93e3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:55.221170 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75aac5f-478b-448e-b312-bfd0e5c5681b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:55.232486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 940/1863] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:55.254756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28dd25-e803-4ee8-a284-c214d3464f9f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:55.256665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0f28dd25-e803-4ee8-a284-c214d3464f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:55.352592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28dd25-e803-4ee8-a284-c214d3464f9f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:55.356531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58336f2d-9d5b-419c-ba31-14464dcaa558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:55.357481 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58336f2d-9d5b-419c-ba31-14464dcaa558 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.358113 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58336f2d-9d5b-419c-ba31-14464dcaa558 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.359550 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:55.360077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58336f2d-9d5b-419c-ba31-14464dcaa558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.370206 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58336f2d-9d5b-419c-ba31-14464dcaa558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:55.371658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58336f2d-9d5b-419c-ba31-14464dcaa558 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:55.382307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 941/1864] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:06:55.428301 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c75aac5f-478b-448e-b312-bfd0e5c5681b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb339bb958e14845a6a10ee8d9fb93e3', 'request_id': 'req-c75aac5f-478b-448e-b312-bfd0e5c5681b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.433681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c75aac5f-478b-448e-b312-bfd0e5c5681b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb339bb958e14845a6a10ee8d9fb93e3', 'request_id': 'req-c75aac5f-478b-448e-b312-bfd0e5c5681b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.450938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58336f2d-9d5b-419c-ba31-14464dcaa558 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:55.452525 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-58336f2d-9d5b-419c-ba31-14464dcaa558 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:55.475444 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58336f2d-9d5b-419c-ba31-14464dcaa558 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:55.536554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c75aac5f-478b-448e-b312-bfd0e5c5681b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb339bb958e14845a6a10ee8d9fb93e3', 'request_id': 'req-c75aac5f-478b-448e-b312-bfd0e5c5681b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.541861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f184e-b67a-4c50-9a71-73f311137f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:55.542756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f184e-b67a-4c50-9a71-73f311137f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.543046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f184e-b67a-4c50-9a71-73f311137f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.543325 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f184e-b67a-4c50-9a71-73f311137f73 admin admin] PATH_INFO: `/v3/projects/a3a9267aeb5240869f1b592ac6ae6935` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.544622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f184e-b67a-4c50-9a71-73f311137f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a9267aeb5240869f1b592ac6ae6935)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:55.546753 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f184e-b67a-4c50-9a71-73f311137f73 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:55.549771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c75aac5f-478b-448e-b312-bfd0e5c5681b admin admin] The token cache is being invalidate because project fb339bb958e14845a6a10ee8d9fb93e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:55.550105 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c75aac5f-478b-448e-b312-bfd0e5c5681b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.550933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c75aac5f-478b-448e-b312-bfd0e5c5681b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.552581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 924/1865] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:55 2022] DELETE /identity/v3/projects/fb339bb958e14845a6a10ee8d9fb93e3 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:55.557470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe7a64-ec4c-458c-a09a-bd88d0b59771 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.557810 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe7a64-ec4c-458c-a09a-bd88d0b59771 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.558286 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe7a64-ec4c-458c-a09a-bd88d0b59771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.580882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-50fe7a64-ec4c-458c-a09a-bd88d0b59771 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:55.582598 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-50fe7a64-ec4c-458c-a09a-bd88d0b59771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:55.591006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 925/1866] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:55.599139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05701df-b651-49d5-97c8-35e8a7cff89a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.603035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05701df-b651-49d5-97c8-35e8a7cff89a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.603341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05701df-b651-49d5-97c8-35e8a7cff89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.638145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c05701df-b651-49d5-97c8-35e8a7cff89a None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:55.640365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c05701df-b651-49d5-97c8-35e8a7cff89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:55.667775 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 926/1867] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:55.670372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05701df-b651-49d5-97c8-35e8a7cff89a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:55.681317 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05701df-b651-49d5-97c8-35e8a7cff89a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:55.690676 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:55.701508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-641f184e-b67a-4c50-9a71-73f311137f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a9267aeb5240869f1b592ac6ae6935', 'request_id': 'req-641f184e-b67a-4c50-9a71-73f311137f73'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.761079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72035d8-5708-4fe5-87fc-f7dbed7ff081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:55.762203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72035d8-5708-4fe5-87fc-f7dbed7ff081 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.762736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72035d8-5708-4fe5-87fc-f7dbed7ff081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.763340 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72035d8-5708-4fe5-87fc-f7dbed7ff081 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.764126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72035d8-5708-4fe5-87fc-f7dbed7ff081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:55.764885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72035d8-5708-4fe5-87fc-f7dbed7ff081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:55.767441 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72035d8-5708-4fe5-87fc-f7dbed7ff081 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:55.779665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-641f184e-b67a-4c50-9a71-73f311137f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a9267aeb5240869f1b592ac6ae6935', 'request_id': 'req-641f184e-b67a-4c50-9a71-73f311137f73'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.786108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 927/1868] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:55.788238 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-641f184e-b67a-4c50-9a71-73f311137f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a9267aeb5240869f1b592ac6ae6935', 'request_id': 'req-641f184e-b67a-4c50-9a71-73f311137f73'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.790893 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72035d8-5708-4fe5-87fc-f7dbed7ff081 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:55.801735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72035d8-5708-4fe5-87fc-f7dbed7ff081 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:55.802519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-641f184e-b67a-4c50-9a71-73f311137f73 admin admin] The token cache is being invalidate because project a3a9267aeb5240869f1b592ac6ae6935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:55.802810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-641f184e-b67a-4c50-9a71-73f311137f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.803740 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-641f184e-b67a-4c50-9a71-73f311137f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:55.805546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 942/1869] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:55 2022] DELETE /identity/v3/projects/a3a9267aeb5240869f1b592ac6ae6935 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:55.808917 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902a057-d408-4c94-bf8d-fd8e5fc1b266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:55.809791 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902a057-d408-4c94-bf8d-fd8e5fc1b266 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.810091 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902a057-d408-4c94-bf8d-fd8e5fc1b266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.810620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902a057-d408-4c94-bf8d-fd8e5fc1b266 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.811486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f184e-b67a-4c50-9a71-73f311137f73 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:55.811813 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902a057-d408-4c94-bf8d-fd8e5fc1b266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:55.812945 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-641f184e-b67a-4c50-9a71-73f311137f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:55.814138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902a057-d408-4c94-bf8d-fd8e5fc1b266 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:55.826828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f184e-b67a-4c50-9a71-73f311137f73 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:55.832768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8012a9c-5712-4ed5-9a82-fa6671102148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:55.833692 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8012a9c-5712-4ed5-9a82-fa6671102148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:55.834101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8012a9c-5712-4ed5-9a82-fa6671102148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:55.834452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8012a9c-5712-4ed5-9a82-fa6671102148 admin admin] PATH_INFO: `/v3/users/02a69e415e68433e83f901a74af1bcaf` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:55.835761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8012a9c-5712-4ed5-9a82-fa6671102148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a69e415e68433e83f901a74af1bcaf)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:55.837796 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8012a9c-5712-4ed5-9a82-fa6671102148 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:55.952109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 928/1870] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:55 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:06:55.953426 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902a057-d408-4c94-bf8d-fd8e5fc1b266 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:55.957117 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5902a057-d408-4c94-bf8d-fd8e5fc1b266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:56.033849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902a057-d408-4c94-bf8d-fd8e5fc1b266 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:56.045189 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846e499-a69a-48a5-bf66-2f6016ea7cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:56.046085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846e499-a69a-48a5-bf66-2f6016ea7cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.046375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846e499-a69a-48a5-bf66-2f6016ea7cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.046659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846e499-a69a-48a5-bf66-2f6016ea7cf4 admin admin] PATH_INFO: `/v3/projects/19ef47eb9ce944639041b3a0a25754a6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.048223 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846e499-a69a-48a5-bf66-2f6016ea7cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ef47eb9ce944639041b3a0a25754a6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:56.050996 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846e499-a69a-48a5-bf66-2f6016ea7cf4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:56.138791 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a8012a9c-5712-4ed5-9a82-fa6671102148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a69e415e68433e83f901a74af1bcaf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.139420 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a8012a9c-5712-4ed5-9a82-fa6671102148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a69e415e68433e83f901a74af1bcaf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.166356 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3846e499-a69a-48a5-bf66-2f6016ea7cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ef47eb9ce944639041b3a0a25754a6', 'request_id': 'req-3846e499-a69a-48a5-bf66-2f6016ea7cf4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.172419 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3846e499-a69a-48a5-bf66-2f6016ea7cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ef47eb9ce944639041b3a0a25754a6', 'request_id': 'req-3846e499-a69a-48a5-bf66-2f6016ea7cf4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.227853 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a8012a9c-5712-4ed5-9a82-fa6671102148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a69e415e68433e83f901a74af1bcaf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.236429 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a8012a9c-5712-4ed5-9a82-fa6671102148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a69e415e68433e83f901a74af1bcaf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.237133 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a8012a9c-5712-4ed5-9a82-fa6671102148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a69e415e68433e83f901a74af1bcaf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.258166 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 943/1871] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:55 2022] DELETE /identity/v3/users/02a69e415e68433e83f901a74af1bcaf => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:56.259092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8012a9c-5712-4ed5-9a82-fa6671102148 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:56.260464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a8012a9c-5712-4ed5-9a82-fa6671102148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:56.285481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3846e499-a69a-48a5-bf66-2f6016ea7cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ef47eb9ce944639041b3a0a25754a6', 'request_id': 'req-3846e499-a69a-48a5-bf66-2f6016ea7cf4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.301728 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3846e499-a69a-48a5-bf66-2f6016ea7cf4 admin admin] The token cache is being invalidate because project 19ef47eb9ce944639041b3a0a25754a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:56.302063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3846e499-a69a-48a5-bf66-2f6016ea7cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.303262 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3846e499-a69a-48a5-bf66-2f6016ea7cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.308469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 929/1872] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:55 2022] DELETE /identity/v3/projects/19ef47eb9ce944639041b3a0a25754a6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:56.309550 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846e499-a69a-48a5-bf66-2f6016ea7cf4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:56.310957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3846e499-a69a-48a5-bf66-2f6016ea7cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:56.334322 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8012a9c-5712-4ed5-9a82-fa6671102148 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:56.341022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b6bfe-8651-4e18-8db3-c9e74c1b92c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:56.341801 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b6bfe-8651-4e18-8db3-c9e74c1b92c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.342486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b6bfe-8651-4e18-8db3-c9e74c1b92c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.342774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b6bfe-8651-4e18-8db3-c9e74c1b92c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.343481 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b6bfe-8651-4e18-8db3-c9e74c1b92c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:56.345473 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b6bfe-8651-4e18-8db3-c9e74c1b92c2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:56.401707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846e499-a69a-48a5-bf66-2f6016ea7cf4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:56.406927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba55bd-5402-4b75-8019-5d3434741d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:56.407819 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba55bd-5402-4b75-8019-5d3434741d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.408145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba55bd-5402-4b75-8019-5d3434741d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.408431 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba55bd-5402-4b75-8019-5d3434741d9e admin admin] PATH_INFO: `/v3/users/1f20362949084e948d693d4146205225` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.410217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba55bd-5402-4b75-8019-5d3434741d9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f20362949084e948d693d4146205225)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:56.412187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba55bd-5402-4b75-8019-5d3434741d9e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:56.464989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 944/1873] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:56 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:56.469304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b6bfe-8651-4e18-8db3-c9e74c1b92c2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:56.474130 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-757b6bfe-8651-4e18-8db3-c9e74c1b92c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:56.487122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b6bfe-8651-4e18-8db3-c9e74c1b92c2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:56.492350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3287a2-2200-43e6-b9c4-a34f6fbbcef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:56.493033 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3287a2-2200-43e6-b9c4-a34f6fbbcef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.493356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3287a2-2200-43e6-b9c4-a34f6fbbcef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.493639 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3287a2-2200-43e6-b9c4-a34f6fbbcef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.494335 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3287a2-2200-43e6-b9c4-a34f6fbbcef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:56.495950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3287a2-2200-43e6-b9c4-a34f6fbbcef7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:56.506231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 945/1874] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:06:56.510185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3287a2-2200-43e6-b9c4-a34f6fbbcef7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:56.522424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3287a2-2200-43e6-b9c4-a34f6fbbcef7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:56.527412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee018d-71a5-40d2-aeb6-df2cf79c852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:56.528244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee018d-71a5-40d2-aeb6-df2cf79c852b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.528751 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee018d-71a5-40d2-aeb6-df2cf79c852b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.529142 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee018d-71a5-40d2-aeb6-df2cf79c852b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.529882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee018d-71a5-40d2-aeb6-df2cf79c852b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:56.531641 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee018d-71a5-40d2-aeb6-df2cf79c852b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:56.546002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 946/1875] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:06:56.549754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee018d-71a5-40d2-aeb6-df2cf79c852b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:56.560894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee018d-71a5-40d2-aeb6-df2cf79c852b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:56.566067 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcba8d5-f786-4f5d-865e-3d73fa79b2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:56.566969 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcba8d5-f786-4f5d-865e-3d73fa79b2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.567259 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcba8d5-f786-4f5d-865e-3d73fa79b2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.567543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcba8d5-f786-4f5d-865e-3d73fa79b2ca admin admin] PATH_INFO: `/v3/projects/34b8d682c2c0445c8cee830614bc8722/users/ddb642f0e42948e3a70d72e609f66c4e/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.584414 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcba8d5-f786-4f5d-865e-3d73fa79b2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b8d682c2c0445c8cee830614bc8722, user_id=ddb642f0e42948e3a70d72e609f66c4e, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:56.587112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcba8d5-f786-4f5d-865e-3d73fa79b2ca admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:56.616864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c6ba55bd-5402-4b75-8019-5d3434741d9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f20362949084e948d693d4146205225'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.628568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c6ba55bd-5402-4b75-8019-5d3434741d9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f20362949084e948d693d4146205225'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.629606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c6ba55bd-5402-4b75-8019-5d3434741d9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f20362949084e948d693d4146205225'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.636049 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c6ba55bd-5402-4b75-8019-5d3434741d9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f20362949084e948d693d4146205225'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.636689 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c6ba55bd-5402-4b75-8019-5d3434741d9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f20362949084e948d693d4146205225'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.697716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 947/1876] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:56 2022] PUT /identity/v3/projects/34b8d682c2c0445c8cee830614bc8722/users/ddb642f0e42948e3a70d72e609f66c4e/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:56.708259 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc885a60-1978-45c2-bc92-2baa22dcec13 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.708800 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc885a60-1978-45c2-bc92-2baa22dcec13 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.708800 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc885a60-1978-45c2-bc92-2baa22dcec13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.723699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:06:56.732727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 930/1877] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:56 2022] DELETE /identity/v3/users/1f20362949084e948d693d4146205225 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:56.734030 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba55bd-5402-4b75-8019-5d3434741d9e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:56.735640 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c6ba55bd-5402-4b75-8019-5d3434741d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:56.756430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fc885a60-1978-45c2-bc92-2baa22dcec13 None None] MFA Rules not processed for user `ddb642f0e42948e3a70d72e609f66c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:56.757921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fc885a60-1978-45c2-bc92-2baa22dcec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:56.829060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba55bd-5402-4b75-8019-5d3434741d9e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:56.836022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbc5db-3c50-4de2-af9a-1a0c5ac525ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:56.839064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbc5db-3c50-4de2-af9a-1a0c5ac525ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.839064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbc5db-3c50-4de2-af9a-1a0c5ac525ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.839064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbc5db-3c50-4de2-af9a-1a0c5ac525ac admin admin] PATH_INFO: `/v3/projects/b38b542c1cec45f985f480b31709463d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.841845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbc5db-3c50-4de2-af9a-1a0c5ac525ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b38b542c1cec45f985f480b31709463d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:56.842387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbc5db-3c50-4de2-af9a-1a0c5ac525ac admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:56.847561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 948/1878] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:56.851951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc885a60-1978-45c2-bc92-2baa22dcec13 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:56.853465 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fc885a60-1978-45c2-bc92-2baa22dcec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:56.869869 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc885a60-1978-45c2-bc92-2baa22dcec13 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:56.875722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548da53-1e89-40f8-be9b-b469a4f1e645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:56.876422 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548da53-1e89-40f8-be9b-b469a4f1e645 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:56.876736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548da53-1e89-40f8-be9b-b469a4f1e645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:56.877014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548da53-1e89-40f8-be9b-b469a4f1e645 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:56.877699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548da53-1e89-40f8-be9b-b469a4f1e645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:56.880367 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548da53-1e89-40f8-be9b-b469a4f1e645 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:56.962303 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-25dbc5db-3c50-4de2-af9a-1a0c5ac525ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b38b542c1cec45f985f480b31709463d', 'request_id': 'req-25dbc5db-3c50-4de2-af9a-1a0c5ac525ac'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.968464 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-25dbc5db-3c50-4de2-af9a-1a0c5ac525ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b38b542c1cec45f985f480b31709463d', 'request_id': 'req-25dbc5db-3c50-4de2-af9a-1a0c5ac525ac'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:56.984128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 949/1879] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:56 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:06:56.988993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548da53-1e89-40f8-be9b-b469a4f1e645 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.039631 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-25dbc5db-3c50-4de2-af9a-1a0c5ac525ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b38b542c1cec45f985f480b31709463d', 'request_id': 'req-25dbc5db-3c50-4de2-af9a-1a0c5ac525ac'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.054107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-25dbc5db-3c50-4de2-af9a-1a0c5ac525ac admin admin] The token cache is being invalidate because project b38b542c1cec45f985f480b31709463d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:57.054634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-25dbc5db-3c50-4de2-af9a-1a0c5ac525ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.055457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-25dbc5db-3c50-4de2-af9a-1a0c5ac525ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.057226 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 931/1880] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:56 2022] DELETE /identity/v3/projects/b38b542c1cec45f985f480b31709463d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:57.061888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ecc6-5708-4ac0-890e-0b9e8721318b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.062188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ecc6-5708-4ac0-890e-0b9e8721318b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.062478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519ecc6-5708-4ac0-890e-0b9e8721318b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.073642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548da53-1e89-40f8-be9b-b469a4f1e645 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.083629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbbeb3-3def-4d7f-88f2-bbf10e91f03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.087228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbbeb3-3def-4d7f-88f2-bbf10e91f03c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.087535 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbbeb3-3def-4d7f-88f2-bbf10e91f03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.088008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbbeb3-3def-4d7f-88f2-bbf10e91f03c admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.088748 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbbeb3-3def-4d7f-88f2-bbf10e91f03c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.090060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f519ecc6-5708-4ac0-890e-0b9e8721318b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:57.091205 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbbeb3-3def-4d7f-88f2-bbf10e91f03c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.091676 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f519ecc6-5708-4ac0-890e-0b9e8721318b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:57.106951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 932/1881] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:57.109095 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73733e57-040a-447d-a3f0-a29227f5cc2d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.109461 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73733e57-040a-447d-a3f0-a29227f5cc2d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.109837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73733e57-040a-447d-a3f0-a29227f5cc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.132416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-73733e57-040a-447d-a3f0-a29227f5cc2d None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:57.133660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-73733e57-040a-447d-a3f0-a29227f5cc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:57.142480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 933/1882] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:57.146888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73733e57-040a-447d-a3f0-a29227f5cc2d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.156092 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73733e57-040a-447d-a3f0-a29227f5cc2d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.161664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3040c2e-9804-4a16-bc74-2d1d5e01bde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.162416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3040c2e-9804-4a16-bc74-2d1d5e01bde0 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.162774 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3040c2e-9804-4a16-bc74-2d1d5e01bde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.163124 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3040c2e-9804-4a16-bc74-2d1d5e01bde0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.163924 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3040c2e-9804-4a16-bc74-2d1d5e01bde0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:57.164340 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3040c2e-9804-4a16-bc74-2d1d5e01bde0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.166637 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3040c2e-9804-4a16-bc74-2d1d5e01bde0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.187920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 934/1883] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 16:06:57.191366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3040c2e-9804-4a16-bc74-2d1d5e01bde0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.201433 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3040c2e-9804-4a16-bc74-2d1d5e01bde0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.206153 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449c921-66f0-49e2-9150-11cf78ec1429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.206738 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449c921-66f0-49e2-9150-11cf78ec1429 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.207042 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449c921-66f0-49e2-9150-11cf78ec1429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.207309 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449c921-66f0-49e2-9150-11cf78ec1429 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.208004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449c921-66f0-49e2-9150-11cf78ec1429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.209926 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449c921-66f0-49e2-9150-11cf78ec1429 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.282259 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 950/1884] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:56 2022] POST /identity/v3/users => generated 297 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:06:57.291554 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbbeb3-3def-4d7f-88f2-bbf10e91f03c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.293380 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e0cbbeb3-3def-4d7f-88f2-bbf10e91f03c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:57.305672 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbbeb3-3def-4d7f-88f2-bbf10e91f03c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.310613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c3d1d-9e01-4153-9e28-cd010ff6b9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.311361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c3d1d-9e01-4153-9e28-cd010ff6b9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.311575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c3d1d-9e01-4153-9e28-cd010ff6b9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.311861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c3d1d-9e01-4153-9e28-cd010ff6b9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.312904 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c3d1d-9e01-4153-9e28-cd010ff6b9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.314726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c3d1d-9e01-4153-9e28-cd010ff6b9c1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.326624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 951/1885] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:06:57.334546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c3d1d-9e01-4153-9e28-cd010ff6b9c1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.336688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f46c3d1d-9e01-4153-9e28-cd010ff6b9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:57.351031 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c3d1d-9e01-4153-9e28-cd010ff6b9c1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.355845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63934407-876f-4a31-87be-a600cc710673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.356852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63934407-876f-4a31-87be-a600cc710673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.357145 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63934407-876f-4a31-87be-a600cc710673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.357572 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63934407-876f-4a31-87be-a600cc710673 admin admin] PATH_INFO: `/v3/projects/45c98b7f9dd14b0186fd91963aea0ab1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.358848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63934407-876f-4a31-87be-a600cc710673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c98b7f9dd14b0186fd91963aea0ab1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.360964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63934407-876f-4a31-87be-a600cc710673 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.424378 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 935/1886] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:57 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:06:57.425644 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449c921-66f0-49e2-9150-11cf78ec1429 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.488456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449c921-66f0-49e2-9150-11cf78ec1429 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.493409 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e0acf-fd74-473f-a5b8-d9ddee62e47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.494413 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e0acf-fd74-473f-a5b8-d9ddee62e47f admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.494696 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e0acf-fd74-473f-a5b8-d9ddee62e47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.494981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e0acf-fd74-473f-a5b8-d9ddee62e47f admin admin] PATH_INFO: `/v3/projects/9e47fda2dc8b400f9a5b87e3fc946ae8/users/dcfe686b9cbd465c9cc23dd45ee55fb5/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.510672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e0acf-fd74-473f-a5b8-d9ddee62e47f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e47fda2dc8b400f9a5b87e3fc946ae8, user_id=dcfe686b9cbd465c9cc23dd45ee55fb5, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.514066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e0acf-fd74-473f-a5b8-d9ddee62e47f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.524173 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-63934407-876f-4a31-87be-a600cc710673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c98b7f9dd14b0186fd91963aea0ab1', 'request_id': 'req-63934407-876f-4a31-87be-a600cc710673'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.686151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 936/1887] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:57 2022] PUT /identity/v3/projects/9e47fda2dc8b400f9a5b87e3fc946ae8/users/dcfe686b9cbd465c9cc23dd45ee55fb5/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:57.710121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e0acf-fd74-473f-a5b8-d9ddee62e47f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.953837 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-63934407-876f-4a31-87be-a600cc710673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c98b7f9dd14b0186fd91963aea0ab1', 'request_id': 'req-63934407-876f-4a31-87be-a600cc710673'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.953837 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-63934407-876f-4a31-87be-a600cc710673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c98b7f9dd14b0186fd91963aea0ab1', 'request_id': 'req-63934407-876f-4a31-87be-a600cc710673'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.953837 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-63934407-876f-4a31-87be-a600cc710673 admin admin] The token cache is being invalidate because project 45c98b7f9dd14b0186fd91963aea0ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:57.953837 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-63934407-876f-4a31-87be-a600cc710673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.955765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-63934407-876f-4a31-87be-a600cc710673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:57.955765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 952/1888] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:57 2022] DELETE /identity/v3/projects/45c98b7f9dd14b0186fd91963aea0ab1 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:57.955765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4048555-5cda-4a3c-ab2d-b76c009bf179 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.955765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4048555-5cda-4a3c-ab2d-b76c009bf179 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.955765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4048555-5cda-4a3c-ab2d-b76c009bf179 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.955765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 953/1889] 10.222.0.50 () {54 vars in 921 bytes} [Thu Jun 2 16:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:06:57.957150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4048555-5cda-4a3c-ab2d-b76c009bf179 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.957150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c4048555-5cda-4a3c-ab2d-b76c009bf179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:57.958071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e0acf-fd74-473f-a5b8-d9ddee62e47f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.958071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19652b1-3640-446e-938d-3636c88066cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.958071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19652b1-3640-446e-938d-3636c88066cd admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.958071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19652b1-3640-446e-938d-3636c88066cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.958448 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19652b1-3640-446e-938d-3636c88066cd admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.958448 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19652b1-3640-446e-938d-3636c88066cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.958448 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19652b1-3640-446e-938d-3636c88066cd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.958654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4048555-5cda-4a3c-ab2d-b76c009bf179 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.958654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ffb9d-ce22-4da9-bd13-f1f70d4a9d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.958654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ffb9d-ce22-4da9-bd13-f1f70d4a9d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.958654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ffb9d-ce22-4da9-bd13-f1f70d4a9d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.958942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ffb9d-ce22-4da9-bd13-f1f70d4a9d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.958942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ffb9d-ce22-4da9-bd13-f1f70d4a9d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.958942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ffb9d-ce22-4da9-bd13-f1f70d4a9d41 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.958942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 954/1890] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:57.958942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377139f-65a2-4593-a715-71f6783347dc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.958942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377139f-65a2-4593-a715-71f6783347dc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.959695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377139f-65a2-4593-a715-71f6783347dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.959695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4377139f-65a2-4593-a715-71f6783347dc None None] MFA Rules not processed for user `8d60a2abffc04ba59b65d5fca5e318a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:57.959695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4377139f-65a2-4593-a715-71f6783347dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:57.959695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 955/1891] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Jun 2 16:06:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:57.959695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377139f-65a2-4593-a715-71f6783347dc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.960106 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4377139f-65a2-4593-a715-71f6783347dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:57.960106 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377139f-65a2-4593-a715-71f6783347dc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.960106 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf462dd5-b32b-4f0f-9b0c-c19a3b5ea5ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60a2abffc04ba59b65d5fca5e318a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.960320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf462dd5-b32b-4f0f-9b0c-c19a3b5ea5ed service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.960320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf462dd5-b32b-4f0f-9b0c-c19a3b5ea5ed service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.960320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf462dd5-b32b-4f0f-9b0c-c19a3b5ea5ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.960320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf462dd5-b32b-4f0f-9b0c-c19a3b5ea5ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.960320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf462dd5-b32b-4f0f-9b0c-c19a3b5ea5ed service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:57.960320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 956/1892] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:06:57.960773 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9993-906b-4a84-b112-cbc29bb4bf87 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.960773 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9993-906b-4a84-b112-cbc29bb4bf87 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.960773 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9993-906b-4a84-b112-cbc29bb4bf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.961437 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-839e9993-906b-4a84-b112-cbc29bb4bf87 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:57.962581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-839e9993-906b-4a84-b112-cbc29bb4bf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:57.972430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 957/1893] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:57.972430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e9993-906b-4a84-b112-cbc29bb4bf87 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:57.981257 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e9993-906b-4a84-b112-cbc29bb4bf87 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:57.985975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1f667-85d0-4ff2-8d9d-0336c870063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:57.986826 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1f667-85d0-4ff2-8d9d-0336c870063c admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:57.987112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1f667-85d0-4ff2-8d9d-0336c870063c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:57.987421 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1f667-85d0-4ff2-8d9d-0336c870063c admin admin] PATH_INFO: `/v3/projects/9e47fda2dc8b400f9a5b87e3fc946ae8/users/dcfe686b9cbd465c9cc23dd45ee55fb5/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:57.989426 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1f667-85d0-4ff2-8d9d-0336c870063c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e47fda2dc8b400f9a5b87e3fc946ae8, user_id=dcfe686b9cbd465c9cc23dd45ee55fb5, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:57.992180 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1f667-85d0-4ff2-8d9d-0336c870063c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:58.002376 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 958/1894] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:57 2022] PUT /identity/v3/projects/9e47fda2dc8b400f9a5b87e3fc946ae8/users/dcfe686b9cbd465c9cc23dd45ee55fb5/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:58.003662 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae37c-e298-4b3c-bec5-1479cd26f31a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:58.003938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae37c-e298-4b3c-bec5-1479cd26f31a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:58.004251 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae37c-e298-4b3c-bec5-1479cd26f31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:58.022376 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7c1ae37c-e298-4b3c-bec5-1479cd26f31a None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:58.023567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7c1ae37c-e298-4b3c-bec5-1479cd26f31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:58.080931 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 959/1895] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:58.082929 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef725de3-20b0-4d9e-b7dd-6071365df73d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:58.083275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef725de3-20b0-4d9e-b7dd-6071365df73d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:58.083543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef725de3-20b0-4d9e-b7dd-6071365df73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:58.108516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ef725de3-20b0-4d9e-b7dd-6071365df73d None None] MFA Rules not processed for user `dcfe686b9cbd465c9cc23dd45ee55fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:58.109733 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ef725de3-20b0-4d9e-b7dd-6071365df73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:58.178451 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 960/1896] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:58.179302 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef725de3-20b0-4d9e-b7dd-6071365df73d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:58.189039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef725de3-20b0-4d9e-b7dd-6071365df73d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:58.194444 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730ccc3-95c2-4e80-b468-7822b2ecbade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:58.195095 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730ccc3-95c2-4e80-b468-7822b2ecbade admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:58.195381 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730ccc3-95c2-4e80-b468-7822b2ecbade admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:58.195661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730ccc3-95c2-4e80-b468-7822b2ecbade admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:58.196409 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730ccc3-95c2-4e80-b468-7822b2ecbade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:58.196719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730ccc3-95c2-4e80-b468-7822b2ecbade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:58.198417 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730ccc3-95c2-4e80-b468-7822b2ecbade admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:58.225565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 937/1897] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:57 2022] POST /identity/v3/users => generated 293 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:58.225565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19652b1-3640-446e-938d-3636c88066cd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:58.228389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 961/1898] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:58.228389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730ccc3-95c2-4e80-b468-7822b2ecbade admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:58.228545 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c19652b1-3640-446e-938d-3636c88066cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:58.228635 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7730ccc3-95c2-4e80-b468-7822b2ecbade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:58.235270 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19652b1-3640-446e-938d-3636c88066cd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:58.241371 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bbf44-dc86-47cf-b32b-004beb40ab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:58.242730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bbf44-dc86-47cf-b32b-004beb40ab5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:58.243032 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bbf44-dc86-47cf-b32b-004beb40ab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:58.243321 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bbf44-dc86-47cf-b32b-004beb40ab5f admin admin] PATH_INFO: `/v3/users/51247285170642698dd2c4567d7bd6cb` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:58.245111 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bbf44-dc86-47cf-b32b-004beb40ab5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=51247285170642698dd2c4567d7bd6cb)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:58.247052 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bbf44-dc86-47cf-b32b-004beb40ab5f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:58.291148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730ccc3-95c2-4e80-b468-7822b2ecbade admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:58.295778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4bacc-ff77-40a6-8b21-cf6979c27e9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:58.296544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4bacc-ff77-40a6-8b21-cf6979c27e9b service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:58.300906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4bacc-ff77-40a6-8b21-cf6979c27e9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:58.300906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4bacc-ff77-40a6-8b21-cf6979c27e9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:58.307858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4bacc-ff77-40a6-8b21-cf6979c27e9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:58.309381 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4bacc-ff77-40a6-8b21-cf6979c27e9b service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:58.318908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 962/1899] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:06:58.324945 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4bacc-ff77-40a6-8b21-cf6979c27e9b service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:58.326597 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5be4bacc-ff77-40a6-8b21-cf6979c27e9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:58.340674 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4bacc-ff77-40a6-8b21-cf6979c27e9b service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:58.347336 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc7a07-a48f-465e-98e8-715b9a7f20e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:58.348110 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc7a07-a48f-465e-98e8-715b9a7f20e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:58.348402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc7a07-a48f-465e-98e8-715b9a7f20e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:58.348684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc7a07-a48f-465e-98e8-715b9a7f20e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:58.349413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc7a07-a48f-465e-98e8-715b9a7f20e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:58.351030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc7a07-a48f-465e-98e8-715b9a7f20e5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:58.366714 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 963/1900] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:58.367927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc7a07-a48f-465e-98e8-715b9a7f20e5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:58.378950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc7a07-a48f-465e-98e8-715b9a7f20e5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:58.385156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf85dc-7688-4a00-8107-cbd90fdf15d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:58.385914 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf85dc-7688-4a00-8107-cbd90fdf15d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:58.386206 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf85dc-7688-4a00-8107-cbd90fdf15d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:58.386493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf85dc-7688-4a00-8107-cbd90fdf15d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:58.387322 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf85dc-7688-4a00-8107-cbd90fdf15d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:58.389403 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf85dc-7688-4a00-8107-cbd90fdf15d4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:58.620173 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 964/1901] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:58 2022] POST /identity/v3/projects => generated 381 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:58.621077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf85dc-7688-4a00-8107-cbd90fdf15d4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:58.691699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf85dc-7688-4a00-8107-cbd90fdf15d4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:58.696844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f3e4a-dae1-4109-8701-a59dd49c7cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:58.697570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f3e4a-dae1-4109-8701-a59dd49c7cbe admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:58.697888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f3e4a-dae1-4109-8701-a59dd49c7cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:58.698165 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f3e4a-dae1-4109-8701-a59dd49c7cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:58.698889 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f3e4a-dae1-4109-8701-a59dd49c7cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:58.700574 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f3e4a-dae1-4109-8701-a59dd49c7cbe admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:58.711392 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 965/1902] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:58.712948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f3e4a-dae1-4109-8701-a59dd49c7cbe admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:58.723035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f3e4a-dae1-4109-8701-a59dd49c7cbe admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:58.736169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0284bd-eef7-45a7-96ff-c54be8de578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:58.736169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0284bd-eef7-45a7-96ff-c54be8de578b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:58.736169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0284bd-eef7-45a7-96ff-c54be8de578b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:58.736169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0284bd-eef7-45a7-96ff-c54be8de578b admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:58.736507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0284bd-eef7-45a7-96ff-c54be8de578b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:58.736886 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0284bd-eef7-45a7-96ff-c54be8de578b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:58.738939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-683bbf44-dc86-47cf-b32b-004beb40ab5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51247285170642698dd2c4567d7bd6cb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:58.750825 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-683bbf44-dc86-47cf-b32b-004beb40ab5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51247285170642698dd2c4567d7bd6cb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:58.751505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-683bbf44-dc86-47cf-b32b-004beb40ab5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51247285170642698dd2c4567d7bd6cb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:58.758412 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-683bbf44-dc86-47cf-b32b-004beb40ab5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51247285170642698dd2c4567d7bd6cb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:58.759073 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-683bbf44-dc86-47cf-b32b-004beb40ab5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51247285170642698dd2c4567d7bd6cb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:58.868026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 938/1903] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:58 2022] DELETE /identity/v3/users/51247285170642698dd2c4567d7bd6cb => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:58.868738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 966/1904] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:58 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:58.868872 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bbf44-dc86-47cf-b32b-004beb40ab5f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:58.870168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-683bbf44-dc86-47cf-b32b-004beb40ab5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:58.872589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0284bd-eef7-45a7-96ff-c54be8de578b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:58.874237 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2e0284bd-eef7-45a7-96ff-c54be8de578b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:58.887824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0284bd-eef7-45a7-96ff-c54be8de578b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:58.952661 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bbf44-dc86-47cf-b32b-004beb40ab5f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:58.955397 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cc15c-9d56-4fa1-b976-7eb6d9c43d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:58.956310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cc15c-9d56-4fa1-b976-7eb6d9c43d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:58.956718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cc15c-9d56-4fa1-b976-7eb6d9c43d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:58.957054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cc15c-9d56-4fa1-b976-7eb6d9c43d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:58.957966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cc15c-9d56-4fa1-b976-7eb6d9c43d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:58.958259 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835ecfb-168c-435f-ab25-482fd3e6312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:58.959162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835ecfb-168c-435f-ab25-482fd3e6312a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:58.959452 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835ecfb-168c-435f-ab25-482fd3e6312a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:58.959737 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835ecfb-168c-435f-ab25-482fd3e6312a admin admin] PATH_INFO: `/v3/projects/77d343217dd84c87ad7da74215997005/users/03b46e6aee044a5bb80fd26156a79135/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:58.959911 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cc15c-9d56-4fa1-b976-7eb6d9c43d03 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:58.974968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 967/1905] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:58.978801 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cc15c-9d56-4fa1-b976-7eb6d9c43d03 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:58.981207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835ecfb-168c-435f-ab25-482fd3e6312a admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d343217dd84c87ad7da74215997005, user_id=03b46e6aee044a5bb80fd26156a79135, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:58.983957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835ecfb-168c-435f-ab25-482fd3e6312a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:58.997508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cc15c-9d56-4fa1-b976-7eb6d9c43d03 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:59.002846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d576fb8-803e-4786-aab1-39769645aec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:59.003547 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d576fb8-803e-4786-aab1-39769645aec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.003838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d576fb8-803e-4786-aab1-39769645aec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.004171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d576fb8-803e-4786-aab1-39769645aec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.005134 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d576fb8-803e-4786-aab1-39769645aec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:59.006481 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d576fb8-803e-4786-aab1-39769645aec0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:59.017655 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 968/1906] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:06:59.022047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d576fb8-803e-4786-aab1-39769645aec0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:59.033005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d576fb8-803e-4786-aab1-39769645aec0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:59.038885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eaab9-849f-421d-bd39-81e91d389ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:59.039781 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eaab9-849f-421d-bd39-81e91d389ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.040097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eaab9-849f-421d-bd39-81e91d389ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.040377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eaab9-849f-421d-bd39-81e91d389ff8 admin admin] PATH_INFO: `/v3/projects/869bb6ccefea4f39a75ced267692df26/users/39d83a4f35944487b40406a9fbe542c1/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.062320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58eaab9-849f-421d-bd39-81e91d389ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869bb6ccefea4f39a75ced267692df26, user_id=39d83a4f35944487b40406a9fbe542c1, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:59.072025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 939/1907] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:58 2022] PUT /identity/v3/projects/77d343217dd84c87ad7da74215997005/users/03b46e6aee044a5bb80fd26156a79135/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:59.072246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58eaab9-849f-421d-bd39-81e91d389ff8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:59.076196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf8d3-659b-4181-a1aa-0a901a10c0e4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.076196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf8d3-659b-4181-a1aa-0a901a10c0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.076196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf8d3-659b-4181-a1aa-0a901a10c0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.103168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-63adf8d3-659b-4181-a1aa-0a901a10c0e4 None None] MFA Rules not processed for user `03b46e6aee044a5bb80fd26156a79135`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:59.104406 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-63adf8d3-659b-4181-a1aa-0a901a10c0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:59.168968 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 940/1908] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:06:59.180466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adf8d3-659b-4181-a1aa-0a901a10c0e4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:59.186241 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-63adf8d3-659b-4181-a1aa-0a901a10c0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:59.189526 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 969/1909] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:06:59 2022] PUT /identity/v3/projects/869bb6ccefea4f39a75ced267692df26/users/39d83a4f35944487b40406a9fbe542c1/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:59.196137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eaab9-849f-421d-bd39-81e91d389ff8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:59.197923 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f58eaab9-849f-421d-bd39-81e91d389ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:59.251862 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adf8d3-659b-4181-a1aa-0a901a10c0e4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:59.272340 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eaab9-849f-421d-bd39-81e91d389ff8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:59.277350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:59.278239 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.278528 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.278811 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee admin admin] PATH_INFO: `/v3/projects/6d3a860bca7b4064a33db0bbe8380c0a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.280047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3a860bca7b4064a33db0bbe8380c0a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:59.281956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:59.302618 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751c49f-b6ae-4f28-b83e-8daa201a555a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:59.303270 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751c49f-b6ae-4f28-b83e-8daa201a555a service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.303558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751c49f-b6ae-4f28-b83e-8daa201a555a service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.303841 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751c49f-b6ae-4f28-b83e-8daa201a555a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.359966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751c49f-b6ae-4f28-b83e-8daa201a555a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:59.361468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751c49f-b6ae-4f28-b83e-8daa201a555a service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:59.371299 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 941/1910] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:06:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:06:59.373297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189064b-bae7-44a7-adda-091fb136f06f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.373886 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189064b-bae7-44a7-adda-091fb136f06f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.374117 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189064b-bae7-44a7-adda-091fb136f06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.401357 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3a860bca7b4064a33db0bbe8380c0a', 'request_id': 'req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:59.402514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8189064b-bae7-44a7-adda-091fb136f06f None None] MFA Rules not processed for user `39d83a4f35944487b40406a9fbe542c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:59.403718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8189064b-bae7-44a7-adda-091fb136f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:59.465310 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 942/1911] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:59.466297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189064b-bae7-44a7-adda-091fb136f06f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:59.487694 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3a860bca7b4064a33db0bbe8380c0a', 'request_id': 'req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:59.495206 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3a860bca7b4064a33db0bbe8380c0a', 'request_id': 'req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:59.506992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee admin admin] The token cache is being invalidate because project 6d3a860bca7b4064a33db0bbe8380c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:06:59.506992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:59.507674 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:59.509634 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 970/1912] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:06:59 2022] DELETE /identity/v3/projects/6d3a860bca7b4064a33db0bbe8380c0a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:06:59.510454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:59.512051 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:59.533062 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189064b-bae7-44a7-adda-091fb136f06f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:59.538385 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b501c-cfd0-41eb-bd43-2d961b53a640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:59.541004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b501c-cfd0-41eb-bd43-2d961b53a640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.541004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b501c-cfd0-41eb-bd43-2d961b53a640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.541004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b501c-cfd0-41eb-bd43-2d961b53a640 admin admin] PATH_INFO: `/v3/users/03b46e6aee044a5bb80fd26156a79135` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.541361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b501c-cfd0-41eb-bd43-2d961b53a640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b46e6aee044a5bb80fd26156a79135)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:59.543350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b501c-cfd0-41eb-bd43-2d961b53a640 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:59.593387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e208c10-4e1d-42d7-90af-9a02e9dbdeee admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:59.598520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076adf59-3d7c-43c9-9d90-74de199785af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:59.599244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076adf59-3d7c-43c9-9d90-74de199785af admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.599530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076adf59-3d7c-43c9-9d90-74de199785af admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.599810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076adf59-3d7c-43c9-9d90-74de199785af admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.600540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076adf59-3d7c-43c9-9d90-74de199785af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:59.602446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076adf59-3d7c-43c9-9d90-74de199785af admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:59.702743 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 971/1913] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:59 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:06:59.704566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca596-efc2-4130-a987-1fb01960974d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.704858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca596-efc2-4130-a987-1fb01960974d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.705143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca596-efc2-4130-a987-1fb01960974d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.723274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-441ca596-efc2-4130-a987-1fb01960974d None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:59.724504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-441ca596-efc2-4130-a987-1fb01960974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:59.781819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 972/1914] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:59.782735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca596-efc2-4130-a987-1fb01960974d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:59.783144 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ed5b501c-cfd0-41eb-bd43-2d961b53a640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b46e6aee044a5bb80fd26156a79135'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:59.784125 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-441ca596-efc2-4130-a987-1fb01960974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:59.796066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ed5b501c-cfd0-41eb-bd43-2d961b53a640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b46e6aee044a5bb80fd26156a79135'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:59.796761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ed5b501c-cfd0-41eb-bd43-2d961b53a640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b46e6aee044a5bb80fd26156a79135'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:59.803748 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ed5b501c-cfd0-41eb-bd43-2d961b53a640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b46e6aee044a5bb80fd26156a79135'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:59.804356 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ed5b501c-cfd0-41eb-bd43-2d961b53a640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b46e6aee044a5bb80fd26156a79135'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:06:59.845965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca596-efc2-4130-a987-1fb01960974d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:59.851283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c4382-1c1d-4818-a073-696a49652e66 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe686b9cbd465c9cc23dd45ee55fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e47fda2dc8b400f9a5b87e3fc946ae8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:59.851966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c4382-1c1d-4818-a073-696a49652e66 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.852290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c4382-1c1d-4818-a073-696a49652e66 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.852573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c4382-1c1d-4818-a073-696a49652e66 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.853348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c4382-1c1d-4818-a073-696a49652e66 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:06:59.853684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c4382-1c1d-4818-a073-696a49652e66 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:59.855343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c4382-1c1d-4818-a073-696a49652e66 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:59.867515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 973/1915] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:06:59.868316 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c4382-1c1d-4818-a073-696a49652e66 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:59.870002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8e2c4382-1c1d-4818-a073-696a49652e66 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:59.874000 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 943/1916] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:06:59 2022] DELETE /identity/v3/users/03b46e6aee044a5bb80fd26156a79135 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:06:59.876481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2519b-1abf-468f-be89-92c7d15974c4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.878491 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2519b-1abf-468f-be89-92c7d15974c4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.878786 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2519b-1abf-468f-be89-92c7d15974c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.883517 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c4382-1c1d-4818-a073-696a49652e66 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:06:59.896517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a3a2519b-1abf-468f-be89-92c7d15974c4 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:06:59.897657 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a3a2519b-1abf-468f-be89-92c7d15974c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:06:59.941151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c4db2-d0bc-4ac1-b24e-599eb8f49b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:06:59.941831 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4db2-d0bc-4ac1-b24e-599eb8f49b4e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:06:59.942208 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4db2-d0bc-4ac1-b24e-599eb8f49b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:06:59.942488 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4db2-d0bc-4ac1-b24e-599eb8f49b4e admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:06:59.943174 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c4db2-d0bc-4ac1-b24e-599eb8f49b4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:06:59.945151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c4db2-d0bc-4ac1-b24e-599eb8f49b4e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:06:59.957789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 944/1917] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:06:59.958630 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2519b-1abf-468f-be89-92c7d15974c4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:06:59.959894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a3a2519b-1abf-468f-be89-92c7d15974c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:00.022790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2519b-1abf-468f-be89-92c7d15974c4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.036025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070abb3-dab3-47ca-baea-d68978fb019a tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe686b9cbd465c9cc23dd45ee55fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e47fda2dc8b400f9a5b87e3fc946ae8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.036025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070abb3-dab3-47ca-baea-d68978fb019a tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.036025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070abb3-dab3-47ca-baea-d68978fb019a tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.036330 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070abb3-dab3-47ca-baea-d68978fb019a tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.036330 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070abb3-dab3-47ca-baea-d68978fb019a tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.036330 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070abb3-dab3-47ca-baea-d68978fb019a tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.060641 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 974/1918] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:06:59 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:00.061752 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2b544-0536-4fef-9254-4257fc63d074 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.062049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2b544-0536-4fef-9254-4257fc63d074 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.062330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2b544-0536-4fef-9254-4257fc63d074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.080128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4ad2b544-0536-4fef-9254-4257fc63d074 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:00.081952 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4ad2b544-0536-4fef-9254-4257fc63d074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:00.089627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 975/1919] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:00.090438 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2b544-0536-4fef-9254-4257fc63d074 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.100306 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2b544-0536-4fef-9254-4257fc63d074 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.104823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83b1f6-8178-4054-93d7-6b8654204d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.105453 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83b1f6-8178-4054-93d7-6b8654204d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.105736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83b1f6-8178-4054-93d7-6b8654204d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.106014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83b1f6-8178-4054-93d7-6b8654204d21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.106820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83b1f6-8178-4054-93d7-6b8654204d21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:00.107123 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83b1f6-8178-4054-93d7-6b8654204d21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.109029 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83b1f6-8178-4054-93d7-6b8654204d21 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.120278 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 976/1920] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:00.127589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83b1f6-8178-4054-93d7-6b8654204d21 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.130511 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83b1f6-8178-4054-93d7-6b8654204d21 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.135305 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d8ba8-f5c6-4cdf-a6c9-b1bb38e1ed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.135945 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d8ba8-f5c6-4cdf-a6c9-b1bb38e1ed0c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.136267 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d8ba8-f5c6-4cdf-a6c9-b1bb38e1ed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.136573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d8ba8-f5c6-4cdf-a6c9-b1bb38e1ed0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.137299 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d8ba8-f5c6-4cdf-a6c9-b1bb38e1ed0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.138849 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d8ba8-f5c6-4cdf-a6c9-b1bb38e1ed0c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.150422 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 977/1921] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:00.151306 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d8ba8-f5c6-4cdf-a6c9-b1bb38e1ed0c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.153395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e60d8ba8-f5c6-4cdf-a6c9-b1bb38e1ed0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:00.158796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 945/1922] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:06:59 2022] POST /identity/v3/projects => generated 354 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:00.158796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070abb3-dab3-47ca-baea-d68978fb019a tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.218065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d8ba8-f5c6-4cdf-a6c9-b1bb38e1ed0c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.224355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070abb3-dab3-47ca-baea-d68978fb019a tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.229620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff38e0-2d4d-4a7c-af51-a36bb48a2e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.230514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff38e0-2d4d-4a7c-af51-a36bb48a2e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.230966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff38e0-2d4d-4a7c-af51-a36bb48a2e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.231401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff38e0-2d4d-4a7c-af51-a36bb48a2e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.232292 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff38e0-2d4d-4a7c-af51-a36bb48a2e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.234376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff38e0-2d4d-4a7c-af51-a36bb48a2e7b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.283511 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada1176-47b6-41af-997d-7c97b922db6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.284236 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1176-47b6-41af-997d-7c97b922db6b service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.284527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1176-47b6-41af-997d-7c97b922db6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.284849 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1176-47b6-41af-997d-7c97b922db6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.294176 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada1176-47b6-41af-997d-7c97b922db6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.295610 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada1176-47b6-41af-997d-7c97b922db6b service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.316925 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 978/1923] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:00.316925 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada1176-47b6-41af-997d-7c97b922db6b service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.316925 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada1176-47b6-41af-997d-7c97b922db6b service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.321186 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff01e20-a26e-4665-a855-497b1f45cef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.322066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff01e20-a26e-4665-a855-497b1f45cef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.322693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff01e20-a26e-4665-a855-497b1f45cef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.322693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff01e20-a26e-4665-a855-497b1f45cef5 admin admin] PATH_INFO: `/v3/projects/2d3f8488daf344ebb446a3c97911cac0/users/876d320c6bb04cea908ed9b1294b20ef/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.336850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff01e20-a26e-4665-a855-497b1f45cef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3f8488daf344ebb446a3c97911cac0, user_id=876d320c6bb04cea908ed9b1294b20ef, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.339622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff01e20-a26e-4665-a855-497b1f45cef5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.389799 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 946/1924] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:00 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:00.394105 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff38e0-2d4d-4a7c-af51-a36bb48a2e7b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.418768 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:00.424450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 979/1925] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:00 2022] PUT /identity/v3/projects/2d3f8488daf344ebb446a3c97911cac0/users/876d320c6bb04cea908ed9b1294b20ef/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:00.425945 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff01e20-a26e-4665-a855-497b1f45cef5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.457643 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff38e0-2d4d-4a7c-af51-a36bb48a2e7b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.492659 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff01e20-a26e-4665-a855-497b1f45cef5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.498706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2251f3-d09a-4fca-b404-8f71c95bbc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.499402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2251f3-d09a-4fca-b404-8f71c95bbc24 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.500186 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2251f3-d09a-4fca-b404-8f71c95bbc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.500186 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2251f3-d09a-4fca-b404-8f71c95bbc24 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.500703 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2251f3-d09a-4fca-b404-8f71c95bbc24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.502657 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2251f3-d09a-4fca-b404-8f71c95bbc24 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.517135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06fe4d-f260-4102-927d-fcd4057af550 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe686b9cbd465c9cc23dd45ee55fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e47fda2dc8b400f9a5b87e3fc946ae8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.517938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06fe4d-f260-4102-927d-fcd4057af550 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.518337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06fe4d-f260-4102-927d-fcd4057af550 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.518741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06fe4d-f260-4102-927d-fcd4057af550 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.519596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06fe4d-f260-4102-927d-fcd4057af550 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:00.520036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06fe4d-f260-4102-927d-fcd4057af550 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.521778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06fe4d-f260-4102-927d-fcd4057af550 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.537559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 947/1926] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:00.537559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06fe4d-f260-4102-927d-fcd4057af550 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.548808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06fe4d-f260-4102-927d-fcd4057af550 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.554407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b57b8-6da1-4e0f-b82f-ebcdda781898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.555221 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b57b8-6da1-4e0f-b82f-ebcdda781898 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.555610 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b57b8-6da1-4e0f-b82f-ebcdda781898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.558455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b57b8-6da1-4e0f-b82f-ebcdda781898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.558455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b57b8-6da1-4e0f-b82f-ebcdda781898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.558455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b57b8-6da1-4e0f-b82f-ebcdda781898 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.573307 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 948/1927] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:00.579921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b57b8-6da1-4e0f-b82f-ebcdda781898 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.589929 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b57b8-6da1-4e0f-b82f-ebcdda781898 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.594675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4253c0b-c004-478e-8999-b4548eb10034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.595561 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4253c0b-c004-478e-8999-b4548eb10034 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.595850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4253c0b-c004-478e-8999-b4548eb10034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.596168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4253c0b-c004-478e-8999-b4548eb10034 admin admin] PATH_INFO: `/v3/projects/2d3f8488daf344ebb446a3c97911cac0/users/876d320c6bb04cea908ed9b1294b20ef/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.598689 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4253c0b-c004-478e-8999-b4548eb10034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3f8488daf344ebb446a3c97911cac0, user_id=876d320c6bb04cea908ed9b1294b20ef, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.601362 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4253c0b-c004-478e-8999-b4548eb10034 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.612135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 949/1928] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:00 2022] PUT /identity/v3/projects/2d3f8488daf344ebb446a3c97911cac0/users/876d320c6bb04cea908ed9b1294b20ef/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:00.614130 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4253c0b-c004-478e-8999-b4548eb10034 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.659694 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 980/1929] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:00 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:00.659694 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a77e4-35d9-489e-ae0a-408ebb20af75 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.659694 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a77e4-35d9-489e-ae0a-408ebb20af75 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.659694 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a77e4-35d9-489e-ae0a-408ebb20af75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.687156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4b7a77e4-35d9-489e-ae0a-408ebb20af75 None None] MFA Rules not processed for user `876d320c6bb04cea908ed9b1294b20ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:00.688653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4b7a77e4-35d9-489e-ae0a-408ebb20af75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:00.694042 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4253c0b-c004-478e-8999-b4548eb10034 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.698954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcfe686b9cbd465c9cc23dd45ee55fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e47fda2dc8b400f9a5b87e3fc946ae8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.699888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.700314 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.700685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] PATH_INFO: `/v3/projects/291c4b4b1cff43e183e8004745ec9ee0` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.701970 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] RBAC: Authorizing `identity:delete_project(project_id=291c4b4b1cff43e183e8004745ec9ee0)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.703953 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.766234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 981/1930] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:00.767352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a77e4-35d9-489e-ae0a-408ebb20af75 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.838586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a77e4-35d9-489e-ae0a-408ebb20af75 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.843469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e58fd-4c0d-46f2-ac70-b52bf685d438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.844190 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e58fd-4c0d-46f2-ac70-b52bf685d438 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.844503 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e58fd-4c0d-46f2-ac70-b52bf685d438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.844770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e58fd-4c0d-46f2-ac70-b52bf685d438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.845497 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e58fd-4c0d-46f2-ac70-b52bf685d438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:00.847124 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e58fd-4c0d-46f2-ac70-b52bf685d438 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:00.866133 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 982/1931] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:00.867224 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e58fd-4c0d-46f2-ac70-b52bf685d438 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.869175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ff8e58fd-4c0d-46f2-ac70-b52bf685d438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:00.879256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '291c4b4b1cff43e183e8004745ec9ee0', 'request_id': 'req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:00.885449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '291c4b4b1cff43e183e8004745ec9ee0', 'request_id': 'req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:00.927487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e58fd-4c0d-46f2-ac70-b52bf685d438 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:00.970763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '291c4b4b1cff43e183e8004745ec9ee0', 'request_id': 'req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:00.975357 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae189a5-bf05-47e0-8a80-e9c7c32d26cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:00.976035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae189a5-bf05-47e0-8a80-e9c7c32d26cd service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:00.976308 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae189a5-bf05-47e0-8a80-e9c7c32d26cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:00.976589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae189a5-bf05-47e0-8a80-e9c7c32d26cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:00.983253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] The token cache is being invalidate because project 291c4b4b1cff43e183e8004745ec9ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:00.983545 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:00.984251 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:00.986098 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 950/1932] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:00 2022] DELETE /identity/v3/projects/291c4b4b1cff43e183e8004745ec9ee0 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:00.986626 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:00.988602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:01.051840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae189a5-bf05-47e0-8a80-e9c7c32d26cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:01.053942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae189a5-bf05-47e0-8a80-e9c7c32d26cd service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:01.062637 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd0bf9-a817-4ab2-8cee-2a3a16938498 tempest-VolumeQuotaClassesTest-2035637943 tempest-VolumeQuotaClassesTest-2035637943-project-admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:01.064347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 983/1933] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:01.065149 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae189a5-bf05-47e0-8a80-e9c7c32d26cd service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:01.069264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:01.070137 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:01.070460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:01.070818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb admin admin] PATH_INFO: `/v3/projects/77d343217dd84c87ad7da74215997005` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:01.072056 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d343217dd84c87ad7da74215997005)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:01.073970 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:01.076568 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae189a5-bf05-47e0-8a80-e9c7c32d26cd service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:01.081543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182a1ea-56dc-44c9-acec-3b40b410bf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:01.082215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182a1ea-56dc-44c9-acec-3b40b410bf5e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:01.082553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182a1ea-56dc-44c9-acec-3b40b410bf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:01.082849 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182a1ea-56dc-44c9-acec-3b40b410bf5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:01.083615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182a1ea-56dc-44c9-acec-3b40b410bf5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:01.085420 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182a1ea-56dc-44c9-acec-3b40b410bf5e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:01.095919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 984/1934] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:01.100115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182a1ea-56dc-44c9-acec-3b40b410bf5e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:01.101846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2182a1ea-56dc-44c9-acec-3b40b410bf5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:01.113135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:01.116527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182a1ea-56dc-44c9-acec-3b40b410bf5e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:01.121202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01364f01-4699-4b55-8026-dcf0f221a584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:01.122135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01364f01-4699-4b55-8026-dcf0f221a584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:01.122416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01364f01-4699-4b55-8026-dcf0f221a584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:01.122694 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01364f01-4699-4b55-8026-dcf0f221a584 admin admin] PATH_INFO: `/v3/projects/ec4df6d9184b486885283b1e0d19dd17/users/117adabb6a27473e9e9ee68efb45a067/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:01.137605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01364f01-4699-4b55-8026-dcf0f221a584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec4df6d9184b486885283b1e0d19dd17, user_id=117adabb6a27473e9e9ee68efb45a067, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:01.140877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01364f01-4699-4b55-8026-dcf0f221a584 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:01.296307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 985/1935] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:01 2022] PUT /identity/v3/projects/ec4df6d9184b486885283b1e0d19dd17/users/117adabb6a27473e9e9ee68efb45a067/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:01.304366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d343217dd84c87ad7da74215997005', 'request_id': 'req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:01.307050 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa80e3e-112c-495c-8f62-b65927f0545b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:01.307344 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa80e3e-112c-495c-8f62-b65927f0545b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:01.307624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa80e3e-112c-495c-8f62-b65927f0545b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:01.310096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d343217dd84c87ad7da74215997005', 'request_id': 'req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:01.336973 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5fa80e3e-112c-495c-8f62-b65927f0545b None None] MFA Rules not processed for user `117adabb6a27473e9e9ee68efb45a067`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:01.338239 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5fa80e3e-112c-495c-8f62-b65927f0545b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:01.405352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 986/1936] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:01.406260 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa80e3e-112c-495c-8f62-b65927f0545b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:01.407863 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5fa80e3e-112c-495c-8f62-b65927f0545b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:01.439890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d343217dd84c87ad7da74215997005', 'request_id': 'req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:01.454046 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb admin admin] The token cache is being invalidate because project 77d343217dd84c87ad7da74215997005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:01.454497 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:01.455233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:01.457135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 951/1937] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:00 2022] DELETE /identity/v3/projects/77d343217dd84c87ad7da74215997005 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:01.457761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:01.461346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:01.481144 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa80e3e-112c-495c-8f62-b65927f0545b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:01.481975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac95ddb-c08f-4b1c-a77c-700c6fab04df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:01.482903 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac95ddb-c08f-4b1c-a77c-700c6fab04df service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:01.483540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac95ddb-c08f-4b1c-a77c-700c6fab04df service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:01.483950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac95ddb-c08f-4b1c-a77c-700c6fab04df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:01.486236 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-eac95ddb-c08f-4b1c-a77c-700c6fab04df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:01.537319 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97c70d-c39f-4403-8f26-7dfb11d15dbb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:01.542851 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdb2d5-f9ca-41e7-8b21-f32ac92a8fa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:01.544365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdb2d5-f9ca-41e7-8b21-f32ac92a8fa6 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:01.544365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdb2d5-f9ca-41e7-8b21-f32ac92a8fa6 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:01.544365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdb2d5-f9ca-41e7-8b21-f32ac92a8fa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:01.544752 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac95ddb-c08f-4b1c-a77c-700c6fab04df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:01.545932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7efdb2d5-f9ca-41e7-8b21-f32ac92a8fa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:01.546207 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac95ddb-c08f-4b1c-a77c-700c6fab04df service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:01.555865 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 987/1938] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:01.557024 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdb2d5-f9ca-41e7-8b21-f32ac92a8fa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:01.557210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e96dc-f6f6-44bb-ac5d-3c4ea1b10ffe None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:01.557490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e96dc-f6f6-44bb-ac5d-3c4ea1b10ffe None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:01.557789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e96dc-f6f6-44bb-ac5d-3c4ea1b10ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:01.558619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdb2d5-f9ca-41e7-8b21-f32ac92a8fa6 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:01.568407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 952/1939] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:01.576910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ee7e96dc-f6f6-44bb-ac5d-3c4ea1b10ffe None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:01.578111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ee7e96dc-f6f6-44bb-ac5d-3c4ea1b10ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:01.637851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 988/1940] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:01.645947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f8a5b-8c92-4ef3-96b4-ddd8afa8cbfb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:01.646243 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f8a5b-8c92-4ef3-96b4-ddd8afa8cbfb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:01.646528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f8a5b-8c92-4ef3-96b4-ddd8afa8cbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:01.664356 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-091f8a5b-8c92-4ef3-96b4-ddd8afa8cbfb None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:01.665573 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-091f8a5b-8c92-4ef3-96b4-ddd8afa8cbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:01.673337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 953/1941] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:01.678890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e96dc-f6f6-44bb-ac5d-3c4ea1b10ffe None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:01.688416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e96dc-f6f6-44bb-ac5d-3c4ea1b10ffe None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:01.699057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b6c73-b6ac-4762-a09f-574f752d5831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:01.699057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b6c73-b6ac-4762-a09f-574f752d5831 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:01.699057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b6c73-b6ac-4762-a09f-574f752d5831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:01.699057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b6c73-b6ac-4762-a09f-574f752d5831 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:01.699432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b6c73-b6ac-4762-a09f-574f752d5831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:01.699432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b6c73-b6ac-4762-a09f-574f752d5831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:01.699432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b6c73-b6ac-4762-a09f-574f752d5831 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:01.709285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 989/1942] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:01.713464 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f8a5b-8c92-4ef3-96b4-ddd8afa8cbfb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:01.729014 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f8a5b-8c92-4ef3-96b4-ddd8afa8cbfb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:01.734027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49e1b9-d673-49dc-a0d3-80caf51fc9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:01.734691 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49e1b9-d673-49dc-a0d3-80caf51fc9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:01.734978 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49e1b9-d673-49dc-a0d3-80caf51fc9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:01.735306 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49e1b9-d673-49dc-a0d3-80caf51fc9c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:01.736004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49e1b9-d673-49dc-a0d3-80caf51fc9c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:01.738423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49e1b9-d673-49dc-a0d3-80caf51fc9c0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:01.841382 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 954/1943] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:01 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:01.845583 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b6c73-b6ac-4762-a09f-574f752d5831 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:01.855398 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b6c73-b6ac-4762-a09f-574f752d5831 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:01.911849 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e22797-17f1-48d5-91cb-c043ddda5ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:01.912558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e22797-17f1-48d5-91cb-c043ddda5ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:01.912850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e22797-17f1-48d5-91cb-c043ddda5ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:01.913135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e22797-17f1-48d5-91cb-c043ddda5ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:01.913855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e22797-17f1-48d5-91cb-c043ddda5ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:01.915843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e22797-17f1-48d5-91cb-c043ddda5ea6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:02.012022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 990/1944] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:01 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:02.015845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49e1b9-d673-49dc-a0d3-80caf51fc9c0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:02.026897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49e1b9-d673-49dc-a0d3-80caf51fc9c0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:02.031788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d56f8e-d26d-492e-a3bc-6b32c1ae3038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:02.032465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d56f8e-d26d-492e-a3bc-6b32c1ae3038 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:02.032761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d56f8e-d26d-492e-a3bc-6b32c1ae3038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:02.033044 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d56f8e-d26d-492e-a3bc-6b32c1ae3038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:02.033773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d56f8e-d26d-492e-a3bc-6b32c1ae3038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:02.036065 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d56f8e-d26d-492e-a3bc-6b32c1ae3038 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:02.046681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 955/1945] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:02.053831 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e22797-17f1-48d5-91cb-c043ddda5ea6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:02.063665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e22797-17f1-48d5-91cb-c043ddda5ea6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:02.068333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8466002-7c1d-4890-8958-6807ab8f46fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:02.068993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8466002-7c1d-4890-8958-6807ab8f46fa admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:02.069282 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8466002-7c1d-4890-8958-6807ab8f46fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:02.069567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8466002-7c1d-4890-8958-6807ab8f46fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:02.070291 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8466002-7c1d-4890-8958-6807ab8f46fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:02.071897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8466002-7c1d-4890-8958-6807ab8f46fa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:02.090161 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 991/1946] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:02.091695 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d56f8e-d26d-492e-a3bc-6b32c1ae3038 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:02.103405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d56f8e-d26d-492e-a3bc-6b32c1ae3038 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:02.109351 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1964a-19e7-478f-b1d4-f7b71b464221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:02.110546 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1964a-19e7-478f-b1d4-f7b71b464221 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:02.110546 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1964a-19e7-478f-b1d4-f7b71b464221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:02.110815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1964a-19e7-478f-b1d4-f7b71b464221 admin admin] PATH_INFO: `/v3/projects/87c95570f9fd4cd0919e559cc1cc027e/users/19e8e06a84c04f7ca4cdda7d9b19ea21/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:02.126504 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1964a-19e7-478f-b1d4-f7b71b464221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c95570f9fd4cd0919e559cc1cc027e, user_id=19e8e06a84c04f7ca4cdda7d9b19ea21, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:02.129317 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1964a-19e7-478f-b1d4-f7b71b464221 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:02.230100 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 956/1947] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:02 2022] PUT /identity/v3/projects/87c95570f9fd4cd0919e559cc1cc027e/users/19e8e06a84c04f7ca4cdda7d9b19ea21/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:02.241512 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f46d2-9527-4257-870c-78f6b3346117 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:02.241811 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f46d2-9527-4257-870c-78f6b3346117 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:02.242097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f46d2-9527-4257-870c-78f6b3346117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:02.269097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e87f46d2-9527-4257-870c-78f6b3346117 None None] MFA Rules not processed for user `19e8e06a84c04f7ca4cdda7d9b19ea21`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:02.270307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e87f46d2-9527-4257-870c-78f6b3346117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:02.332861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 992/1948] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:02.337444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1964a-19e7-478f-b1d4-f7b71b464221 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:02.402394 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1964a-19e7-478f-b1d4-f7b71b464221 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:02.407088 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3ec4f-8467-4e6c-967d-1486e3e8c4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:02.407746 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3ec4f-8467-4e6c-967d-1486e3e8c4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:02.408066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3ec4f-8467-4e6c-967d-1486e3e8c4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:02.412930 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3ec4f-8467-4e6c-967d-1486e3e8c4f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:02.412930 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3ec4f-8467-4e6c-967d-1486e3e8c4f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:02.412930 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3ec4f-8467-4e6c-967d-1486e3e8c4f7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:02.504574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 957/1949] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:02 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:02.508816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f46d2-9527-4257-870c-78f6b3346117 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:02.519793 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f46d2-9527-4257-870c-78f6b3346117 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:02.578798 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297fb84-1fe4-4a66-993b-1761ea4ed3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:02.579497 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297fb84-1fe4-4a66-993b-1761ea4ed3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:02.579784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297fb84-1fe4-4a66-993b-1761ea4ed3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:02.580262 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297fb84-1fe4-4a66-993b-1761ea4ed3d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:02.580881 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297fb84-1fe4-4a66-993b-1761ea4ed3d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:02.582818 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297fb84-1fe4-4a66-993b-1761ea4ed3d7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:02.713835 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 993/1950] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:02 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:02.717843 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3ec4f-8467-4e6c-967d-1486e3e8c4f7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:02.728722 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3ec4f-8467-4e6c-967d-1486e3e8c4f7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:02.733271 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7f5d6-90b5-4478-b39c-299675077642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:02.733927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7f5d6-90b5-4478-b39c-299675077642 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:02.734215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7f5d6-90b5-4478-b39c-299675077642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:02.734821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7f5d6-90b5-4478-b39c-299675077642 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:02.735480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7f5d6-90b5-4478-b39c-299675077642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:02.738405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7f5d6-90b5-4478-b39c-299675077642 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:02.756665 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 958/1951] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:02.758881 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297fb84-1fe4-4a66-993b-1761ea4ed3d7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:02.771329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297fb84-1fe4-4a66-993b-1761ea4ed3d7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:02.777522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aac0c-44a5-40c6-8879-180d0cbd6931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:02.778737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aac0c-44a5-40c6-8879-180d0cbd6931 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:02.779030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aac0c-44a5-40c6-8879-180d0cbd6931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:02.779392 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aac0c-44a5-40c6-8879-180d0cbd6931 admin admin] PATH_INFO: `/v3/projects/c8e60ac170a64ba8ba1f151790cf8a54/users/f97fcc8d29064a848c6169152fcc58c8/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:02.798898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80aac0c-44a5-40c6-8879-180d0cbd6931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e60ac170a64ba8ba1f151790cf8a54, user_id=f97fcc8d29064a848c6169152fcc58c8, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:02.800675 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80aac0c-44a5-40c6-8879-180d0cbd6931 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:02.836102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7f5d6-90b5-4478-b39c-299675077642 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:02.837974 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f3c7f5d6-90b5-4478-b39c-299675077642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:02.851601 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7f5d6-90b5-4478-b39c-299675077642 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:02.856816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef08f07-3871-4ce8-a236-742c138a850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:02.857976 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef08f07-3871-4ce8-a236-742c138a850e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:02.858660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef08f07-3871-4ce8-a236-742c138a850e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:02.858985 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef08f07-3871-4ce8-a236-742c138a850e admin admin] PATH_INFO: `/v3/users/ddb642f0e42948e3a70d72e609f66c4e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:02.860435 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef08f07-3871-4ce8-a236-742c138a850e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb642f0e42948e3a70d72e609f66c4e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:02.863477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef08f07-3871-4ce8-a236-742c138a850e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:02.904381 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 994/1952] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:02 2022] PUT /identity/v3/projects/c8e60ac170a64ba8ba1f151790cf8a54/users/f97fcc8d29064a848c6169152fcc58c8/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:02.907497 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aac0c-44a5-40c6-8879-180d0cbd6931 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:02.969897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aac0c-44a5-40c6-8879-180d0cbd6931 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:02.975198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb54c6-7c4c-4d08-8f72-4cf1189e3a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:02.975859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb54c6-7c4c-4d08-8f72-4cf1189e3a50 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:02.976187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb54c6-7c4c-4d08-8f72-4cf1189e3a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:02.976467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb54c6-7c4c-4d08-8f72-4cf1189e3a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:02.977249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb54c6-7c4c-4d08-8f72-4cf1189e3a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:02.978853 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb54c6-7c4c-4d08-8f72-4cf1189e3a50 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:02.988991 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 995/1953] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:02.992975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb54c6-7c4c-4d08-8f72-4cf1189e3a50 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:03.002536 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb54c6-7c4c-4d08-8f72-4cf1189e3a50 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:03.007458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d926f2-63fc-40dd-8dc7-30fe28be090f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:03.008390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d926f2-63fc-40dd-8dc7-30fe28be090f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:03.008681 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d926f2-63fc-40dd-8dc7-30fe28be090f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:03.008961 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d926f2-63fc-40dd-8dc7-30fe28be090f admin admin] PATH_INFO: `/v3/projects/c8e60ac170a64ba8ba1f151790cf8a54/users/f97fcc8d29064a848c6169152fcc58c8/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:03.010966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d926f2-63fc-40dd-8dc7-30fe28be090f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e60ac170a64ba8ba1f151790cf8a54, user_id=f97fcc8d29064a848c6169152fcc58c8, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:03.013722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d926f2-63fc-40dd-8dc7-30fe28be090f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:03.024902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 996/1954] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:02 2022] PUT /identity/v3/projects/c8e60ac170a64ba8ba1f151790cf8a54/users/f97fcc8d29064a848c6169152fcc58c8/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:03.035197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec973cd-470b-49b3-a389-fe5026543c6b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:03.035498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec973cd-470b-49b3-a389-fe5026543c6b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:03.035785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec973cd-470b-49b3-a389-fe5026543c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:03.069671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4ec973cd-470b-49b3-a389-fe5026543c6b None None] MFA Rules not processed for user `f97fcc8d29064a848c6169152fcc58c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:03.072968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4ec973cd-470b-49b3-a389-fe5026543c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:03.123377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2ef08f07-3871-4ce8-a236-742c138a850e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb642f0e42948e3a70d72e609f66c4e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:03.151909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2ef08f07-3871-4ce8-a236-742c138a850e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb642f0e42948e3a70d72e609f66c4e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:03.160131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2ef08f07-3871-4ce8-a236-742c138a850e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb642f0e42948e3a70d72e609f66c4e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:03.168341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2ef08f07-3871-4ce8-a236-742c138a850e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb642f0e42948e3a70d72e609f66c4e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:03.169110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2ef08f07-3871-4ce8-a236-742c138a850e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb642f0e42948e3a70d72e609f66c4e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:03.188890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 997/1955] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:03.199827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec973cd-470b-49b3-a389-fe5026543c6b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:03.201341 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4ec973cd-470b-49b3-a389-fe5026543c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:03.257955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec973cd-470b-49b3-a389-fe5026543c6b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:03.261992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68520a9-1424-455d-89e3-3ee79d1517d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:03.262642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68520a9-1424-455d-89e3-3ee79d1517d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:03.262932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68520a9-1424-455d-89e3-3ee79d1517d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:03.263214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68520a9-1424-455d-89e3-3ee79d1517d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:03.265283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d68520a9-1424-455d-89e3-3ee79d1517d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:03.302879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 959/1956] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:02 2022] DELETE /identity/v3/users/ddb642f0e42948e3a70d72e609f66c4e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:03.306943 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd119f9-44aa-4bbe-96c0-b0fde05bc245 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:03.307238 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd119f9-44aa-4bbe-96c0-b0fde05bc245 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:03.307521 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd119f9-44aa-4bbe-96c0-b0fde05bc245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:03.326055 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ccd119f9-44aa-4bbe-96c0-b0fde05bc245 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:03.327375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ccd119f9-44aa-4bbe-96c0-b0fde05bc245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:03.333425 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68520a9-1424-455d-89e3-3ee79d1517d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:03.334861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68520a9-1424-455d-89e3-3ee79d1517d8 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:03.343609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 998/1957] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:03.386051 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:03.390002 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 960/1958] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:03.400302 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68520a9-1424-455d-89e3-3ee79d1517d8 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:03.401735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d68520a9-1424-455d-89e3-3ee79d1517d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:03.460425 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68520a9-1424-455d-89e3-3ee79d1517d8 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:03.508642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9a394-3234-4e25-bf5f-cc7ce5693282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:03.509227 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9a394-3234-4e25-bf5f-cc7ce5693282 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:03.509518 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9a394-3234-4e25-bf5f-cc7ce5693282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:03.509802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9a394-3234-4e25-bf5f-cc7ce5693282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:03.519226 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9a394-3234-4e25-bf5f-cc7ce5693282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:03.520771 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9a394-3234-4e25-bf5f-cc7ce5693282 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:03.530361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 999/1959] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:03.677565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:03.972994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd119f9-44aa-4bbe-96c0-b0fde05bc245 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:03.974595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ccd119f9-44aa-4bbe-96c0-b0fde05bc245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:03.986849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd119f9-44aa-4bbe-96c0-b0fde05bc245 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:03.991503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee40354-af7c-4068-8cde-317b38c3e9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:03.992471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40354-af7c-4068-8cde-317b38c3e9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:03.992761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40354-af7c-4068-8cde-317b38c3e9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:03.993072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40354-af7c-4068-8cde-317b38c3e9ef admin admin] PATH_INFO: `/v3/projects/34b8d682c2c0445c8cee830614bc8722` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:03.994445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee40354-af7c-4068-8cde-317b38c3e9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b8d682c2c0445c8cee830614bc8722)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:03.996462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee40354-af7c-4068-8cde-317b38c3e9ef admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:04.119605 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0ee40354-af7c-4068-8cde-317b38c3e9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b8d682c2c0445c8cee830614bc8722', 'request_id': 'req-0ee40354-af7c-4068-8cde-317b38c3e9ef'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:04.125253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0ee40354-af7c-4068-8cde-317b38c3e9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b8d682c2c0445c8cee830614bc8722', 'request_id': 'req-0ee40354-af7c-4068-8cde-317b38c3e9ef'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:04.220287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0ee40354-af7c-4068-8cde-317b38c3e9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b8d682c2c0445c8cee830614bc8722', 'request_id': 'req-0ee40354-af7c-4068-8cde-317b38c3e9ef'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:04.220546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:04.243027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0ee40354-af7c-4068-8cde-317b38c3e9ef admin admin] The token cache is being invalidate because project 34b8d682c2c0445c8cee830614bc8722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:04.243334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0ee40354-af7c-4068-8cde-317b38c3e9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:04.244094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0ee40354-af7c-4068-8cde-317b38c3e9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:04.245794 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 961/1960] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:03 2022] DELETE /identity/v3/projects/34b8d682c2c0445c8cee830614bc8722 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:04.249746 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9a394-3234-4e25-bf5f-cc7ce5693282 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:04.260686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9a394-3234-4e25-bf5f-cc7ce5693282 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:04.335055 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684fc93-525f-4d8a-85d0-76de01babbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:04.336081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684fc93-525f-4d8a-85d0-76de01babbdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:04.336441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684fc93-525f-4d8a-85d0-76de01babbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:04.336795 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684fc93-525f-4d8a-85d0-76de01babbdc admin admin] PATH_INFO: `/v3/users/dcfe686b9cbd465c9cc23dd45ee55fb5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:04.338186 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684fc93-525f-4d8a-85d0-76de01babbdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcfe686b9cbd465c9cc23dd45ee55fb5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:04.340310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684fc93-525f-4d8a-85d0-76de01babbdc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:04.600246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0684fc93-525f-4d8a-85d0-76de01babbdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcfe686b9cbd465c9cc23dd45ee55fb5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:04.601128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0684fc93-525f-4d8a-85d0-76de01babbdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcfe686b9cbd465c9cc23dd45ee55fb5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:04.662377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee40354-af7c-4068-8cde-317b38c3e9ef admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:04.663792 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0ee40354-af7c-4068-8cde-317b38c3e9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:04.679022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0684fc93-525f-4d8a-85d0-76de01babbdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcfe686b9cbd465c9cc23dd45ee55fb5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:04.686722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0684fc93-525f-4d8a-85d0-76de01babbdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcfe686b9cbd465c9cc23dd45ee55fb5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:04.687468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0684fc93-525f-4d8a-85d0-76de01babbdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcfe686b9cbd465c9cc23dd45ee55fb5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:04.706033 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1000/1961] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:04 2022] DELETE /identity/v3/users/dcfe686b9cbd465c9cc23dd45ee55fb5 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:04.719718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee40354-af7c-4068-8cde-317b38c3e9ef admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:04.773228 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983f44c-0568-4ebc-bfbc-13744761da80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:04.773880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983f44c-0568-4ebc-bfbc-13744761da80 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:04.774166 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983f44c-0568-4ebc-bfbc-13744761da80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:04.774724 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983f44c-0568-4ebc-bfbc-13744761da80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:04.776591 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9983f44c-0568-4ebc-bfbc-13744761da80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:04.838249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983f44c-0568-4ebc-bfbc-13744761da80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:04.839685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983f44c-0568-4ebc-bfbc-13744761da80 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:04.849420 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 962/1962] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:04 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:05.203112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684fc93-525f-4d8a-85d0-76de01babbdc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:05.204618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0684fc93-525f-4d8a-85d0-76de01babbdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:05.274096 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684fc93-525f-4d8a-85d0-76de01babbdc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:05.279033 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7613130-59ad-4d96-b45f-bed64c8c7b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:05.283854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7613130-59ad-4d96-b45f-bed64c8c7b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:05.283854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7613130-59ad-4d96-b45f-bed64c8c7b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:05.283854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7613130-59ad-4d96-b45f-bed64c8c7b95 admin admin] PATH_INFO: `/v3/projects/9e47fda2dc8b400f9a5b87e3fc946ae8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:05.283854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7613130-59ad-4d96-b45f-bed64c8c7b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e47fda2dc8b400f9a5b87e3fc946ae8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:05.283854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7613130-59ad-4d96-b45f-bed64c8c7b95 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:05.420322 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7613130-59ad-4d96-b45f-bed64c8c7b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e47fda2dc8b400f9a5b87e3fc946ae8', 'request_id': 'req-e7613130-59ad-4d96-b45f-bed64c8c7b95'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:05.513522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7613130-59ad-4d96-b45f-bed64c8c7b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e47fda2dc8b400f9a5b87e3fc946ae8', 'request_id': 'req-e7613130-59ad-4d96-b45f-bed64c8c7b95'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:05.522334 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7613130-59ad-4d96-b45f-bed64c8c7b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e47fda2dc8b400f9a5b87e3fc946ae8', 'request_id': 'req-e7613130-59ad-4d96-b45f-bed64c8c7b95'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:05.533032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7613130-59ad-4d96-b45f-bed64c8c7b95 admin admin] The token cache is being invalidate because project 9e47fda2dc8b400f9a5b87e3fc946ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:05.533325 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7613130-59ad-4d96-b45f-bed64c8c7b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:05.534012 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7613130-59ad-4d96-b45f-bed64c8c7b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:05.535828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1001/1963] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:05 2022] DELETE /identity/v3/projects/9e47fda2dc8b400f9a5b87e3fc946ae8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:05.540428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cfa82-baf6-4472-a18e-49ea3c73d441 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:05.540720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cfa82-baf6-4472-a18e-49ea3c73d441 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:05.541004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cfa82-baf6-4472-a18e-49ea3c73d441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:05.558730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f48cfa82-baf6-4472-a18e-49ea3c73d441 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:05.560015 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f48cfa82-baf6-4472-a18e-49ea3c73d441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:05.619004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 963/1964] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:05.627037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b6d14-1589-495d-96d1-3ee52777da77 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:05.627346 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b6d14-1589-495d-96d1-3ee52777da77 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:05.628339 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b6d14-1589-495d-96d1-3ee52777da77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:05.648366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-260b6d14-1589-495d-96d1-3ee52777da77 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:05.649602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-260b6d14-1589-495d-96d1-3ee52777da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:05.658925 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1002/1965] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:05.663707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cfa82-baf6-4472-a18e-49ea3c73d441 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:05.673825 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cfa82-baf6-4472-a18e-49ea3c73d441 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:05.679125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc04bf-d463-411d-a7ed-2da8a6d488de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:05.679788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc04bf-d463-411d-a7ed-2da8a6d488de admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:05.682201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc04bf-d463-411d-a7ed-2da8a6d488de admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:05.682201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc04bf-d463-411d-a7ed-2da8a6d488de admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:05.682201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc04bf-d463-411d-a7ed-2da8a6d488de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:05.682201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc04bf-d463-411d-a7ed-2da8a6d488de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:05.683086 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc04bf-d463-411d-a7ed-2da8a6d488de admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:05.696498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 964/1966] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:05.700642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b6d14-1589-495d-96d1-3ee52777da77 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:05.710084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b6d14-1589-495d-96d1-3ee52777da77 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:05.715069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1ab48-c4eb-4bbd-b1bf-5f0bb205d12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:05.715724 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1ab48-c4eb-4bbd-b1bf-5f0bb205d12a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:05.716030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1ab48-c4eb-4bbd-b1bf-5f0bb205d12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:05.716354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1ab48-c4eb-4bbd-b1bf-5f0bb205d12a admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:05.717274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1ab48-c4eb-4bbd-b1bf-5f0bb205d12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:05.719159 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1ab48-c4eb-4bbd-b1bf-5f0bb205d12a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:05.825051 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1003/1967] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:05 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:05.828323 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc04bf-d463-411d-a7ed-2da8a6d488de admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:05.839145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc04bf-d463-411d-a7ed-2da8a6d488de admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:05.894885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1c7b9-90d0-4b55-96ad-b2fb268adc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:05.895610 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1c7b9-90d0-4b55-96ad-b2fb268adc63 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:05.895899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1c7b9-90d0-4b55-96ad-b2fb268adc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:05.896211 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1c7b9-90d0-4b55-96ad-b2fb268adc63 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:05.896899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1c7b9-90d0-4b55-96ad-b2fb268adc63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:05.898839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1c7b9-90d0-4b55-96ad-b2fb268adc63 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:06.099455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 965/1968] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:05 2022] POST /identity/v3/users => generated 294 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:06.103509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1ab48-c4eb-4bbd-b1bf-5f0bb205d12a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:06.115415 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1ab48-c4eb-4bbd-b1bf-5f0bb205d12a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:06.120975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0880b0-5884-4a7f-a102-7f62b45d8018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:06.122219 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0880b0-5884-4a7f-a102-7f62b45d8018 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:06.122512 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0880b0-5884-4a7f-a102-7f62b45d8018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:06.122820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0880b0-5884-4a7f-a102-7f62b45d8018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:06.123688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0880b0-5884-4a7f-a102-7f62b45d8018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:06.125370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0880b0-5884-4a7f-a102-7f62b45d8018 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:06.139334 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1004/1969] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:06.140832 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1c7b9-90d0-4b55-96ad-b2fb268adc63 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:06.151779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1c7b9-90d0-4b55-96ad-b2fb268adc63 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:06.156691 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b57497-5e4c-4a43-b5e0-f226bb6fa8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:06.157454 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57497-5e4c-4a43-b5e0-f226bb6fa8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:06.157802 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57497-5e4c-4a43-b5e0-f226bb6fa8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:06.158153 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57497-5e4c-4a43-b5e0-f226bb6fa8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:06.159464 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b57497-5e4c-4a43-b5e0-f226bb6fa8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:06.161146 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b57497-5e4c-4a43-b5e0-f226bb6fa8f9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:06.171936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 966/1970] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:06.176180 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0880b0-5884-4a7f-a102-7f62b45d8018 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:06.186632 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0880b0-5884-4a7f-a102-7f62b45d8018 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:06.191492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72599876-c62d-4d8b-980c-ea2a36d2b1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:06.192423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72599876-c62d-4d8b-980c-ea2a36d2b1e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:06.192718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72599876-c62d-4d8b-980c-ea2a36d2b1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:06.193005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72599876-c62d-4d8b-980c-ea2a36d2b1e6 admin admin] PATH_INFO: `/v3/projects/c58a8d3d5f1848738a3378c7cc2522c2/users/6df6c598e60644f38ee97ce6817fb6f3/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:06.211060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72599876-c62d-4d8b-980c-ea2a36d2b1e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58a8d3d5f1848738a3378c7cc2522c2, user_id=6df6c598e60644f38ee97ce6817fb6f3, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:06.214073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72599876-c62d-4d8b-980c-ea2a36d2b1e6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:06.352522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1005/1971] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:06 2022] PUT /identity/v3/projects/c58a8d3d5f1848738a3378c7cc2522c2/users/6df6c598e60644f38ee97ce6817fb6f3/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:06.362882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cf2bb-8366-4776-a73d-a95d9436c334 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:06.363173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cf2bb-8366-4776-a73d-a95d9436c334 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:06.363465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cf2bb-8366-4776-a73d-a95d9436c334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:06.389930 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e07cf2bb-8366-4776-a73d-a95d9436c334 None None] MFA Rules not processed for user `6df6c598e60644f38ee97ce6817fb6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:06.391075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e07cf2bb-8366-4776-a73d-a95d9436c334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:06.466693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 967/1972] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:06.471406 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72599876-c62d-4d8b-980c-ea2a36d2b1e6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:06.533823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72599876-c62d-4d8b-980c-ea2a36d2b1e6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:06.541758 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb058e33-1d3b-4756-89a8-e54ffe268112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:06.542573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb058e33-1d3b-4756-89a8-e54ffe268112 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:06.542976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb058e33-1d3b-4756-89a8-e54ffe268112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:06.543133 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb058e33-1d3b-4756-89a8-e54ffe268112 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:06.543891 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb058e33-1d3b-4756-89a8-e54ffe268112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:06.545829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb058e33-1d3b-4756-89a8-e54ffe268112 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:06.692732 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1006/1973] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:06 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:06.696694 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:06.701177 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cf2bb-8366-4776-a73d-a95d9436c334 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:06.712341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cf2bb-8366-4776-a73d-a95d9436c334 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:06.770156 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb27120-c230-46e4-8a2d-2c3cf9e0a468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:06.770824 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb27120-c230-46e4-8a2d-2c3cf9e0a468 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:06.771114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb27120-c230-46e4-8a2d-2c3cf9e0a468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:06.771398 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb27120-c230-46e4-8a2d-2c3cf9e0a468 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:06.772159 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb27120-c230-46e4-8a2d-2c3cf9e0a468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:06.774078 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb27120-c230-46e4-8a2d-2c3cf9e0a468 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:06.866769 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 968/1974] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:06 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:06.870760 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb058e33-1d3b-4756-89a8-e54ffe268112 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:06.882313 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb058e33-1d3b-4756-89a8-e54ffe268112 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:06.887269 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf25f31-8aac-443f-898d-568120941aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:06.887948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf25f31-8aac-443f-898d-568120941aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:06.888267 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf25f31-8aac-443f-898d-568120941aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:06.888553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf25f31-8aac-443f-898d-568120941aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:06.889282 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf25f31-8aac-443f-898d-568120941aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:06.891212 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf25f31-8aac-443f-898d-568120941aa3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:06.903519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1007/1975] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:06.907350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb27120-c230-46e4-8a2d-2c3cf9e0a468 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:06.918620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb27120-c230-46e4-8a2d-2c3cf9e0a468 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:06.923393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc43a81-c207-4983-965c-a219074e7602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:06.924102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc43a81-c207-4983-965c-a219074e7602 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:06.924920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc43a81-c207-4983-965c-a219074e7602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:06.925204 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc43a81-c207-4983-965c-a219074e7602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:06.925932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc43a81-c207-4983-965c-a219074e7602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:06.927530 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc43a81-c207-4983-965c-a219074e7602 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:06.937900 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 969/1976] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:06.942826 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf25f31-8aac-443f-898d-568120941aa3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:06.952939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf25f31-8aac-443f-898d-568120941aa3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:06.957873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4114b-0fcb-427b-a238-6049a6583a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:06.958771 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4114b-0fcb-427b-a238-6049a6583a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:06.959061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4114b-0fcb-427b-a238-6049a6583a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:06.959348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4114b-0fcb-427b-a238-6049a6583a22 admin admin] PATH_INFO: `/v3/projects/ebd441af6ca8483b9bfd2b0a85233a56/users/34fa2d97a44940628acb22fcbbee46bf/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:06.973846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4114b-0fcb-427b-a238-6049a6583a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd441af6ca8483b9bfd2b0a85233a56, user_id=34fa2d97a44940628acb22fcbbee46bf, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:06.976547 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4114b-0fcb-427b-a238-6049a6583a22 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:07.056774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1008/1977] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:06 2022] PUT /identity/v3/projects/ebd441af6ca8483b9bfd2b0a85233a56/users/34fa2d97a44940628acb22fcbbee46bf/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:07.068267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3ff6-6e0a-43eb-8bd2-c9e643b33311 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:07.068573 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3ff6-6e0a-43eb-8bd2-c9e643b33311 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:07.068863 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3ff6-6e0a-43eb-8bd2-c9e643b33311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:07.095249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-befb3ff6-6e0a-43eb-8bd2-c9e643b33311 None None] MFA Rules not processed for user `34fa2d97a44940628acb22fcbbee46bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:07.096499 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-befb3ff6-6e0a-43eb-8bd2-c9e643b33311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:07.160396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 970/1978] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:07.164613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4114b-0fcb-427b-a238-6049a6583a22 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:07.171814 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3ff6-6e0a-43eb-8bd2-c9e643b33311 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:07.173256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-befb3ff6-6e0a-43eb-8bd2-c9e643b33311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:07.237557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4114b-0fcb-427b-a238-6049a6583a22 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:07.242395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0d26d-a8b5-4ec6-8b03-04f0e551d3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:07.243058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0d26d-a8b5-4ec6-8b03-04f0e551d3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:07.243347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0d26d-a8b5-4ec6-8b03-04f0e551d3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:07.243633 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0d26d-a8b5-4ec6-8b03-04f0e551d3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:07.244394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0d26d-a8b5-4ec6-8b03-04f0e551d3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:07.246295 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0d26d-a8b5-4ec6-8b03-04f0e551d3c4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:07.251167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3ff6-6e0a-43eb-8bd2-c9e643b33311 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:07.256005 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31026aad-c22d-497d-8d30-13b504357243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:07.256906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026aad-c22d-497d-8d30-13b504357243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:07.257175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026aad-c22d-497d-8d30-13b504357243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:07.257450 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31026aad-c22d-497d-8d30-13b504357243 admin admin] PATH_INFO: `/v3/users/19e8e06a84c04f7ca4cdda7d9b19ea21` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:07.258684 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31026aad-c22d-497d-8d30-13b504357243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e8e06a84c04f7ca4cdda7d9b19ea21)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:07.260678 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31026aad-c22d-497d-8d30-13b504357243 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:07.296300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:07.378791 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1009/1979] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:07 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:07.381753 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0d26d-a8b5-4ec6-8b03-04f0e551d3c4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:07.441927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0d26d-a8b5-4ec6-8b03-04f0e551d3c4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:07.446840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecc189-43b0-44ba-ac4a-8ca4614f95e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:07.447506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecc189-43b0-44ba-ac4a-8ca4614f95e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:07.447801 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecc189-43b0-44ba-ac4a-8ca4614f95e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:07.448127 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecc189-43b0-44ba-ac4a-8ca4614f95e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:07.448859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecc189-43b0-44ba-ac4a-8ca4614f95e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:07.450777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecc189-43b0-44ba-ac4a-8ca4614f95e7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:07.511006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-31026aad-c22d-497d-8d30-13b504357243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e8e06a84c04f7ca4cdda7d9b19ea21'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.523806 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-31026aad-c22d-497d-8d30-13b504357243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e8e06a84c04f7ca4cdda7d9b19ea21'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.524725 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-31026aad-c22d-497d-8d30-13b504357243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e8e06a84c04f7ca4cdda7d9b19ea21'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.532352 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-31026aad-c22d-497d-8d30-13b504357243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e8e06a84c04f7ca4cdda7d9b19ea21'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.533207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-31026aad-c22d-497d-8d30-13b504357243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e8e06a84c04f7ca4cdda7d9b19ea21'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:07.563393 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1010/1980] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:07 2022] POST /identity/v3/users => generated 299 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:07.564458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecc189-43b0-44ba-ac4a-8ca4614f95e7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:07.566572 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-03ecc189-43b0-44ba-ac4a-8ca4614f95e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:07.578374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecc189-43b0-44ba-ac4a-8ca4614f95e7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:07.583627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb3d60-1f0b-4973-964d-e57a86010bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:07.584305 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb3d60-1f0b-4973-964d-e57a86010bbb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:07.584593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb3d60-1f0b-4973-964d-e57a86010bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:07.584872 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb3d60-1f0b-4973-964d-e57a86010bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:07.585594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb3d60-1f0b-4973-964d-e57a86010bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:07.587194 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb3d60-1f0b-4973-964d-e57a86010bbb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:07.597184 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1011/1981] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:07.601222 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb3d60-1f0b-4973-964d-e57a86010bbb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:07.610487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb3d60-1f0b-4973-964d-e57a86010bbb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:07.615573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d60c70-bdd5-4fe6-b38b-84e6586d2043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:07.616453 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d60c70-bdd5-4fe6-b38b-84e6586d2043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:07.616738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d60c70-bdd5-4fe6-b38b-84e6586d2043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:07.617018 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d60c70-bdd5-4fe6-b38b-84e6586d2043 admin admin] PATH_INFO: `/v3/projects/5d059e7028244f81a2edc6a9d2d24b4e/users/df1f4c2b1b1a4f37ace6b7c9301bd525/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:07.631553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d60c70-bdd5-4fe6-b38b-84e6586d2043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d059e7028244f81a2edc6a9d2d24b4e, user_id=df1f4c2b1b1a4f37ace6b7c9301bd525, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:07.634211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d60c70-bdd5-4fe6-b38b-84e6586d2043 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:07.661700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 971/1982] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:07 2022] DELETE /identity/v3/users/19e8e06a84c04f7ca4cdda7d9b19ea21 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:07.672789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9147a6c-4c96-4d37-b2dc-45bd31b1841d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:07.672789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9147a6c-4c96-4d37-b2dc-45bd31b1841d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:07.672789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9147a6c-4c96-4d37-b2dc-45bd31b1841d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:07.683292 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a9147a6c-4c96-4d37-b2dc-45bd31b1841d None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:07.684577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a9147a6c-4c96-4d37-b2dc-45bd31b1841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:07.746305 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 972/1983] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:07.756710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9147a6c-4c96-4d37-b2dc-45bd31b1841d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:07.758076 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a9147a6c-4c96-4d37-b2dc-45bd31b1841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:07.771318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1012/1984] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:07 2022] PUT /identity/v3/projects/5d059e7028244f81a2edc6a9d2d24b4e/users/df1f4c2b1b1a4f37ace6b7c9301bd525/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:07.775391 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d60c70-bdd5-4fe6-b38b-84e6586d2043 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:07.855020 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9147a6c-4c96-4d37-b2dc-45bd31b1841d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:07.891055 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d60c70-bdd5-4fe6-b38b-84e6586d2043 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:07.908751 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff6281-f010-444e-83a3-2922c6a5296a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:07.909558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff6281-f010-444e-83a3-2922c6a5296a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:07.910878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff6281-f010-444e-83a3-2922c6a5296a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:07.912960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff6281-f010-444e-83a3-2922c6a5296a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:07.913840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff6281-f010-444e-83a3-2922c6a5296a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:07.918511 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff6281-f010-444e-83a3-2922c6a5296a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:07.946647 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a4248-ce10-45da-b373-e9694e843903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:07.947370 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a4248-ce10-45da-b373-e9694e843903 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:07.947972 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a4248-ce10-45da-b373-e9694e843903 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:07.948278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a4248-ce10-45da-b373-e9694e843903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:07.952809 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1013/1985] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:07.960528 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff6281-f010-444e-83a3-2922c6a5296a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:07.968377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a4248-ce10-45da-b373-e9694e843903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:07.971797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a4248-ce10-45da-b373-e9694e843903 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:07.974318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff6281-f010-444e-83a3-2922c6a5296a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:07.986188 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e20726-3973-4bde-bc30-d1ac80ceb464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:07.991369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e20726-3973-4bde-bc30-d1ac80ceb464 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:07.991369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e20726-3973-4bde-bc30-d1ac80ceb464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:07.991369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e20726-3973-4bde-bc30-d1ac80ceb464 admin admin] PATH_INFO: `/v3/projects/5d059e7028244f81a2edc6a9d2d24b4e/users/df1f4c2b1b1a4f37ace6b7c9301bd525/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:07.991369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e20726-3973-4bde-bc30-d1ac80ceb464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d059e7028244f81a2edc6a9d2d24b4e, user_id=df1f4c2b1b1a4f37ace6b7c9301bd525, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:07.995167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e20726-3973-4bde-bc30-d1ac80ceb464 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:07.996054 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 973/1986] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:08.004382 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1014/1987] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:07 2022] PUT /identity/v3/projects/5d059e7028244f81a2edc6a9d2d24b4e/users/df1f4c2b1b1a4f37ace6b7c9301bd525/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:08.015118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c01a4-4fca-4018-98e6-9a14da260238 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:08.015410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c01a4-4fca-4018-98e6-9a14da260238 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:08.020272 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c01a4-4fca-4018-98e6-9a14da260238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:08.054572 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4c6c01a4-4fca-4018-98e6-9a14da260238 None None] MFA Rules not processed for user `df1f4c2b1b1a4f37ace6b7c9301bd525`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:08.054572 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4c6c01a4-4fca-4018-98e6-9a14da260238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:08.127635 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 974/1988] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:08.138396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e20726-3973-4bde-bc30-d1ac80ceb464 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:08.140452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c1e20726-3973-4bde-bc30-d1ac80ceb464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:08.197591 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e20726-3973-4bde-bc30-d1ac80ceb464 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:08.201190 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dfba3-e426-47b1-9289-dd549991021c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:08.201837 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dfba3-e426-47b1-9289-dd549991021c service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:08.202129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dfba3-e426-47b1-9289-dd549991021c service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:08.202700 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dfba3-e426-47b1-9289-dd549991021c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:08.211866 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64dfba3-e426-47b1-9289-dd549991021c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:08.213412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64dfba3-e426-47b1-9289-dd549991021c service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:08.223465 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1015/1989] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:08.524880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c01a4-4fca-4018-98e6-9a14da260238 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:08.526358 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4c6c01a4-4fca-4018-98e6-9a14da260238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:08.609671 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c01a4-4fca-4018-98e6-9a14da260238 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:08.615272 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe848bdf-2919-4c5b-a205-eb96947dec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:08.616890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe848bdf-2919-4c5b-a205-eb96947dec0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:08.617191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe848bdf-2919-4c5b-a205-eb96947dec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:08.617571 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe848bdf-2919-4c5b-a205-eb96947dec0d admin admin] PATH_INFO: `/v3/projects/87c95570f9fd4cd0919e559cc1cc027e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:08.619278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe848bdf-2919-4c5b-a205-eb96947dec0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c95570f9fd4cd0919e559cc1cc027e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:08.622248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe848bdf-2919-4c5b-a205-eb96947dec0d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:08.787172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fe848bdf-2919-4c5b-a205-eb96947dec0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c95570f9fd4cd0919e559cc1cc027e', 'request_id': 'req-fe848bdf-2919-4c5b-a205-eb96947dec0d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.792849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fe848bdf-2919-4c5b-a205-eb96947dec0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c95570f9fd4cd0919e559cc1cc027e', 'request_id': 'req-fe848bdf-2919-4c5b-a205-eb96947dec0d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.897288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fe848bdf-2919-4c5b-a205-eb96947dec0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c95570f9fd4cd0919e559cc1cc027e', 'request_id': 'req-fe848bdf-2919-4c5b-a205-eb96947dec0d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.910258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fe848bdf-2919-4c5b-a205-eb96947dec0d admin admin] The token cache is being invalidate because project 87c95570f9fd4cd0919e559cc1cc027e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:08.910629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fe848bdf-2919-4c5b-a205-eb96947dec0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.918172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fe848bdf-2919-4c5b-a205-eb96947dec0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:08.918172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 975/1990] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:08 2022] DELETE /identity/v3/projects/87c95570f9fd4cd0919e559cc1cc027e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:08.918401 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dfba3-e426-47b1-9289-dd549991021c service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:08.928846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dfba3-e426-47b1-9289-dd549991021c service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:08.998575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34735e14-6080-4b2e-8fa3-62b396516cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:08.999518 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34735e14-6080-4b2e-8fa3-62b396516cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:09.000038 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34735e14-6080-4b2e-8fa3-62b396516cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:09.000389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34735e14-6080-4b2e-8fa3-62b396516cf5 admin admin] PATH_INFO: `/v3/users/f97fcc8d29064a848c6169152fcc58c8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:09.001682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34735e14-6080-4b2e-8fa3-62b396516cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f97fcc8d29064a848c6169152fcc58c8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:09.004618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34735e14-6080-4b2e-8fa3-62b396516cf5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:09.104603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe848bdf-2919-4c5b-a205-eb96947dec0d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:09.104603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fe848bdf-2919-4c5b-a205-eb96947dec0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:09.121763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe848bdf-2919-4c5b-a205-eb96947dec0d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:09.126736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8526892-2b4b-4cea-8545-29f954365a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:09.128497 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8526892-2b4b-4cea-8545-29f954365a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:09.129008 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8526892-2b4b-4cea-8545-29f954365a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:09.129546 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8526892-2b4b-4cea-8545-29f954365a35 admin admin] PATH_INFO: `/v3/users/117adabb6a27473e9e9ee68efb45a067` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:09.130985 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8526892-2b4b-4cea-8545-29f954365a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=117adabb6a27473e9e9ee68efb45a067)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:09.133176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8526892-2b4b-4cea-8545-29f954365a35 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:09.248199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:09.413880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-34735e14-6080-4b2e-8fa3-62b396516cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f97fcc8d29064a848c6169152fcc58c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.414704 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-34735e14-6080-4b2e-8fa3-62b396516cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f97fcc8d29064a848c6169152fcc58c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.442960 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e8526892-2b4b-4cea-8545-29f954365a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '117adabb6a27473e9e9ee68efb45a067'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.454962 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e8526892-2b4b-4cea-8545-29f954365a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '117adabb6a27473e9e9ee68efb45a067'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.455681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e8526892-2b4b-4cea-8545-29f954365a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '117adabb6a27473e9e9ee68efb45a067'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.462487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e8526892-2b4b-4cea-8545-29f954365a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '117adabb6a27473e9e9ee68efb45a067'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.463114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e8526892-2b4b-4cea-8545-29f954365a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '117adabb6a27473e9e9ee68efb45a067'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.576901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:09.577730 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-34735e14-6080-4b2e-8fa3-62b396516cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f97fcc8d29064a848c6169152fcc58c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.587036 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-34735e14-6080-4b2e-8fa3-62b396516cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f97fcc8d29064a848c6169152fcc58c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.588176 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-34735e14-6080-4b2e-8fa3-62b396516cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f97fcc8d29064a848c6169152fcc58c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:09.614485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1016/1991] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:08 2022] DELETE /identity/v3/users/f97fcc8d29064a848c6169152fcc58c8 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:09.704908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 976/1992] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:09 2022] DELETE /identity/v3/users/117adabb6a27473e9e9ee68efb45a067 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:09.709708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aff16-2cae-4e08-9876-48589b23af21 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:09.710001 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aff16-2cae-4e08-9876-48589b23af21 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:09.710295 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874aff16-2cae-4e08-9876-48589b23af21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:09.736084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-874aff16-2cae-4e08-9876-48589b23af21 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:09.737372 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-874aff16-2cae-4e08-9876-48589b23af21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:09.760684 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8526892-2b4b-4cea-8545-29f954365a35 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:09.762090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e8526892-2b4b-4cea-8545-29f954365a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:09.798081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1017/1993] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:09.807691 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874aff16-2cae-4e08-9876-48589b23af21 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:09.809653 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-874aff16-2cae-4e08-9876-48589b23af21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:09.820412 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8526892-2b4b-4cea-8545-29f954365a35 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:09.824279 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf332453-07de-440c-8f90-026e17dbc987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:09.824934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf332453-07de-440c-8f90-026e17dbc987 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:09.825221 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf332453-07de-440c-8f90-026e17dbc987 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:09.825505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf332453-07de-440c-8f90-026e17dbc987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:09.827326 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cf332453-07de-440c-8f90-026e17dbc987 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:09.892442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874aff16-2cae-4e08-9876-48589b23af21 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:09.896565 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6767d85-4e6c-4f4e-9dc8-18d8a6e1be9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:09.897369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6767d85-4e6c-4f4e-9dc8-18d8a6e1be9a service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:09.897757 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6767d85-4e6c-4f4e-9dc8-18d8a6e1be9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:09.898390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6767d85-4e6c-4f4e-9dc8-18d8a6e1be9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:09.901704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf332453-07de-440c-8f90-026e17dbc987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:09.903441 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf332453-07de-440c-8f90-026e17dbc987 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:09.909984 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6767d85-4e6c-4f4e-9dc8-18d8a6e1be9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:09.911924 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6767d85-4e6c-4f4e-9dc8-18d8a6e1be9a service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:09.916155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 977/1994] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:09.923544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1018/1995] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:10.185536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf332453-07de-440c-8f90-026e17dbc987 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:10.187149 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cf332453-07de-440c-8f90-026e17dbc987 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:10.204335 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf332453-07de-440c-8f90-026e17dbc987 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:10.210150 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efb0ce-f630-4aed-a112-108f2677c1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:10.211139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efb0ce-f630-4aed-a112-108f2677c1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:10.211485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efb0ce-f630-4aed-a112-108f2677c1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:10.215751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efb0ce-f630-4aed-a112-108f2677c1a4 admin admin] PATH_INFO: `/v3/projects/c8e60ac170a64ba8ba1f151790cf8a54` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:10.215751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efb0ce-f630-4aed-a112-108f2677c1a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e60ac170a64ba8ba1f151790cf8a54)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:10.215751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efb0ce-f630-4aed-a112-108f2677c1a4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:10.404786 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-84efb0ce-f630-4aed-a112-108f2677c1a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e60ac170a64ba8ba1f151790cf8a54', 'request_id': 'req-84efb0ce-f630-4aed-a112-108f2677c1a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.419834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-84efb0ce-f630-4aed-a112-108f2677c1a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e60ac170a64ba8ba1f151790cf8a54', 'request_id': 'req-84efb0ce-f630-4aed-a112-108f2677c1a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.587694 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-84efb0ce-f630-4aed-a112-108f2677c1a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e60ac170a64ba8ba1f151790cf8a54', 'request_id': 'req-84efb0ce-f630-4aed-a112-108f2677c1a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.594880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6767d85-4e6c-4f4e-9dc8-18d8a6e1be9a service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:10.596697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b6767d85-4e6c-4f4e-9dc8-18d8a6e1be9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:10.604350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-84efb0ce-f630-4aed-a112-108f2677c1a4 admin admin] The token cache is being invalidate because project c8e60ac170a64ba8ba1f151790cf8a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:10.604868 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-84efb0ce-f630-4aed-a112-108f2677c1a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.607229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-84efb0ce-f630-4aed-a112-108f2677c1a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.609181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 978/1996] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:10 2022] DELETE /identity/v3/projects/c8e60ac170a64ba8ba1f151790cf8a54 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:10.615337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcfc7b-a579-4b78-ac26-608c7133c4c8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:10.615830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcfc7b-a579-4b78-ac26-608c7133c4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:10.616665 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcfc7b-a579-4b78-ac26-608c7133c4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:10.616789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6767d85-4e6c-4f4e-9dc8-18d8a6e1be9a service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:10.649782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a4fcfc7b-a579-4b78-ac26-608c7133c4c8 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:10.650996 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a4fcfc7b-a579-4b78-ac26-608c7133c4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:10.682893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d60f1-2ccd-46c7-adee-caf7cd155625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:10.683613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d60f1-2ccd-46c7-adee-caf7cd155625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:10.683828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d60f1-2ccd-46c7-adee-caf7cd155625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:10.684151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d60f1-2ccd-46c7-adee-caf7cd155625 admin admin] PATH_INFO: `/v3/projects/ec4df6d9184b486885283b1e0d19dd17` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:10.686658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d60f1-2ccd-46c7-adee-caf7cd155625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec4df6d9184b486885283b1e0d19dd17)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:10.689249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d60f1-2ccd-46c7-adee-caf7cd155625 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:10.721843 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 979/1997] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:10.729042 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404bd8d-ec36-47d8-a25c-a1c09c32974a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:10.729528 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404bd8d-ec36-47d8-a25c-a1c09c32974a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:10.729983 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404bd8d-ec36-47d8-a25c-a1c09c32974a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:10.755847 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c404bd8d-ec36-47d8-a25c-a1c09c32974a None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:10.756039 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c404bd8d-ec36-47d8-a25c-a1c09c32974a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:10.764882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 980/1998] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:10.769322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404bd8d-ec36-47d8-a25c-a1c09c32974a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:10.778749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404bd8d-ec36-47d8-a25c-a1c09c32974a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:10.783520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b5f3b-c009-4a37-9206-ce83e663bc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:10.784204 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b5f3b-c009-4a37-9206-ce83e663bc28 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:10.784494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b5f3b-c009-4a37-9206-ce83e663bc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:10.784778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b5f3b-c009-4a37-9206-ce83e663bc28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:10.786576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b5f3b-c009-4a37-9206-ce83e663bc28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:10.786576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b5f3b-c009-4a37-9206-ce83e663bc28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:10.787634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b5f3b-c009-4a37-9206-ce83e663bc28 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:10.799979 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 981/1999] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 16:07:10.804195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b5f3b-c009-4a37-9206-ce83e663bc28 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:10.813798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b5f3b-c009-4a37-9206-ce83e663bc28 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:10.828091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ea2d60f1-2ccd-46c7-adee-caf7cd155625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec4df6d9184b486885283b1e0d19dd17', 'request_id': 'req-ea2d60f1-2ccd-46c7-adee-caf7cd155625'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.882638 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ef86f-3738-40f1-9178-2e600d16e2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:10.883241 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ef86f-3738-40f1-9178-2e600d16e2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:10.883556 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ef86f-3738-40f1-9178-2e600d16e2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:10.883839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ef86f-3738-40f1-9178-2e600d16e2e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:10.884587 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ef86f-3738-40f1-9178-2e600d16e2e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:10.886618 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ef86f-3738-40f1-9178-2e600d16e2e5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:10.937251 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ea2d60f1-2ccd-46c7-adee-caf7cd155625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec4df6d9184b486885283b1e0d19dd17', 'request_id': 'req-ea2d60f1-2ccd-46c7-adee-caf7cd155625'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.945134 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ea2d60f1-2ccd-46c7-adee-caf7cd155625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec4df6d9184b486885283b1e0d19dd17', 'request_id': 'req-ea2d60f1-2ccd-46c7-adee-caf7cd155625'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.957373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ea2d60f1-2ccd-46c7-adee-caf7cd155625 admin admin] The token cache is being invalidate because project ec4df6d9184b486885283b1e0d19dd17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:10.957670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ea2d60f1-2ccd-46c7-adee-caf7cd155625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.963880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ea2d60f1-2ccd-46c7-adee-caf7cd155625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:10.963880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1019/2000] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:10 2022] DELETE /identity/v3/projects/ec4df6d9184b486885283b1e0d19dd17 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:10.965693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3c3a3-e48f-4066-8512-4d11ad6ae65c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:10.966183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3c3a3-e48f-4066-8512-4d11ad6ae65c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:10.966755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3c3a3-e48f-4066-8512-4d11ad6ae65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:10.988913 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e2e3c3a3-e48f-4066-8512-4d11ad6ae65c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:10.990147 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e2e3c3a3-e48f-4066-8512-4d11ad6ae65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:10.999193 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1020/2001] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:11.004577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 982/2002] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:10 2022] POST /identity/v3/projects => generated 371 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:11.012937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3c3a3-e48f-4066-8512-4d11ad6ae65c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.013176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97c6b7-e2c2-4ec0-8df4-2eec06f43f2e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.013574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97c6b7-e2c2-4ec0-8df4-2eec06f43f2e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.013956 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97c6b7-e2c2-4ec0-8df4-2eec06f43f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.014242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e2e3c3a3-e48f-4066-8512-4d11ad6ae65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:11.027569 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3c3a3-e48f-4066-8512-4d11ad6ae65c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.035174 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6e97c6b7-e2c2-4ec0-8df4-2eec06f43f2e None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:11.036428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6e97c6b7-e2c2-4ec0-8df4-2eec06f43f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:11.084186 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a61737-c569-471b-a018-8bd1772ca381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.084874 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a61737-c569-471b-a018-8bd1772ca381 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.085178 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a61737-c569-471b-a018-8bd1772ca381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.085442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a61737-c569-471b-a018-8bd1772ca381 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.086318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a61737-c569-471b-a018-8bd1772ca381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.088271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a61737-c569-471b-a018-8bd1772ca381 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.098937 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 983/2003] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:11.103047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97c6b7-e2c2-4ec0-8df4-2eec06f43f2e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.112503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97c6b7-e2c2-4ec0-8df4-2eec06f43f2e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.117426 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a13d3-1386-485a-a0f7-8c408f90254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.124010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a13d3-1386-485a-a0f7-8c408f90254d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.124010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a13d3-1386-485a-a0f7-8c408f90254d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.124010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a13d3-1386-485a-a0f7-8c408f90254d admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.124010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a13d3-1386-485a-a0f7-8c408f90254d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:11.124010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a13d3-1386-485a-a0f7-8c408f90254d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.124010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a13d3-1386-485a-a0f7-8c408f90254d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.133201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 984/2004] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 16:07:11.137143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a13d3-1386-485a-a0f7-8c408f90254d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.146821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a13d3-1386-485a-a0f7-8c408f90254d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.151350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1e149-e60f-4f97-9502-c1640ff547b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.152080 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1e149-e60f-4f97-9502-c1640ff547b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.152375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1e149-e60f-4f97-9502-c1640ff547b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.152663 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1e149-e60f-4f97-9502-c1640ff547b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.153370 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1e149-e60f-4f97-9502-c1640ff547b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.155240 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1e149-e60f-4f97-9502-c1640ff547b7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.187729 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1021/2005] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:11 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:11.191737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a61737-c569-471b-a018-8bd1772ca381 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.201032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a61737-c569-471b-a018-8bd1772ca381 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.205913 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84142c-4281-40cf-a39e-0cf0155c3018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.206546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84142c-4281-40cf-a39e-0cf0155c3018 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.206856 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84142c-4281-40cf-a39e-0cf0155c3018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.207135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84142c-4281-40cf-a39e-0cf0155c3018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.207850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84142c-4281-40cf-a39e-0cf0155c3018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.209468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84142c-4281-40cf-a39e-0cf0155c3018 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.219100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1022/2006] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:11.229037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84142c-4281-40cf-a39e-0cf0155c3018 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.238863 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84142c-4281-40cf-a39e-0cf0155c3018 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.243400 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b1744-dd3a-4b2d-85cf-0290801df3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.244044 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b1744-dd3a-4b2d-85cf-0290801df3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.244332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b1744-dd3a-4b2d-85cf-0290801df3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.244612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b1744-dd3a-4b2d-85cf-0290801df3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.245332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b1744-dd3a-4b2d-85cf-0290801df3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.246877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b1744-dd3a-4b2d-85cf-0290801df3f3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.257901 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1023/2007] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:11.261926 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b1744-dd3a-4b2d-85cf-0290801df3f3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.271530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b1744-dd3a-4b2d-85cf-0290801df3f3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.276120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bcfa0-90cb-4f43-a94a-a20c824a9ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.276968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bcfa0-90cb-4f43-a94a-a20c824a9ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.277280 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bcfa0-90cb-4f43-a94a-a20c824a9ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.277557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bcfa0-90cb-4f43-a94a-a20c824a9ecf admin admin] PATH_INFO: `/v3/projects/db0ab8a7ac7548be9f23595ef70245a6/users/beaa2d0578ea4f77b3b4aadd14ac1be9/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.292032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bcfa0-90cb-4f43-a94a-a20c824a9ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0ab8a7ac7548be9f23595ef70245a6, user_id=beaa2d0578ea4f77b3b4aadd14ac1be9, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.294715 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bcfa0-90cb-4f43-a94a-a20c824a9ecf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.303770 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 985/2008] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:11 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:11.308273 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1e149-e60f-4f97-9502-c1640ff547b7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.331701 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:11.374340 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1e149-e60f-4f97-9502-c1640ff547b7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.379265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a5700-1153-4f95-8573-bff8d4787562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.381396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a5700-1153-4f95-8573-bff8d4787562 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.381396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a5700-1153-4f95-8573-bff8d4787562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.381396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a5700-1153-4f95-8573-bff8d4787562 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.381396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a5700-1153-4f95-8573-bff8d4787562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.384363 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a5700-1153-4f95-8573-bff8d4787562 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.404992 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1024/2009] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:11 2022] PUT /identity/v3/projects/db0ab8a7ac7548be9f23595ef70245a6/users/beaa2d0578ea4f77b3b4aadd14ac1be9/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:11.416991 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd7a53-da9d-4491-a88c-1bf3ef70ce43 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.417283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd7a53-da9d-4491-a88c-1bf3ef70ce43 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.417565 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd7a53-da9d-4491-a88c-1bf3ef70ce43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.443764 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8dbd7a53-da9d-4491-a88c-1bf3ef70ce43 None None] MFA Rules not processed for user `beaa2d0578ea4f77b3b4aadd14ac1be9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:11.445085 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8dbd7a53-da9d-4491-a88c-1bf3ef70ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:11.516430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1025/2010] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:11.528876 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd7a53-da9d-4491-a88c-1bf3ef70ce43 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.530285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8dbd7a53-da9d-4491-a88c-1bf3ef70ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:11.534275 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 986/2011] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:11 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:11.541347 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a5700-1153-4f95-8573-bff8d4787562 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.551393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a5700-1153-4f95-8573-bff8d4787562 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.592157 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd7a53-da9d-4491-a88c-1bf3ef70ce43 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.596810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa067a-f1d5-4ba6-b4c7-2aea0b080b61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5157588644972a6a4554b3a9f1d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.597534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa067a-f1d5-4ba6-b4c7-2aea0b080b61 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.597880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa067a-f1d5-4ba6-b4c7-2aea0b080b61 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.598223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa067a-f1d5-4ba6-b4c7-2aea0b080b61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.607476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa067a-f1d5-4ba6-b4c7-2aea0b080b61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.609060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa067a-f1d5-4ba6-b4c7-2aea0b080b61 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.609564 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4993670-9b46-427f-bc02-72b0cb9c8bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.610249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4993670-9b46-427f-bc02-72b0cb9c8bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.610526 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4993670-9b46-427f-bc02-72b0cb9c8bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.611045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4993670-9b46-427f-bc02-72b0cb9c8bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.611813 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4993670-9b46-427f-bc02-72b0cb9c8bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.613526 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4993670-9b46-427f-bc02-72b0cb9c8bc9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.623602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1026/2012] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:11.631380 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 987/2013] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:11.639070 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa067a-f1d5-4ba6-b4c7-2aea0b080b61 service glance] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.652222 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa067a-f1d5-4ba6-b4c7-2aea0b080b61 service glance] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.656866 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb7ac7-18a3-4e3b-9558-c8c37315016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.657538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb7ac7-18a3-4e3b-9558-c8c37315016b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.657825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb7ac7-18a3-4e3b-9558-c8c37315016b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.658105 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb7ac7-18a3-4e3b-9558-c8c37315016b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.659397 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb7ac7-18a3-4e3b-9558-c8c37315016b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.661192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb7ac7-18a3-4e3b-9558-c8c37315016b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.676789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1027/2014] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:11.678131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4993670-9b46-427f-bc02-72b0cb9c8bc9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:11.690850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4993670-9b46-427f-bc02-72b0cb9c8bc9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:11.699081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a002a3f-2503-4922-b9e0-160ab31e43a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:11.700329 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a002a3f-2503-4922-b9e0-160ab31e43a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.700660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a002a3f-2503-4922-b9e0-160ab31e43a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.701024 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a002a3f-2503-4922-b9e0-160ab31e43a4 admin admin] PATH_INFO: `/v3/projects/ec18e153db54449781eb12175405b701/users/d2a94775cc0b4052b9c8ec0c499e7a1b/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.718686 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a002a3f-2503-4922-b9e0-160ab31e43a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec18e153db54449781eb12175405b701, user_id=d2a94775cc0b4052b9c8ec0c499e7a1b, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:11.721399 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a002a3f-2503-4922-b9e0-160ab31e43a4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:11.891027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 988/2015] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:11 2022] PUT /identity/v3/projects/ec18e153db54449781eb12175405b701/users/d2a94775cc0b4052b9c8ec0c499e7a1b/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:11.906708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b9270-a321-4c7e-9987-44e317db194e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:11.907001 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b9270-a321-4c7e-9987-44e317db194e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:11.907287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b9270-a321-4c7e-9987-44e317db194e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:11.935238 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8e5b9270-a321-4c7e-9987-44e317db194e None None] MFA Rules not processed for user `d2a94775cc0b4052b9c8ec0c499e7a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:11.936518 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8e5b9270-a321-4c7e-9987-44e317db194e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:11.998216 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1028/2016] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:12.009559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a002a3f-2503-4922-b9e0-160ab31e43a4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:12.011333 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4a002a3f-2503-4922-b9e0-160ab31e43a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:12.105795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a002a3f-2503-4922-b9e0-160ab31e43a4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:12.111839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e294677-595f-4bf5-8166-7ab8803d55ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:12.112578 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e294677-595f-4bf5-8166-7ab8803d55ee service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:12.112867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e294677-595f-4bf5-8166-7ab8803d55ee service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:12.113148 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e294677-595f-4bf5-8166-7ab8803d55ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:12.121819 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e294677-595f-4bf5-8166-7ab8803d55ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:12.128381 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e294677-595f-4bf5-8166-7ab8803d55ee service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:12.132342 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 989/2017] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:12.734988 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:12.833851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b9270-a321-4c7e-9987-44e317db194e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:12.844322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e294677-595f-4bf5-8166-7ab8803d55ee service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:12.846164 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2e294677-595f-4bf5-8166-7ab8803d55ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:12.899702 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b9270-a321-4c7e-9987-44e317db194e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:12.904264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec96cb7-a63e-4c0b-9dd7-62097f953002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:12.905206 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec96cb7-a63e-4c0b-9dd7-62097f953002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:12.905633 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec96cb7-a63e-4c0b-9dd7-62097f953002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:12.905920 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec96cb7-a63e-4c0b-9dd7-62097f953002 admin admin] PATH_INFO: `/v3/users/d2a94775cc0b4052b9c8ec0c499e7a1b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:12.907100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec96cb7-a63e-4c0b-9dd7-62097f953002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2a94775cc0b4052b9c8ec0c499e7a1b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:12.909140 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec96cb7-a63e-4c0b-9dd7-62097f953002 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:12.914253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e294677-595f-4bf5-8166-7ab8803d55ee service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:12.919511 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eac5c8-4bcf-43f0-a455-c027c8e3dc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:12.922101 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eac5c8-4bcf-43f0-a455-c027c8e3dc25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:12.922101 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eac5c8-4bcf-43f0-a455-c027c8e3dc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:12.922101 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eac5c8-4bcf-43f0-a455-c027c8e3dc25 admin admin] PATH_INFO: `/v3/users/39d83a4f35944487b40406a9fbe542c1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:12.922459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eac5c8-4bcf-43f0-a455-c027c8e3dc25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d83a4f35944487b40406a9fbe542c1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:12.925104 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eac5c8-4bcf-43f0-a455-c027c8e3dc25 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:13.168265 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9ec96cb7-a63e-4c0b-9dd7-62097f953002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2a94775cc0b4052b9c8ec0c499e7a1b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:13.169030 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-72eac5c8-4bcf-43f0-a455-c027c8e3dc25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d83a4f35944487b40406a9fbe542c1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:13.169212 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9ec96cb7-a63e-4c0b-9dd7-62097f953002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2a94775cc0b4052b9c8ec0c499e7a1b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:13.181894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-72eac5c8-4bcf-43f0-a455-c027c8e3dc25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d83a4f35944487b40406a9fbe542c1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:13.182595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-72eac5c8-4bcf-43f0-a455-c027c8e3dc25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d83a4f35944487b40406a9fbe542c1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:13.189827 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-72eac5c8-4bcf-43f0-a455-c027c8e3dc25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d83a4f35944487b40406a9fbe542c1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:13.197136 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-72eac5c8-4bcf-43f0-a455-c027c8e3dc25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d83a4f35944487b40406a9fbe542c1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:13.295727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9ec96cb7-a63e-4c0b-9dd7-62097f953002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2a94775cc0b4052b9c8ec0c499e7a1b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:13.304005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9ec96cb7-a63e-4c0b-9dd7-62097f953002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2a94775cc0b4052b9c8ec0c499e7a1b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:13.304764 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9ec96cb7-a63e-4c0b-9dd7-62097f953002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2a94775cc0b4052b9c8ec0c499e7a1b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:13.322475 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1029/2018] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:12 2022] DELETE /identity/v3/users/d2a94775cc0b4052b9c8ec0c499e7a1b => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:13.328039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64540b4-e6ad-45f9-aa97-bf0647246234 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:13.328039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64540b4-e6ad-45f9-aa97-bf0647246234 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:13.328039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64540b4-e6ad-45f9-aa97-bf0647246234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:13.345799 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b64540b4-e6ad-45f9-aa97-bf0647246234 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:13.346948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b64540b4-e6ad-45f9-aa97-bf0647246234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:13.407210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 990/2019] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:12 2022] DELETE /identity/v3/users/39d83a4f35944487b40406a9fbe542c1 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:13.411365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9529f-5ccf-4974-aef6-44b6e0d2fd91 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:13.411790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9529f-5ccf-4974-aef6-44b6e0d2fd91 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:13.412280 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9529f-5ccf-4974-aef6-44b6e0d2fd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:13.425290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1030/2020] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:13.437272 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64540b4-e6ad-45f9-aa97-bf0647246234 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:13.439054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b64540b4-e6ad-45f9-aa97-bf0647246234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:13.443173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dda9529f-5ccf-4974-aef6-44b6e0d2fd91 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:13.444396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dda9529f-5ccf-4974-aef6-44b6e0d2fd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:13.499590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64540b4-e6ad-45f9-aa97-bf0647246234 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:13.508388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 991/2021] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:13.519361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9529f-5ccf-4974-aef6-44b6e0d2fd91 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:13.556900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405bcdc-5296-46d2-a5ec-3788d89635c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:13.556900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405bcdc-5296-46d2-a5ec-3788d89635c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:13.557143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405bcdc-5296-46d2-a5ec-3788d89635c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:13.557439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405bcdc-5296-46d2-a5ec-3788d89635c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:13.568029 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405bcdc-5296-46d2-a5ec-3788d89635c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:13.570158 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405bcdc-5296-46d2-a5ec-3788d89635c1 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:13.581186 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1031/2022] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:13.592648 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9529f-5ccf-4974-aef6-44b6e0d2fd91 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:13.597006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9ff24-fca8-4f94-ab3d-1f4472c53ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:13.597831 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9ff24-fca8-4f94-ab3d-1f4472c53ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:13.598132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9ff24-fca8-4f94-ab3d-1f4472c53ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:13.598481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9ff24-fca8-4f94-ab3d-1f4472c53ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:13.609183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9ff24-fca8-4f94-ab3d-1f4472c53ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:13.614070 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9ff24-fca8-4f94-ab3d-1f4472c53ac3 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:13.623053 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 992/2023] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:13.765755 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:14.238083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:14.534608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405bcdc-5296-46d2-a5ec-3788d89635c1 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:14.536196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e405bcdc-5296-46d2-a5ec-3788d89635c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:14.543557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9ff24-fca8-4f94-ab3d-1f4472c53ac3 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:14.545068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6ae9ff24-fca8-4f94-ab3d-1f4472c53ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:14.563768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405bcdc-5296-46d2-a5ec-3788d89635c1 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:14.564268 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9ff24-fca8-4f94-ab3d-1f4472c53ac3 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:14.564358 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:14.564658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:14.565279 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:14.565844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46 admin admin] PATH_INFO: `/v3/projects/869bb6ccefea4f39a75ced267692df26` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:14.568469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=869bb6ccefea4f39a75ced267692df26)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:14.570713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:14.575507 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30543832-00c2-4444-8640-14ad58bdf28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:14.576418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30543832-00c2-4444-8640-14ad58bdf28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:14.576705 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30543832-00c2-4444-8640-14ad58bdf28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:14.576984 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30543832-00c2-4444-8640-14ad58bdf28e admin admin] PATH_INFO: `/v3/projects/ec18e153db54449781eb12175405b701` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:14.578347 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30543832-00c2-4444-8640-14ad58bdf28e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec18e153db54449781eb12175405b701)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:14.581007 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30543832-00c2-4444-8640-14ad58bdf28e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:14.740336 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869bb6ccefea4f39a75ced267692df26', 'request_id': 'req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:14.743480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30543832-00c2-4444-8640-14ad58bdf28e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec18e153db54449781eb12175405b701', 'request_id': 'req-30543832-00c2-4444-8640-14ad58bdf28e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:14.749743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30543832-00c2-4444-8640-14ad58bdf28e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec18e153db54449781eb12175405b701', 'request_id': 'req-30543832-00c2-4444-8640-14ad58bdf28e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:14.851634 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869bb6ccefea4f39a75ced267692df26', 'request_id': 'req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:14.860742 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869bb6ccefea4f39a75ced267692df26', 'request_id': 'req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:14.872396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46 admin admin] The token cache is being invalidate because project 869bb6ccefea4f39a75ced267692df26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:14.872689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:14.873341 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:14.875089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1032/2024] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:14 2022] DELETE /identity/v3/projects/869bb6ccefea4f39a75ced267692df26 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:14.878806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:14.880567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:14.948885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b6339-8d8e-4670-8ea0-eb34e8cf7f46 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:14.962401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30543832-00c2-4444-8640-14ad58bdf28e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec18e153db54449781eb12175405b701', 'request_id': 'req-30543832-00c2-4444-8640-14ad58bdf28e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:14.978563 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30543832-00c2-4444-8640-14ad58bdf28e admin admin] The token cache is being invalidate because project ec18e153db54449781eb12175405b701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:14.979752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30543832-00c2-4444-8640-14ad58bdf28e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:14.980587 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30543832-00c2-4444-8640-14ad58bdf28e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:14.983673 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 993/2025] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:14 2022] DELETE /identity/v3/projects/ec18e153db54449781eb12175405b701 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:14.987357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51abea4-c7e8-45cf-b814-4e78054757f2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:14.987748 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51abea4-c7e8-45cf-b814-4e78054757f2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:14.988174 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51abea4-c7e8-45cf-b814-4e78054757f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:15.009005 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b51abea4-c7e8-45cf-b814-4e78054757f2 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:15.010334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b51abea4-c7e8-45cf-b814-4e78054757f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:15.019116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeeffc8-d093-44af-9cbe-e98482045340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:15.020035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeeffc8-d093-44af-9cbe-e98482045340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:15.020332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeeffc8-d093-44af-9cbe-e98482045340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:15.020676 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeeffc8-d093-44af-9cbe-e98482045340 admin admin] PATH_INFO: `/v3/users/876d320c6bb04cea908ed9b1294b20ef` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:15.022111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeeffc8-d093-44af-9cbe-e98482045340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=876d320c6bb04cea908ed9b1294b20ef)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:15.024235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeeffc8-d093-44af-9cbe-e98482045340 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:15.092662 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 994/2026] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:15.097542 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d8f59-4492-4164-81da-25ce5b08c4a8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:15.097964 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d8f59-4492-4164-81da-25ce5b08c4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:15.098252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d8f59-4492-4164-81da-25ce5b08c4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:15.116843 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-039d8f59-4492-4164-81da-25ce5b08c4a8 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:15.118201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-039d8f59-4492-4164-81da-25ce5b08c4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:15.127818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 995/2027] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:15.131775 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d8f59-4492-4164-81da-25ce5b08c4a8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:15.142938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d8f59-4492-4164-81da-25ce5b08c4a8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:15.147762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd37db9-a7fd-4391-870b-0b5ea991f87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:15.148468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd37db9-a7fd-4391-870b-0b5ea991f87b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:15.148754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd37db9-a7fd-4391-870b-0b5ea991f87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:15.149050 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd37db9-a7fd-4391-870b-0b5ea991f87b admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:15.149959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd37db9-a7fd-4391-870b-0b5ea991f87b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:15.150443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd37db9-a7fd-4391-870b-0b5ea991f87b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:15.152287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd37db9-a7fd-4391-870b-0b5ea991f87b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:15.166316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 996/2028] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:15.168513 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd37db9-a7fd-4391-870b-0b5ea991f87b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:15.178708 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd37db9-a7fd-4391-870b-0b5ea991f87b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:15.183461 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954682f-ea37-4ed5-8528-bc51530d02be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:15.184261 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954682f-ea37-4ed5-8528-bc51530d02be admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:15.184425 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954682f-ea37-4ed5-8528-bc51530d02be admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:15.184706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954682f-ea37-4ed5-8528-bc51530d02be admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:15.185391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954682f-ea37-4ed5-8528-bc51530d02be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:15.187311 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954682f-ea37-4ed5-8528-bc51530d02be admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:15.407016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 997/2029] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:15 2022] POST /identity/v3/projects => generated 399 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:15.411040 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954682f-ea37-4ed5-8528-bc51530d02be admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:15.414901 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6eeeffc8-d093-44af-9cbe-e98482045340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876d320c6bb04cea908ed9b1294b20ef'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:15.415550 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6eeeffc8-d093-44af-9cbe-e98482045340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876d320c6bb04cea908ed9b1294b20ef'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:15.476675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954682f-ea37-4ed5-8528-bc51530d02be admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:15.481823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244a30b-d646-4af5-b835-b2250da1a530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:15.482496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244a30b-d646-4af5-b835-b2250da1a530 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:15.482822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244a30b-d646-4af5-b835-b2250da1a530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:15.483111 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244a30b-d646-4af5-b835-b2250da1a530 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:15.483861 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244a30b-d646-4af5-b835-b2250da1a530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:15.485774 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244a30b-d646-4af5-b835-b2250da1a530 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:15.530111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6eeeffc8-d093-44af-9cbe-e98482045340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876d320c6bb04cea908ed9b1294b20ef'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:15.538558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6eeeffc8-d093-44af-9cbe-e98482045340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876d320c6bb04cea908ed9b1294b20ef'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:15.539233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6eeeffc8-d093-44af-9cbe-e98482045340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876d320c6bb04cea908ed9b1294b20ef'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:15.557398 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1033/2030] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:14 2022] DELETE /identity/v3/users/876d320c6bb04cea908ed9b1294b20ef => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:15.610690 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 998/2031] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:15 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:15.615231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeeffc8-d093-44af-9cbe-e98482045340 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:15.617116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6eeeffc8-d093-44af-9cbe-e98482045340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:15.683241 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeeffc8-d093-44af-9cbe-e98482045340 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:15.687809 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d6bc6-662f-446a-bf01-73d8cb5e97b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:15.688513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d6bc6-662f-446a-bf01-73d8cb5e97b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:15.688803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d6bc6-662f-446a-bf01-73d8cb5e97b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:15.689087 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d6bc6-662f-446a-bf01-73d8cb5e97b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:15.689821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d6bc6-662f-446a-bf01-73d8cb5e97b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:15.691429 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d6bc6-662f-446a-bf01-73d8cb5e97b1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:15.701705 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1034/2032] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:15.705823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244a30b-d646-4af5-b835-b2250da1a530 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:15.716350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244a30b-d646-4af5-b835-b2250da1a530 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:15.721716 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211aeda-18a7-45a3-83da-c52216d4b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:15.722387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211aeda-18a7-45a3-83da-c52216d4b6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:15.722721 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211aeda-18a7-45a3-83da-c52216d4b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:15.723108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211aeda-18a7-45a3-83da-c52216d4b6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:15.723835 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211aeda-18a7-45a3-83da-c52216d4b6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:15.725919 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211aeda-18a7-45a3-83da-c52216d4b6d0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:15.737435 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 999/2033] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:15.742286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d6bc6-662f-446a-bf01-73d8cb5e97b1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:15.752937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d6bc6-662f-446a-bf01-73d8cb5e97b1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:15.759879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c9bc3-275c-4bef-9848-daaa3216736f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:15.760827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9bc3-275c-4bef-9848-daaa3216736f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:15.761118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9bc3-275c-4bef-9848-daaa3216736f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:15.761439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c9bc3-275c-4bef-9848-daaa3216736f admin admin] PATH_INFO: `/v3/projects/c6f761733454497fb707af985a983010/users/f70f4f48871444ef8f8a84e9dcd2330b/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:15.786498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c9bc3-275c-4bef-9848-daaa3216736f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f761733454497fb707af985a983010, user_id=f70f4f48871444ef8f8a84e9dcd2330b, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:15.790180 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c9bc3-275c-4bef-9848-daaa3216736f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:15.922856 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1035/2034] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:15 2022] PUT /identity/v3/projects/c6f761733454497fb707af985a983010/users/f70f4f48871444ef8f8a84e9dcd2330b/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:15.937757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1b430-1907-41b5-9e9c-4a2ef4a13441 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:15.938300 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1b430-1907-41b5-9e9c-4a2ef4a13441 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:15.938592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1b430-1907-41b5-9e9c-4a2ef4a13441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:15.987536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0bb1b430-1907-41b5-9e9c-4a2ef4a13441 None None] MFA Rules not processed for user `f70f4f48871444ef8f8a84e9dcd2330b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:15.988907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0bb1b430-1907-41b5-9e9c-4a2ef4a13441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:16.053487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1000/2035] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:16.058256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c9bc3-275c-4bef-9848-daaa3216736f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:16.086538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1b430-1907-41b5-9e9c-4a2ef4a13441 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:16.088217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0bb1b430-1907-41b5-9e9c-4a2ef4a13441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:16.142322 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c9bc3-275c-4bef-9848-daaa3216736f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:16.148529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32b4fc-628b-4b66-9e4a-c814f2159ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:16.149292 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32b4fc-628b-4b66-9e4a-c814f2159ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:16.149715 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32b4fc-628b-4b66-9e4a-c814f2159ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:16.150185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32b4fc-628b-4b66-9e4a-c814f2159ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:16.151051 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32b4fc-628b-4b66-9e4a-c814f2159ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:16.153017 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32b4fc-628b-4b66-9e4a-c814f2159ca5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:16.172346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1b430-1907-41b5-9e9c-4a2ef4a13441 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:16.178068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e9b78-25a0-40c3-a331-21f4917dbff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:16.178957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e9b78-25a0-40c3-a331-21f4917dbff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:16.179246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e9b78-25a0-40c3-a331-21f4917dbff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:16.179532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e9b78-25a0-40c3-a331-21f4917dbff1 admin admin] PATH_INFO: `/v3/projects/2d3f8488daf344ebb446a3c97911cac0` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:16.180748 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e9b78-25a0-40c3-a331-21f4917dbff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d3f8488daf344ebb446a3c97911cac0)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:16.182679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e9b78-25a0-40c3-a331-21f4917dbff1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:16.323820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1036/2036] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:16 2022] POST /identity/v3/projects => generated 399 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:16.324765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32b4fc-628b-4b66-9e4a-c814f2159ca5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:16.326401 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fa32b4fc-628b-4b66-9e4a-c814f2159ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:16.383970 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32b4fc-628b-4b66-9e4a-c814f2159ca5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:16.389075 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5280bb4-1eaf-46db-9069-411e26115acd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:16.390116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5280bb4-1eaf-46db-9069-411e26115acd service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:16.390543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5280bb4-1eaf-46db-9069-411e26115acd service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:16.390978 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5280bb4-1eaf-46db-9069-411e26115acd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:16.393439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a5280bb4-1eaf-46db-9069-411e26115acd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:16.405838 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-755e9b78-25a0-40c3-a331-21f4917dbff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d3f8488daf344ebb446a3c97911cac0', 'request_id': 'req-755e9b78-25a0-40c3-a331-21f4917dbff1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:16.413763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-755e9b78-25a0-40c3-a331-21f4917dbff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d3f8488daf344ebb446a3c97911cac0', 'request_id': 'req-755e9b78-25a0-40c3-a331-21f4917dbff1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:16.457419 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5280bb4-1eaf-46db-9069-411e26115acd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:16.458789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5280bb4-1eaf-46db-9069-411e26115acd service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:16.467767 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1037/2037] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:16.468575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5280bb4-1eaf-46db-9069-411e26115acd service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:16.529115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-755e9b78-25a0-40c3-a331-21f4917dbff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d3f8488daf344ebb446a3c97911cac0', 'request_id': 'req-755e9b78-25a0-40c3-a331-21f4917dbff1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:16.534871 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5280bb4-1eaf-46db-9069-411e26115acd service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:16.549377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-755e9b78-25a0-40c3-a331-21f4917dbff1 admin admin] The token cache is being invalidate because project 2d3f8488daf344ebb446a3c97911cac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:16.549823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-755e9b78-25a0-40c3-a331-21f4917dbff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:16.550618 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-755e9b78-25a0-40c3-a331-21f4917dbff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:16.552728 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1001/2038] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:16 2022] DELETE /identity/v3/projects/2d3f8488daf344ebb446a3c97911cac0 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:16.557685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc788c50-2c31-435f-bf3e-c3528d555c0e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:16.557976 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc788c50-2c31-435f-bf3e-c3528d555c0e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:16.558269 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc788c50-2c31-435f-bf3e-c3528d555c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:16.581382 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cc788c50-2c31-435f-bf3e-c3528d555c0e None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:16.582733 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cc788c50-2c31-435f-bf3e-c3528d555c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:16.598663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613cfb5-42d4-462f-9167-9656c868a17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:16.599350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613cfb5-42d4-462f-9167-9656c868a17d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:16.603784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613cfb5-42d4-462f-9167-9656c868a17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:16.603784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613cfb5-42d4-462f-9167-9656c868a17d admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:16.603784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613cfb5-42d4-462f-9167-9656c868a17d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:16.603784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613cfb5-42d4-462f-9167-9656c868a17d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:16.646489 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1002/2039] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:16.653948 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dac895-175e-4351-941c-0d8cb26ca7a7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:16.654244 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dac895-175e-4351-941c-0d8cb26ca7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:16.654633 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dac895-175e-4351-941c-0d8cb26ca7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:16.674607 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-44dac895-175e-4351-941c-0d8cb26ca7a7 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:16.675898 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-44dac895-175e-4351-941c-0d8cb26ca7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:16.684000 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1003/2040] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:16.688030 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dac895-175e-4351-941c-0d8cb26ca7a7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:16.697783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dac895-175e-4351-941c-0d8cb26ca7a7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:16.702503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab70d4a-5818-4fa3-a14f-4d4edc7f8900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:16.703167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab70d4a-5818-4fa3-a14f-4d4edc7f8900 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:16.703453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab70d4a-5818-4fa3-a14f-4d4edc7f8900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:16.703733 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab70d4a-5818-4fa3-a14f-4d4edc7f8900 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:16.704488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab70d4a-5818-4fa3-a14f-4d4edc7f8900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:16.704804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab70d4a-5818-4fa3-a14f-4d4edc7f8900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:16.706940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab70d4a-5818-4fa3-a14f-4d4edc7f8900 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:16.726573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1038/2042] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:16 2022] POST /identity/v3/users => generated 306 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:16.726784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1004/2041] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 16:07:16.728403 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab70d4a-5818-4fa3-a14f-4d4edc7f8900 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:16.729025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613cfb5-42d4-462f-9167-9656c868a17d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:16.731803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9613cfb5-42d4-462f-9167-9656c868a17d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:16.740652 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab70d4a-5818-4fa3-a14f-4d4edc7f8900 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:16.746195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1046fe7-9fb6-4fd0-a9a1-b76244a4019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:16.747060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1046fe7-9fb6-4fd0-a9a1-b76244a4019f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:16.747349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1046fe7-9fb6-4fd0-a9a1-b76244a4019f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:16.747628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1046fe7-9fb6-4fd0-a9a1-b76244a4019f admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:16.748248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613cfb5-42d4-462f-9167-9656c868a17d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:16.748373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1046fe7-9fb6-4fd0-a9a1-b76244a4019f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:16.750299 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1046fe7-9fb6-4fd0-a9a1-b76244a4019f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:16.754249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cd7ae-cc91-4642-ba26-304c144e6bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:16.758880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cd7ae-cc91-4642-ba26-304c144e6bfb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:16.758880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cd7ae-cc91-4642-ba26-304c144e6bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:16.758880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cd7ae-cc91-4642-ba26-304c144e6bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:16.758880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4cd7ae-cc91-4642-ba26-304c144e6bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:16.758880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4cd7ae-cc91-4642-ba26-304c144e6bfb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:16.775890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1039/2043] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:16.778769 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cd7ae-cc91-4642-ba26-304c144e6bfb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:16.790717 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cd7ae-cc91-4642-ba26-304c144e6bfb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:16.795389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476bf3c-7cae-448e-a201-5679a2078dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:16.798877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476bf3c-7cae-448e-a201-5679a2078dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:16.798877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476bf3c-7cae-448e-a201-5679a2078dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:16.798877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476bf3c-7cae-448e-a201-5679a2078dd0 admin admin] PATH_INFO: `/v3/projects/768be626452348499e6dbe66d62efd69/users/2fd39c7bebfd48d4aed87f6088ba86fe/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:16.812084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476bf3c-7cae-448e-a201-5679a2078dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=768be626452348499e6dbe66d62efd69, user_id=2fd39c7bebfd48d4aed87f6088ba86fe, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:16.814743 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476bf3c-7cae-448e-a201-5679a2078dd0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:16.869337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1005/2044] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:16 2022] POST /identity/v3/projects => generated 355 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:16.873465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1046fe7-9fb6-4fd0-a9a1-b76244a4019f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:16.912413 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:16.918060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1040/2045] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:16 2022] PUT /identity/v3/projects/768be626452348499e6dbe66d62efd69/users/2fd39c7bebfd48d4aed87f6088ba86fe/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:16.922783 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476bf3c-7cae-448e-a201-5679a2078dd0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:16.940354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1046fe7-9fb6-4fd0-a9a1-b76244a4019f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:16.985473 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476bf3c-7cae-448e-a201-5679a2078dd0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:16.990320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af39bef-4dd8-4f9b-b3c9-52a1246429f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:16.991003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af39bef-4dd8-4f9b-b3c9-52a1246429f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:16.991294 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af39bef-4dd8-4f9b-b3c9-52a1246429f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:16.991703 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af39bef-4dd8-4f9b-b3c9-52a1246429f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:16.992470 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af39bef-4dd8-4f9b-b3c9-52a1246429f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:16.994161 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af39bef-4dd8-4f9b-b3c9-52a1246429f8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:17.001134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedabf12-bb30-4d38-8f17-c6dc2e9865c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:17.003299 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedabf12-bb30-4d38-8f17-c6dc2e9865c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:17.004075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedabf12-bb30-4d38-8f17-c6dc2e9865c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:17.004563 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedabf12-bb30-4d38-8f17-c6dc2e9865c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:17.005446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1041/2046] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:17.005711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedabf12-bb30-4d38-8f17-c6dc2e9865c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:17.007918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedabf12-bb30-4d38-8f17-c6dc2e9865c0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:17.010102 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af39bef-4dd8-4f9b-b3c9-52a1246429f8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:17.024299 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af39bef-4dd8-4f9b-b3c9-52a1246429f8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:17.029122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a11652-c3fe-4c28-bba6-9c322435510a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:17.030098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a11652-c3fe-4c28-bba6-9c322435510a admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:17.030385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a11652-c3fe-4c28-bba6-9c322435510a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:17.030665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a11652-c3fe-4c28-bba6-9c322435510a admin admin] PATH_INFO: `/v3/projects/768be626452348499e6dbe66d62efd69/users/2fd39c7bebfd48d4aed87f6088ba86fe/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:17.032799 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a11652-c3fe-4c28-bba6-9c322435510a admin admin] RBAC: Authorizing `identity:create_grant(project_id=768be626452348499e6dbe66d62efd69, user_id=2fd39c7bebfd48d4aed87f6088ba86fe, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:17.037434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a11652-c3fe-4c28-bba6-9c322435510a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:17.058755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1042/2047] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:17 2022] PUT /identity/v3/projects/768be626452348499e6dbe66d62efd69/users/2fd39c7bebfd48d4aed87f6088ba86fe/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:17.061571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92296d3-8b05-4828-bb9d-27398964d547 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:17.061869 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92296d3-8b05-4828-bb9d-27398964d547 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:17.062178 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92296d3-8b05-4828-bb9d-27398964d547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:17.095526 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c92296d3-8b05-4828-bb9d-27398964d547 None None] MFA Rules not processed for user `2fd39c7bebfd48d4aed87f6088ba86fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:17.096896 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c92296d3-8b05-4828-bb9d-27398964d547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:17.128835 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1006/2048] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:16 2022] POST /identity/v3/users => generated 278 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:17.130058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedabf12-bb30-4d38-8f17-c6dc2e9865c0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:17.140773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedabf12-bb30-4d38-8f17-c6dc2e9865c0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:17.174619 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1043/2049] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:17 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:17.198288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bf2c1-52b0-463f-bb86-2a4d99349adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:17.198962 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bf2c1-52b0-463f-bb86-2a4d99349adc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:17.199252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bf2c1-52b0-463f-bb86-2a4d99349adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:17.199535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bf2c1-52b0-463f-bb86-2a4d99349adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:17.200285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bf2c1-52b0-463f-bb86-2a4d99349adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:17.201918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bf2c1-52b0-463f-bb86-2a4d99349adc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:17.212589 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1007/2050] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:17.216565 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92296d3-8b05-4828-bb9d-27398964d547 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:17.226719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92296d3-8b05-4828-bb9d-27398964d547 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:17.231291 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce2047-ced5-4e71-baa8-6c5894932248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:17.231950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce2047-ced5-4e71-baa8-6c5894932248 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:17.232275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce2047-ced5-4e71-baa8-6c5894932248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:17.232560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce2047-ced5-4e71-baa8-6c5894932248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:17.233285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce2047-ced5-4e71-baa8-6c5894932248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:17.234883 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce2047-ced5-4e71-baa8-6c5894932248 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:17.244977 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1044/2051] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:17.249064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bf2c1-52b0-463f-bb86-2a4d99349adc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:17.259419 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bf2c1-52b0-463f-bb86-2a4d99349adc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:17.263999 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce3043-95f7-453a-994e-39a8300b07a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:17.265158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce3043-95f7-453a-994e-39a8300b07a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:17.265443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce3043-95f7-453a-994e-39a8300b07a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:17.265737 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce3043-95f7-453a-994e-39a8300b07a9 admin admin] PATH_INFO: `/v3/projects/e734f261852c4872b2a736bcdbfcf76c/users/a2c33e28328f4cf181c9b21946c7e5a6/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:17.282495 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce3043-95f7-453a-994e-39a8300b07a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e734f261852c4872b2a736bcdbfcf76c, user_id=a2c33e28328f4cf181c9b21946c7e5a6, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:17.285323 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce3043-95f7-453a-994e-39a8300b07a9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:17.380181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1008/2052] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:17 2022] PUT /identity/v3/projects/e734f261852c4872b2a736bcdbfcf76c/users/a2c33e28328f4cf181c9b21946c7e5a6/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:17.386170 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce2047-ced5-4e71-baa8-6c5894932248 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:17.388209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-46ce2047-ced5-4e71-baa8-6c5894932248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:17.393378 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc099e4-015b-4ab1-8f09-8bc224e17c57 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:17.393671 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc099e4-015b-4ab1-8f09-8bc224e17c57 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:17.393955 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc099e4-015b-4ab1-8f09-8bc224e17c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:17.422132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cfc099e4-015b-4ab1-8f09-8bc224e17c57 None None] MFA Rules not processed for user `a2c33e28328f4cf181c9b21946c7e5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:17.423340 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cfc099e4-015b-4ab1-8f09-8bc224e17c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:17.455753 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce2047-ced5-4e71-baa8-6c5894932248 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:17.507151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:17.507826 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1009/2053] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:17 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:17.511179 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc099e4-015b-4ab1-8f09-8bc224e17c57 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:17.519920 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e665f6-da2a-4b5d-9bd6-3e0e6282e68d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:17.520643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e665f6-da2a-4b5d-9bd6-3e0e6282e68d service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:17.522102 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e665f6-da2a-4b5d-9bd6-3e0e6282e68d service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:17.522562 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e665f6-da2a-4b5d-9bd6-3e0e6282e68d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:17.582800 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc099e4-015b-4ab1-8f09-8bc224e17c57 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:17.588919 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987c509-3e8e-456b-be3e-b87e9b42f145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:17.589458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e665f6-da2a-4b5d-9bd6-3e0e6282e68d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:17.589576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987c509-3e8e-456b-be3e-b87e9b42f145 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:17.589861 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987c509-3e8e-456b-be3e-b87e9b42f145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:17.590148 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987c509-3e8e-456b-be3e-b87e9b42f145 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:17.590854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987c509-3e8e-456b-be3e-b87e9b42f145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:17.590963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e665f6-da2a-4b5d-9bd6-3e0e6282e68d service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:17.593143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987c509-3e8e-456b-be3e-b87e9b42f145 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:17.602079 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1045/2054] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:17 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:17.693045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1010/2055] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:17 2022] POST /identity/v3/projects => generated 357 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:17.698022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e665f6-da2a-4b5d-9bd6-3e0e6282e68d service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:17.709092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e665f6-da2a-4b5d-9bd6-3e0e6282e68d service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:17.774998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965e044-c3a4-4c77-9997-b2eb2907d0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:17.775834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965e044-c3a4-4c77-9997-b2eb2907d0cc admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:17.776045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965e044-c3a4-4c77-9997-b2eb2907d0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:17.776334 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965e044-c3a4-4c77-9997-b2eb2907d0cc admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:17.777040 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965e044-c3a4-4c77-9997-b2eb2907d0cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:17.779059 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965e044-c3a4-4c77-9997-b2eb2907d0cc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:17.936486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1046/2056] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:17 2022] POST /identity/v3/users => generated 285 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:17.943581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987c509-3e8e-456b-be3e-b87e9b42f145 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:17.951979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965e044-c3a4-4c77-9997-b2eb2907d0cc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:17.954818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987c509-3e8e-456b-be3e-b87e9b42f145 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:17.960884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3a1b2-d25b-4ab4-8ac0-b4ff237f0c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:17.961821 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3a1b2-d25b-4ab4-8ac0-b4ff237f0c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:17.962275 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3a1b2-d25b-4ab4-8ac0-b4ff237f0c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:17.962762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3a1b2-d25b-4ab4-8ac0-b4ff237f0c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:17.963674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3a1b2-d25b-4ab4-8ac0-b4ff237f0c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:17.965415 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3a1b2-d25b-4ab4-8ac0-b4ff237f0c60 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:17.978861 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1011/2057] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:17.982787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3a1b2-d25b-4ab4-8ac0-b4ff237f0c60 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:17.993144 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3a1b2-d25b-4ab4-8ac0-b4ff237f0c60 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:17.997913 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9acfd9-abe6-421b-ab20-0b85c24681d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:17.998797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9acfd9-abe6-421b-ab20-0b85c24681d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:17.999083 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9acfd9-abe6-421b-ab20-0b85c24681d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:17.999365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9acfd9-abe6-421b-ab20-0b85c24681d9 admin admin] PATH_INFO: `/v3/projects/66af98cfdeb647abb58c0bb7e5915b3e/users/1466305009e3481ca0955a3a38258eb6/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:18.014077 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9acfd9-abe6-421b-ab20-0b85c24681d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66af98cfdeb647abb58c0bb7e5915b3e, user_id=1466305009e3481ca0955a3a38258eb6, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:18.014933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965e044-c3a4-4c77-9997-b2eb2907d0cc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:18.016950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9acfd9-abe6-421b-ab20-0b85c24681d9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:18.018369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf65fd-fd6e-491a-9f45-77914a93298d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:18.019017 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf65fd-fd6e-491a-9f45-77914a93298d service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:18.019308 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf65fd-fd6e-491a-9f45-77914a93298d service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:18.019590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf65fd-fd6e-491a-9f45-77914a93298d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:18.021606 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fabf65fd-fd6e-491a-9f45-77914a93298d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:18.081454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf65fd-fd6e-491a-9f45-77914a93298d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:18.082910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf65fd-fd6e-491a-9f45-77914a93298d service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:18.092367 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1047/2058] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:18.101844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1012/2059] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:17 2022] PUT /identity/v3/projects/66af98cfdeb647abb58c0bb7e5915b3e/users/1466305009e3481ca0955a3a38258eb6/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:18.105902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf65fd-fd6e-491a-9f45-77914a93298d service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:18.117229 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf65fd-fd6e-491a-9f45-77914a93298d service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:18.178479 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2538c-44dd-4ba2-86e6-5ff72e92f244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:18.179359 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2538c-44dd-4ba2-86e6-5ff72e92f244 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:18.179654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2538c-44dd-4ba2-86e6-5ff72e92f244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:18.179939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2538c-44dd-4ba2-86e6-5ff72e92f244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:18.180705 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2538c-44dd-4ba2-86e6-5ff72e92f244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:18.182369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2538c-44dd-4ba2-86e6-5ff72e92f244 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:18.192983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1048/2060] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:18.197266 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9acfd9-abe6-421b-ab20-0b85c24681d9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:18.210043 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9acfd9-abe6-421b-ab20-0b85c24681d9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:18.216674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77717f43-27ac-453e-9897-924035f5e86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:18.217740 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77717f43-27ac-453e-9897-924035f5e86a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:18.218139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77717f43-27ac-453e-9897-924035f5e86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:18.218526 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77717f43-27ac-453e-9897-924035f5e86a admin admin] PATH_INFO: `/v3/projects/66af98cfdeb647abb58c0bb7e5915b3e/users/1466305009e3481ca0955a3a38258eb6/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:18.221587 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77717f43-27ac-453e-9897-924035f5e86a admin admin] RBAC: Authorizing `identity:create_grant(project_id=66af98cfdeb647abb58c0bb7e5915b3e, user_id=1466305009e3481ca0955a3a38258eb6, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:18.224400 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77717f43-27ac-453e-9897-924035f5e86a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:18.235353 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1013/2061] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:18 2022] PUT /identity/v3/projects/66af98cfdeb647abb58c0bb7e5915b3e/users/1466305009e3481ca0955a3a38258eb6/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:18.247119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186ad62-ae0d-4755-82e1-33f789c83cbc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:18.247411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186ad62-ae0d-4755-82e1-33f789c83cbc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:18.247696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186ad62-ae0d-4755-82e1-33f789c83cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:18.276149 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f186ad62-ae0d-4755-82e1-33f789c83cbc None None] MFA Rules not processed for user `1466305009e3481ca0955a3a38258eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:18.277581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f186ad62-ae0d-4755-82e1-33f789c83cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:18.361790 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1049/2062] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:18 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:18.371247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77717f43-27ac-453e-9897-924035f5e86a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:18.373297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-77717f43-27ac-453e-9897-924035f5e86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:18.432097 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77717f43-27ac-453e-9897-924035f5e86a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:18.436037 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5319108-2587-4fd5-84a1-836913cb2dac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:18.436698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5319108-2587-4fd5-84a1-836913cb2dac service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:18.436989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5319108-2587-4fd5-84a1-836913cb2dac service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:18.437267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5319108-2587-4fd5-84a1-836913cb2dac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:18.447715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5319108-2587-4fd5-84a1-836913cb2dac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:18.449196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5319108-2587-4fd5-84a1-836913cb2dac service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:18.459260 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1014/2063] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:18 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:18.863447 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186ad62-ae0d-4755-82e1-33f789c83cbc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:18.872854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186ad62-ae0d-4755-82e1-33f789c83cbc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:18.876565 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439feacd-5c4e-44a6-a464-5ad07e435ac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:18.877823 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439feacd-5c4e-44a6-a464-5ad07e435ac8 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:18.878109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439feacd-5c4e-44a6-a464-5ad07e435ac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:18.878422 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439feacd-5c4e-44a6-a464-5ad07e435ac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:18.938845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439feacd-5c4e-44a6-a464-5ad07e435ac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:18.941097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439feacd-5c4e-44a6-a464-5ad07e435ac8 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:18.950081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1050/2064] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:18 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:19.896182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:20.450789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=12,keystone:SELECT=83,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:22.548263 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5319108-2587-4fd5-84a1-836913cb2dac service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:22.550344 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e5319108-2587-4fd5-84a1-836913cb2dac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:22.605948 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:22.627782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5319108-2587-4fd5-84a1-836913cb2dac service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:22.632882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9dd4a-6c75-4536-8957-bdbe6e8906f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:22.633765 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9dd4a-6c75-4536-8957-bdbe6e8906f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:22.634057 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9dd4a-6c75-4536-8957-bdbe6e8906f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:22.634346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9dd4a-6c75-4536-8957-bdbe6e8906f9 admin admin] PATH_INFO: `/v3/users/6df6c598e60644f38ee97ce6817fb6f3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:22.635533 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9dd4a-6c75-4536-8957-bdbe6e8906f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df6c598e60644f38ee97ce6817fb6f3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:22.637571 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9dd4a-6c75-4536-8957-bdbe6e8906f9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:22.841143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8ad9dd4a-6c75-4536-8957-bdbe6e8906f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df6c598e60644f38ee97ce6817fb6f3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:22.858685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8ad9dd4a-6c75-4536-8957-bdbe6e8906f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df6c598e60644f38ee97ce6817fb6f3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:22.859282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8ad9dd4a-6c75-4536-8957-bdbe6e8906f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df6c598e60644f38ee97ce6817fb6f3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:22.867335 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8ad9dd4a-6c75-4536-8957-bdbe6e8906f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df6c598e60644f38ee97ce6817fb6f3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:22.868557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8ad9dd4a-6c75-4536-8957-bdbe6e8906f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df6c598e60644f38ee97ce6817fb6f3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:22.983138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1015/2065] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:22 2022] DELETE /identity/v3/users/6df6c598e60644f38ee97ce6817fb6f3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:22.987977 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4764c-e042-405d-9b6e-11945dcbf8fb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:22.988446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4764c-e042-405d-9b6e-11945dcbf8fb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:22.988735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4764c-e042-405d-9b6e-11945dcbf8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:23.010090 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6aa4764c-e042-405d-9b6e-11945dcbf8fb None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:23.011445 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6aa4764c-e042-405d-9b6e-11945dcbf8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:23.076039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1051/2066] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:23.086537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9dd4a-6c75-4536-8957-bdbe6e8906f9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:23.088394 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8ad9dd4a-6c75-4536-8957-bdbe6e8906f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:23.160289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9dd4a-6c75-4536-8957-bdbe6e8906f9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:23.165510 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d029bd-0ad8-4669-9322-2278b01b24cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:23.169312 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d029bd-0ad8-4669-9322-2278b01b24cc service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:23.169595 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d029bd-0ad8-4669-9322-2278b01b24cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:23.169927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d029bd-0ad8-4669-9322-2278b01b24cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:23.181672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d029bd-0ad8-4669-9322-2278b01b24cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:23.183263 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d029bd-0ad8-4669-9322-2278b01b24cc service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:23.197092 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1016/2067] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:23.200748 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:23.708962 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4764c-e042-405d-9b6e-11945dcbf8fb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:23.710480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6aa4764c-e042-405d-9b6e-11945dcbf8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:23.728970 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4764c-e042-405d-9b6e-11945dcbf8fb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:23.738629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b25a95-09d7-4d4d-b664-5fee1df0910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:23.739517 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b25a95-09d7-4d4d-b664-5fee1df0910f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:23.739856 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b25a95-09d7-4d4d-b664-5fee1df0910f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:23.740211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b25a95-09d7-4d4d-b664-5fee1df0910f admin admin] PATH_INFO: `/v3/projects/c58a8d3d5f1848738a3378c7cc2522c2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:23.741439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b25a95-09d7-4d4d-b664-5fee1df0910f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58a8d3d5f1848738a3378c7cc2522c2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:23.743395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b25a95-09d7-4d4d-b664-5fee1df0910f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:23.903827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-81b25a95-09d7-4d4d-b664-5fee1df0910f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58a8d3d5f1848738a3378c7cc2522c2', 'request_id': 'req-81b25a95-09d7-4d4d-b664-5fee1df0910f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:23.987722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-81b25a95-09d7-4d4d-b664-5fee1df0910f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58a8d3d5f1848738a3378c7cc2522c2', 'request_id': 'req-81b25a95-09d7-4d4d-b664-5fee1df0910f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:23.995125 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-81b25a95-09d7-4d4d-b664-5fee1df0910f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58a8d3d5f1848738a3378c7cc2522c2', 'request_id': 'req-81b25a95-09d7-4d4d-b664-5fee1df0910f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:24.006264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-81b25a95-09d7-4d4d-b664-5fee1df0910f admin admin] The token cache is being invalidate because project c58a8d3d5f1848738a3378c7cc2522c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:24.006553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-81b25a95-09d7-4d4d-b664-5fee1df0910f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:24.007411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-81b25a95-09d7-4d4d-b664-5fee1df0910f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:24.012143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1052/2068] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:23 2022] DELETE /identity/v3/projects/c58a8d3d5f1848738a3378c7cc2522c2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:24.013034 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d029bd-0ad8-4669-9322-2278b01b24cc service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:24.022446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b25a95-09d7-4d4d-b664-5fee1df0910f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:24.024141 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-81b25a95-09d7-4d4d-b664-5fee1df0910f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:24.031613 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d029bd-0ad8-4669-9322-2278b01b24cc service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:24.105400 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b25a95-09d7-4d4d-b664-5fee1df0910f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:24.111278 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74030a33-6642-4b68-87c7-1be8f6a452a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:24.112743 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74030a33-6642-4b68-87c7-1be8f6a452a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:24.113034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74030a33-6642-4b68-87c7-1be8f6a452a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:24.113486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74030a33-6642-4b68-87c7-1be8f6a452a9 admin admin] PATH_INFO: `/v3/users/f70f4f48871444ef8f8a84e9dcd2330b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:24.114734 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74030a33-6642-4b68-87c7-1be8f6a452a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70f4f48871444ef8f8a84e9dcd2330b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:24.116758 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74030a33-6642-4b68-87c7-1be8f6a452a9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:24.123297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeb2e2-4875-4c46-a3cf-2c9a4cc03ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:24.126594 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeb2e2-4875-4c46-a3cf-2c9a4cc03ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:24.128913 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeb2e2-4875-4c46-a3cf-2c9a4cc03ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:24.129065 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeb2e2-4875-4c46-a3cf-2c9a4cc03ab8 admin admin] PATH_INFO: `/v3/users/34fa2d97a44940628acb22fcbbee46bf` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:24.132982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeb2e2-4875-4c46-a3cf-2c9a4cc03ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34fa2d97a44940628acb22fcbbee46bf)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:24.134970 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eeb2e2-4875-4c46-a3cf-2c9a4cc03ab8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:24.516653 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a4eeb2e2-4875-4c46-a3cf-2c9a4cc03ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34fa2d97a44940628acb22fcbbee46bf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:24.518743 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-74030a33-6642-4b68-87c7-1be8f6a452a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70f4f48871444ef8f8a84e9dcd2330b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:24.519245 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-74030a33-6642-4b68-87c7-1be8f6a452a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70f4f48871444ef8f8a84e9dcd2330b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:24.528834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a4eeb2e2-4875-4c46-a3cf-2c9a4cc03ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34fa2d97a44940628acb22fcbbee46bf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:24.529530 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a4eeb2e2-4875-4c46-a3cf-2c9a4cc03ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34fa2d97a44940628acb22fcbbee46bf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:24.537013 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a4eeb2e2-4875-4c46-a3cf-2c9a4cc03ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34fa2d97a44940628acb22fcbbee46bf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:24.537661 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a4eeb2e2-4875-4c46-a3cf-2c9a4cc03ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34fa2d97a44940628acb22fcbbee46bf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:24.616451 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-74030a33-6642-4b68-87c7-1be8f6a452a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70f4f48871444ef8f8a84e9dcd2330b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:24.625271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-74030a33-6642-4b68-87c7-1be8f6a452a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70f4f48871444ef8f8a84e9dcd2330b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:24.625986 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-74030a33-6642-4b68-87c7-1be8f6a452a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70f4f48871444ef8f8a84e9dcd2330b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:24.646155 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1053/2069] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:24 2022] DELETE /identity/v3/users/f70f4f48871444ef8f8a84e9dcd2330b => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:24.653425 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0777bea-65ca-4c6b-bf15-d0542ea98ece None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:24.653749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0777bea-65ca-4c6b-bf15-d0542ea98ece None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:24.653981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0777bea-65ca-4c6b-bf15-d0542ea98ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:24.673913 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e0777bea-65ca-4c6b-bf15-d0542ea98ece None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:24.676107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e0777bea-65ca-4c6b-bf15-d0542ea98ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:24.725889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1017/2070] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:24 2022] DELETE /identity/v3/users/34fa2d97a44940628acb22fcbbee46bf => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:24.739567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1054/2071] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:24.752659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeb2e2-4875-4c46-a3cf-2c9a4cc03ab8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:24.754859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a4eeb2e2-4875-4c46-a3cf-2c9a4cc03ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:24.832219 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eeb2e2-4875-4c46-a3cf-2c9a4cc03ab8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:24.836900 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25140a-ca0d-4de2-b961-913d5da65c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:24.837693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25140a-ca0d-4de2-b961-913d5da65c30 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:24.837992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25140a-ca0d-4de2-b961-913d5da65c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:24.838844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25140a-ca0d-4de2-b961-913d5da65c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:24.903566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25140a-ca0d-4de2-b961-913d5da65c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:24.904985 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25140a-ca0d-4de2-b961-913d5da65c30 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:24.915094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1018/2072] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:25.425450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0777bea-65ca-4c6b-bf15-d0542ea98ece None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:25.429855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e0777bea-65ca-4c6b-bf15-d0542ea98ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:25.451921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0777bea-65ca-4c6b-bf15-d0542ea98ece None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:25.457258 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:25.458123 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:25.458410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:25.458746 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b admin admin] PATH_INFO: `/v3/projects/ebd441af6ca8483b9bfd2b0a85233a56` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:25.459943 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd441af6ca8483b9bfd2b0a85233a56)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:25.461839 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:25.478302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25140a-ca0d-4de2-b961-913d5da65c30 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:25.480773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1c25140a-ca0d-4de2-b961-913d5da65c30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:25.497366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25140a-ca0d-4de2-b961-913d5da65c30 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:25.502269 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:25.503170 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:25.503463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:25.504107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24 admin admin] PATH_INFO: `/v3/projects/c6f761733454497fb707af985a983010` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:25.504985 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f761733454497fb707af985a983010)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:25.506980 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:25.668916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f761733454497fb707af985a983010', 'request_id': 'req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:25.670023 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd441af6ca8483b9bfd2b0a85233a56', 'request_id': 'req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:25.674426 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f761733454497fb707af985a983010', 'request_id': 'req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:25.735289 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd441af6ca8483b9bfd2b0a85233a56', 'request_id': 'req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:25.741993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd441af6ca8483b9bfd2b0a85233a56', 'request_id': 'req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:25.752725 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b admin admin] The token cache is being invalidate because project ebd441af6ca8483b9bfd2b0a85233a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:25.753070 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:25.753760 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:25.755360 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1055/2073] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:25 2022] DELETE /identity/v3/projects/ebd441af6ca8483b9bfd2b0a85233a56 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:25.759273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:25.760625 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:25.764971 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:25.815617 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f761733454497fb707af985a983010', 'request_id': 'req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:25.827840 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24 admin admin] The token cache is being invalidate because project c6f761733454497fb707af985a983010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:25.828178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:25.828837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:25.830488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1019/2074] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:25 2022] DELETE /identity/v3/projects/c6f761733454497fb707af985a983010 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:25.833111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a5816-5a5a-4a4f-8349-3aefb29dd94b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:25.835334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:25.836693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:25.893082 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1248241-47f4-46f1-be5d-be9c76182381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:25.894626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1248241-47f4-46f1-be5d-be9c76182381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:25.894916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1248241-47f4-46f1-be5d-be9c76182381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:25.895198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1248241-47f4-46f1-be5d-be9c76182381 admin admin] PATH_INFO: `/v3/users/df1f4c2b1b1a4f37ace6b7c9301bd525` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:25.896589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1248241-47f4-46f1-be5d-be9c76182381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df1f4c2b1b1a4f37ace6b7c9301bd525)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:25.898572 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1248241-47f4-46f1-be5d-be9c76182381 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:25.901145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089ef7b-513b-4e4e-81c8-2ff6eca55c24 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:25.906443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593ed89-a1f8-4104-87df-b3fd3ca4952e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:25.907346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593ed89-a1f8-4104-87df-b3fd3ca4952e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:25.907648 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593ed89-a1f8-4104-87df-b3fd3ca4952e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:25.907934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593ed89-a1f8-4104-87df-b3fd3ca4952e admin admin] PATH_INFO: `/v3/users/2fd39c7bebfd48d4aed87f6088ba86fe` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:25.909749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593ed89-a1f8-4104-87df-b3fd3ca4952e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd39c7bebfd48d4aed87f6088ba86fe)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:25.911792 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593ed89-a1f8-4104-87df-b3fd3ca4952e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:26.146402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b1248241-47f4-46f1-be5d-be9c76182381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df1f4c2b1b1a4f37ace6b7c9301bd525'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:26.147239 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b1248241-47f4-46f1-be5d-be9c76182381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df1f4c2b1b1a4f37ace6b7c9301bd525'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:26.174583 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e593ed89-a1f8-4104-87df-b3fd3ca4952e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd39c7bebfd48d4aed87f6088ba86fe'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:26.186347 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e593ed89-a1f8-4104-87df-b3fd3ca4952e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd39c7bebfd48d4aed87f6088ba86fe'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:26.187099 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e593ed89-a1f8-4104-87df-b3fd3ca4952e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd39c7bebfd48d4aed87f6088ba86fe'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:26.195129 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e593ed89-a1f8-4104-87df-b3fd3ca4952e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd39c7bebfd48d4aed87f6088ba86fe'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:26.195803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e593ed89-a1f8-4104-87df-b3fd3ca4952e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd39c7bebfd48d4aed87f6088ba86fe'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:26.270762 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:26.270762 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b1248241-47f4-46f1-be5d-be9c76182381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df1f4c2b1b1a4f37ace6b7c9301bd525'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:26.276701 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b1248241-47f4-46f1-be5d-be9c76182381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df1f4c2b1b1a4f37ace6b7c9301bd525'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:26.277374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b1248241-47f4-46f1-be5d-be9c76182381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df1f4c2b1b1a4f37ace6b7c9301bd525'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:26.305294 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1056/2075] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:25 2022] DELETE /identity/v3/users/df1f4c2b1b1a4f37ace6b7c9301bd525 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:26.386507 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1020/2076] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:25 2022] DELETE /identity/v3/users/2fd39c7bebfd48d4aed87f6088ba86fe => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:26.872564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1248241-47f4-46f1-be5d-be9c76182381 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:26.873063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593ed89-a1f8-4104-87df-b3fd3ca4952e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:26.874037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b1248241-47f4-46f1-be5d-be9c76182381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:26.874462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e593ed89-a1f8-4104-87df-b3fd3ca4952e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:26.944570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1248241-47f4-46f1-be5d-be9c76182381 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:26.958496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593ed89-a1f8-4104-87df-b3fd3ca4952e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:26.967343 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3a1e1-efac-4876-a82f-34361f216f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:26.967343 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3a1e1-efac-4876-a82f-34361f216f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:26.967343 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3a1e1-efac-4876-a82f-34361f216f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:26.967343 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3a1e1-efac-4876-a82f-34361f216f07 admin admin] PATH_INFO: `/v3/projects/5d059e7028244f81a2edc6a9d2d24b4e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:26.967660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3a1e1-efac-4876-a82f-34361f216f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d059e7028244f81a2edc6a9d2d24b4e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:26.967834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3a1e1-efac-4876-a82f-34361f216f07 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:27.003263 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a55ee-d89d-4c30-857e-a0f231aed002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:27.004152 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a55ee-d89d-4c30-857e-a0f231aed002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.004436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a55ee-d89d-4c30-857e-a0f231aed002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.004716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a55ee-d89d-4c30-857e-a0f231aed002 admin admin] PATH_INFO: `/v3/projects/768be626452348499e6dbe66d62efd69` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.005885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a55ee-d89d-4c30-857e-a0f231aed002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=768be626452348499e6dbe66d62efd69)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:27.007862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a55ee-d89d-4c30-857e-a0f231aed002 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:27.085416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30f3a1e1-efac-4876-a82f-34361f216f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d059e7028244f81a2edc6a9d2d24b4e', 'request_id': 'req-30f3a1e1-efac-4876-a82f-34361f216f07'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.090829 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30f3a1e1-efac-4876-a82f-34361f216f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d059e7028244f81a2edc6a9d2d24b4e', 'request_id': 'req-30f3a1e1-efac-4876-a82f-34361f216f07'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.156459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f61a55ee-d89d-4c30-857e-a0f231aed002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768be626452348499e6dbe66d62efd69', 'request_id': 'req-f61a55ee-d89d-4c30-857e-a0f231aed002'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.168599 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30f3a1e1-efac-4876-a82f-34361f216f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d059e7028244f81a2edc6a9d2d24b4e', 'request_id': 'req-30f3a1e1-efac-4876-a82f-34361f216f07'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.181390 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30f3a1e1-efac-4876-a82f-34361f216f07 admin admin] The token cache is being invalidate because project 5d059e7028244f81a2edc6a9d2d24b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:27.181685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30f3a1e1-efac-4876-a82f-34361f216f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.182340 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30f3a1e1-efac-4876-a82f-34361f216f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.184155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1021/2077] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:26 2022] DELETE /identity/v3/projects/5d059e7028244f81a2edc6a9d2d24b4e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:27.189790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e92860-e306-4aac-afa1-d1b6cc8aace7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.190669 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e92860-e306-4aac-afa1-d1b6cc8aace7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.191009 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e92860-e306-4aac-afa1-d1b6cc8aace7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.211208 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-98e92860-e306-4aac-afa1-d1b6cc8aace7 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:27.212482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-98e92860-e306-4aac-afa1-d1b6cc8aace7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:27.243807 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f61a55ee-d89d-4c30-857e-a0f231aed002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768be626452348499e6dbe66d62efd69', 'request_id': 'req-f61a55ee-d89d-4c30-857e-a0f231aed002'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.250606 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f61a55ee-d89d-4c30-857e-a0f231aed002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768be626452348499e6dbe66d62efd69', 'request_id': 'req-f61a55ee-d89d-4c30-857e-a0f231aed002'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.261577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f61a55ee-d89d-4c30-857e-a0f231aed002 admin admin] The token cache is being invalidate because project 768be626452348499e6dbe66d62efd69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:27.261865 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f61a55ee-d89d-4c30-857e-a0f231aed002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.262506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f61a55ee-d89d-4c30-857e-a0f231aed002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:27.264116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1057/2078] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:26 2022] DELETE /identity/v3/projects/768be626452348499e6dbe66d62efd69 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:27.269108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cac8a-f8fb-4ff8-a931-db07bba9892d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.269395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cac8a-f8fb-4ff8-a931-db07bba9892d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.269676 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cac8a-f8fb-4ff8-a931-db07bba9892d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.272030 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1022/2079] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:27.281058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd666d-02c1-4df4-b38f-51de4a2403b0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.288477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd666d-02c1-4df4-b38f-51de4a2403b0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.288477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd666d-02c1-4df4-b38f-51de4a2403b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.288682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e96cac8a-f8fb-4ff8-a931-db07bba9892d None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:27.289436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e96cac8a-f8fb-4ff8-a931-db07bba9892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:27.297392 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1058/2080] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:27.300261 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d0fd666d-02c1-4df4-b38f-51de4a2403b0 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:27.301449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d0fd666d-02c1-4df4-b38f-51de4a2403b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:27.305363 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9f7cc-8036-440b-916a-6e00493be77d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.305659 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9f7cc-8036-440b-916a-6e00493be77d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.305948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9f7cc-8036-440b-916a-6e00493be77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.309431 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1023/2081] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:27.313399 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd666d-02c1-4df4-b38f-51de4a2403b0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:27.346158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd666d-02c1-4df4-b38f-51de4a2403b0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:27.346302 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d0a9f7cc-8036-440b-916a-6e00493be77d None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:27.346396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886135f-aab0-4aa6-817e-c457cc1ee2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:27.346508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d0a9f7cc-8036-440b-916a-6e00493be77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:27.346597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886135f-aab0-4aa6-817e-c457cc1ee2ac admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.346597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886135f-aab0-4aa6-817e-c457cc1ee2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.346597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886135f-aab0-4aa6-817e-c457cc1ee2ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.346597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886135f-aab0-4aa6-817e-c457cc1ee2ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:27.346597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886135f-aab0-4aa6-817e-c457cc1ee2ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:27.346597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886135f-aab0-4aa6-817e-c457cc1ee2ac admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:27.347045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1059/2082] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:27.347134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1024/2083] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 16:07:27.349130 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9f7cc-8036-440b-916a-6e00493be77d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:27.358800 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9f7cc-8036-440b-916a-6e00493be77d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:27.359026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886135f-aab0-4aa6-817e-c457cc1ee2ac admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:27.369851 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886135f-aab0-4aa6-817e-c457cc1ee2ac admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:27.372228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b25958-09dc-47e4-b55d-d37485276eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:27.372932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b25958-09dc-47e4-b55d-d37485276eec admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.373184 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b25958-09dc-47e4-b55d-d37485276eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.373463 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b25958-09dc-47e4-b55d-d37485276eec admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.374542 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b25958-09dc-47e4-b55d-d37485276eec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:27.374889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3d22-1850-4fed-b50d-f88a38bf5510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:27.375014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b25958-09dc-47e4-b55d-d37485276eec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:27.375590 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3d22-1850-4fed-b50d-f88a38bf5510 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.375824 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3d22-1850-4fed-b50d-f88a38bf5510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.376148 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3d22-1850-4fed-b50d-f88a38bf5510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.376835 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b25958-09dc-47e4-b55d-d37485276eec admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:27.376992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e3d22-1850-4fed-b50d-f88a38bf5510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:27.379474 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e3d22-1850-4fed-b50d-f88a38bf5510 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:27.390915 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1060/2084] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:27.394774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b25958-09dc-47e4-b55d-d37485276eec admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:27.404282 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b25958-09dc-47e4-b55d-d37485276eec admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:27.409428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db65c8-f879-499f-8b70-efa3d13ca6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:27.409993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db65c8-f879-499f-8b70-efa3d13ca6bb admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.410277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db65c8-f879-499f-8b70-efa3d13ca6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.410703 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db65c8-f879-499f-8b70-efa3d13ca6bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.411376 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db65c8-f879-499f-8b70-efa3d13ca6bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:27.413384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db65c8-f879-499f-8b70-efa3d13ca6bb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:27.549253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1025/2085] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:27 2022] POST /identity/v3/projects => generated 389 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:27.553759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3d22-1850-4fed-b50d-f88a38bf5510 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:27.614881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3d22-1850-4fed-b50d-f88a38bf5510 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:27.619685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131210fd-1a07-468c-b19a-cead61e37511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:27.620463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131210fd-1a07-468c-b19a-cead61e37511 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.620859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131210fd-1a07-468c-b19a-cead61e37511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.621213 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131210fd-1a07-468c-b19a-cead61e37511 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.622094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131210fd-1a07-468c-b19a-cead61e37511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:27.624073 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131210fd-1a07-468c-b19a-cead61e37511 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:27.703909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1061/2086] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:27 2022] POST /identity/v3/projects => generated 377 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:27.707852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db65c8-f879-499f-8b70-efa3d13ca6bb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:27.769877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db65c8-f879-499f-8b70-efa3d13ca6bb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:27.775024 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c6995-3242-4d64-8296-fd366fee6138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:27.775841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6995-3242-4d64-8296-fd366fee6138 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.776261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6995-3242-4d64-8296-fd366fee6138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.776668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c6995-3242-4d64-8296-fd366fee6138 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.777957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c6995-3242-4d64-8296-fd366fee6138 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:27.780026 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c6995-3242-4d64-8296-fd366fee6138 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:27.793332 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1026/2087] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:27 2022] POST /identity/v3/users => generated 295 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:27.803021 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131210fd-1a07-468c-b19a-cead61e37511 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:27.813661 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131210fd-1a07-468c-b19a-cead61e37511 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:27.818579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d634c9-7922-4e2e-9365-45ce506a98a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:27.819237 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d634c9-7922-4e2e-9365-45ce506a98a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.819521 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d634c9-7922-4e2e-9365-45ce506a98a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.819799 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d634c9-7922-4e2e-9365-45ce506a98a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.820679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d634c9-7922-4e2e-9365-45ce506a98a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:27.822647 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d634c9-7922-4e2e-9365-45ce506a98a8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:27.833234 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1027/2088] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:27.842275 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d634c9-7922-4e2e-9365-45ce506a98a8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:27.852258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d634c9-7922-4e2e-9365-45ce506a98a8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:27.856803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20466b-1a75-4eba-a04b-8a4b6d18e57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:27.857411 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20466b-1a75-4eba-a04b-8a4b6d18e57c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.857696 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20466b-1a75-4eba-a04b-8a4b6d18e57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.857975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20466b-1a75-4eba-a04b-8a4b6d18e57c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.858662 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20466b-1a75-4eba-a04b-8a4b6d18e57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:27.860490 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20466b-1a75-4eba-a04b-8a4b6d18e57c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:27.871671 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1028/2089] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:27.876922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20466b-1a75-4eba-a04b-8a4b6d18e57c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:27.886028 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20466b-1a75-4eba-a04b-8a4b6d18e57c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:27.891174 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccd924-72d4-420c-9907-9b3b7ca64b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:27.892024 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccd924-72d4-420c-9907-9b3b7ca64b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.892305 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccd924-72d4-420c-9907-9b3b7ca64b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.892583 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccd924-72d4-420c-9907-9b3b7ca64b2b admin admin] PATH_INFO: `/v3/projects/01c6b314d80847b5a78d2e0c8b7539a5/users/69aabfed13aa476da9321e9923fd9f4c/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.901475 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1062/2090] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:27 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:27.910831 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccd924-72d4-420c-9907-9b3b7ca64b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c6b314d80847b5a78d2e0c8b7539a5, user_id=69aabfed13aa476da9321e9923fd9f4c, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:27.912806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c6995-3242-4d64-8296-fd366fee6138 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:27.914175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccd924-72d4-420c-9907-9b3b7ca64b2b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:27.922726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c6995-3242-4d64-8296-fd366fee6138 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:27.927466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785747d4-c384-4c7a-b563-f5c91f778d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:27.928161 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785747d4-c384-4c7a-b563-f5c91f778d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.928454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785747d4-c384-4c7a-b563-f5c91f778d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.928733 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785747d4-c384-4c7a-b563-f5c91f778d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.929454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785747d4-c384-4c7a-b563-f5c91f778d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:27.931070 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785747d4-c384-4c7a-b563-f5c91f778d2e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:27.941019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1063/2091] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:27.951310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785747d4-c384-4c7a-b563-f5c91f778d2e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:27.961404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785747d4-c384-4c7a-b563-f5c91f778d2e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:27.966042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105273c7-c74c-45e8-b48f-cd8cb277daee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:27.966678 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105273c7-c74c-45e8-b48f-cd8cb277daee admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.966965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105273c7-c74c-45e8-b48f-cd8cb277daee admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.967247 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105273c7-c74c-45e8-b48f-cd8cb277daee admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:27.967951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105273c7-c74c-45e8-b48f-cd8cb277daee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:27.969551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105273c7-c74c-45e8-b48f-cd8cb277daee admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:27.980321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1064/2092] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:27.984029 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105273c7-c74c-45e8-b48f-cd8cb277daee admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:27.993305 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105273c7-c74c-45e8-b48f-cd8cb277daee admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:27.998018 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5d474-3c72-4822-8fd7-d61cb149c6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:27.998897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5d474-3c72-4822-8fd7-d61cb149c6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:27.999186 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5d474-3c72-4822-8fd7-d61cb149c6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:27.999467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5d474-3c72-4822-8fd7-d61cb149c6b4 admin admin] PATH_INFO: `/v3/projects/b99a8142479745999b1c3511cb98edd2/users/4fcb857bf24348f3a20dc5127afadefe/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:28.013592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5d474-3c72-4822-8fd7-d61cb149c6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99a8142479745999b1c3511cb98edd2, user_id=4fcb857bf24348f3a20dc5127afadefe, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:28.016578 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5d474-3c72-4822-8fd7-d61cb149c6b4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:28.078686 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1029/2093] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:27 2022] PUT /identity/v3/projects/01c6b314d80847b5a78d2e0c8b7539a5/users/69aabfed13aa476da9321e9923fd9f4c/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:28.090070 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682cd46-51a0-404c-ae89-0110d13547bd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:28.090364 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682cd46-51a0-404c-ae89-0110d13547bd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:28.090809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682cd46-51a0-404c-ae89-0110d13547bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:28.116598 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1682cd46-51a0-404c-ae89-0110d13547bd None None] MFA Rules not processed for user `69aabfed13aa476da9321e9923fd9f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:28.117800 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1682cd46-51a0-404c-ae89-0110d13547bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:28.122440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1065/2094] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:27 2022] PUT /identity/v3/projects/b99a8142479745999b1c3511cb98edd2/users/4fcb857bf24348f3a20dc5127afadefe/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:28.134700 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e0dd7-59bd-42cd-aabd-c1d542184103 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:28.135011 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e0dd7-59bd-42cd-aabd-c1d542184103 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:28.135298 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e0dd7-59bd-42cd-aabd-c1d542184103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:28.163366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-823e0dd7-59bd-42cd-aabd-c1d542184103 None None] MFA Rules not processed for user `4fcb857bf24348f3a20dc5127afadefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:28.164633 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-823e0dd7-59bd-42cd-aabd-c1d542184103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:28.182646 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1030/2095] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:28.187137 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682cd46-51a0-404c-ae89-0110d13547bd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:28.227706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1066/2096] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:28.232282 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e0dd7-59bd-42cd-aabd-c1d542184103 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:28.250374 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682cd46-51a0-404c-ae89-0110d13547bd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:28.261668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df81190-c288-4c37-b8bd-0353b9dd1d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:28.262338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df81190-c288-4c37-b8bd-0353b9dd1d40 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:28.262622 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df81190-c288-4c37-b8bd-0353b9dd1d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:28.262903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df81190-c288-4c37-b8bd-0353b9dd1d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:28.263648 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df81190-c288-4c37-b8bd-0353b9dd1d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:28.265997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df81190-c288-4c37-b8bd-0353b9dd1d40 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:28.295431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e0dd7-59bd-42cd-aabd-c1d542184103 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:28.300694 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803f585-6896-4c65-a044-a650d212aa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:28.301348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803f585-6896-4c65-a044-a650d212aa7d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:28.301632 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803f585-6896-4c65-a044-a650d212aa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:28.301912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803f585-6896-4c65-a044-a650d212aa7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:28.302594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803f585-6896-4c65-a044-a650d212aa7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:28.304521 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803f585-6896-4c65-a044-a650d212aa7d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:28.457577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1031/2097] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:28 2022] POST /identity/v3/projects => generated 389 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:28.461494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df81190-c288-4c37-b8bd-0353b9dd1d40 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:28.498557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1067/2098] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:28 2022] POST /identity/v3/projects => generated 375 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:28.504687 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803f585-6896-4c65-a044-a650d212aa7d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:28.523460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df81190-c288-4c37-b8bd-0353b9dd1d40 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:28.567637 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803f585-6896-4c65-a044-a650d212aa7d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:28.573469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091c6fa-c12d-4f53-802d-d27b94e1f8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:28.574136 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c6fa-c12d-4f53-802d-d27b94e1f8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:28.574478 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c6fa-c12d-4f53-802d-d27b94e1f8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:28.574703 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c6fa-c12d-4f53-802d-d27b94e1f8b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:28.575561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091c6fa-c12d-4f53-802d-d27b94e1f8b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:28.577490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091c6fa-c12d-4f53-802d-d27b94e1f8b4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:28.582730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bf17d-7661-4064-9e0a-328961f21c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:28.583406 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bf17d-7661-4064-9e0a-328961f21c65 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:28.585940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bf17d-7661-4064-9e0a-328961f21c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:28.585940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bf17d-7661-4064-9e0a-328961f21c65 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:28.585940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bf17d-7661-4064-9e0a-328961f21c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:28.586657 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bf17d-7661-4064-9e0a-328961f21c65 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:28.609605 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:28.693354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1068/2099] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:28 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:28.697128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091c6fa-c12d-4f53-802d-d27b94e1f8b4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:28.706993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091c6fa-c12d-4f53-802d-d27b94e1f8b4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:28.711642 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1032/2100] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:28 2022] POST /identity/v3/users => generated 301 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:28.711789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9db89-3098-46d5-a990-c34ed6ecd3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:28.712272 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9db89-3098-46d5-a990-c34ed6ecd3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:28.712561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9db89-3098-46d5-a990-c34ed6ecd3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:28.712846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9db89-3098-46d5-a990-c34ed6ecd3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:28.713564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9db89-3098-46d5-a990-c34ed6ecd3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:28.715204 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9db89-3098-46d5-a990-c34ed6ecd3f5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:28.715320 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bf17d-7661-4064-9e0a-328961f21c65 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:28.725989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bf17d-7661-4064-9e0a-328961f21c65 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:28.726388 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1069/2101] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:28.730385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9db89-3098-46d5-a990-c34ed6ecd3f5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:28.733693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c8302-77e3-4b25-a5ce-f30146919265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:28.734375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c8302-77e3-4b25-a5ce-f30146919265 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:28.734637 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c8302-77e3-4b25-a5ce-f30146919265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:28.735049 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c8302-77e3-4b25-a5ce-f30146919265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:28.735641 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c8302-77e3-4b25-a5ce-f30146919265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:28.737288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c8302-77e3-4b25-a5ce-f30146919265 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:28.742650 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9db89-3098-46d5-a990-c34ed6ecd3f5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:28.746353 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bd357-2729-4ea0-9aaf-6273a28e856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:28.747091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bd357-2729-4ea0-9aaf-6273a28e856c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:28.747459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bd357-2729-4ea0-9aaf-6273a28e856c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:28.747828 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1033/2102] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:28.747961 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bd357-2729-4ea0-9aaf-6273a28e856c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:28.748630 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bd357-2729-4ea0-9aaf-6273a28e856c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:28.750191 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bd357-2729-4ea0-9aaf-6273a28e856c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:28.751788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c8302-77e3-4b25-a5ce-f30146919265 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:28.764836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1070/2103] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:28.765055 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c8302-77e3-4b25-a5ce-f30146919265 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:28.766098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bd357-2729-4ea0-9aaf-6273a28e856c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:28.766959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf97ed-572c-4637-bd3b-bf8c5c6b7983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:28.767853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf97ed-572c-4637-bd3b-bf8c5c6b7983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:28.768711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf97ed-572c-4637-bd3b-bf8c5c6b7983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:28.772452 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf97ed-572c-4637-bd3b-bf8c5c6b7983 admin admin] PATH_INFO: `/v3/projects/78b7b7070e5d4d73a214a009fa95a603/users/a5fdac072a684b9789963e94b9edf908/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:28.777024 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bd357-2729-4ea0-9aaf-6273a28e856c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:28.782008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d0870-f24f-4fea-968c-e1df38c32da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:28.782901 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0870-f24f-4fea-968c-e1df38c32da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:28.783252 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0870-f24f-4fea-968c-e1df38c32da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:28.783459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0870-f24f-4fea-968c-e1df38c32da7 admin admin] PATH_INFO: `/v3/projects/d7c73ddf696e495699b7dab6aa9c6608/users/0762ff7131e14f6eb2082dcda14dbf88/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:28.785129 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf97ed-572c-4637-bd3b-bf8c5c6b7983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b7b7070e5d4d73a214a009fa95a603, user_id=a5fdac072a684b9789963e94b9edf908, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:28.787770 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf97ed-572c-4637-bd3b-bf8c5c6b7983 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:28.805173 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d0870-f24f-4fea-968c-e1df38c32da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c73ddf696e495699b7dab6aa9c6608, user_id=0762ff7131e14f6eb2082dcda14dbf88, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:28.812735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d0870-f24f-4fea-968c-e1df38c32da7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:28.900712 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1034/2104] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:28 2022] PUT /identity/v3/projects/78b7b7070e5d4d73a214a009fa95a603/users/a5fdac072a684b9789963e94b9edf908/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:28.909252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf97ed-572c-4637-bd3b-bf8c5c6b7983 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:28.909573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1071/2105] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:28 2022] PUT /identity/v3/projects/d7c73ddf696e495699b7dab6aa9c6608/users/0762ff7131e14f6eb2082dcda14dbf88/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:28.919432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9487a-6b74-4c45-9de0-877e9a2960c1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:28.920261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9487a-6b74-4c45-9de0-877e9a2960c1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:28.920553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9487a-6b74-4c45-9de0-877e9a2960c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:28.949339 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cbb9487a-6b74-4c45-9de0-877e9a2960c1 None None] MFA Rules not processed for user `0762ff7131e14f6eb2082dcda14dbf88`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:28.950686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cbb9487a-6b74-4c45-9de0-877e9a2960c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:28.975375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf97ed-572c-4637-bd3b-bf8c5c6b7983 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:28.999452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:29.023077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1072/2106] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:29.027727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9487a-6b74-4c45-9de0-877e9a2960c1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.038730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874de03c-d2b1-4d20-8d71-8d4aaa99a414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:29.039397 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874de03c-d2b1-4d20-8d71-8d4aaa99a414 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.039684 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874de03c-d2b1-4d20-8d71-8d4aaa99a414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.039966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874de03c-d2b1-4d20-8d71-8d4aaa99a414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.040787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874de03c-d2b1-4d20-8d71-8d4aaa99a414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:29.042485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874de03c-d2b1-4d20-8d71-8d4aaa99a414 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:29.056425 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1035/2107] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:29.057486 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874de03c-d2b1-4d20-8d71-8d4aaa99a414 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.067154 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874de03c-d2b1-4d20-8d71-8d4aaa99a414 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:29.071726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0739d-cad2-42b5-b519-f73af0309ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:29.072679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0739d-cad2-42b5-b519-f73af0309ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.072965 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0739d-cad2-42b5-b519-f73af0309ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.073240 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0739d-cad2-42b5-b519-f73af0309ba9 admin admin] PATH_INFO: `/v3/projects/78b7b7070e5d4d73a214a009fa95a603/users/a5fdac072a684b9789963e94b9edf908/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.075188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0739d-cad2-42b5-b519-f73af0309ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b7b7070e5d4d73a214a009fa95a603, user_id=a5fdac072a684b9789963e94b9edf908, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:29.077829 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0739d-cad2-42b5-b519-f73af0309ba9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:29.087868 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1036/2108] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:29 2022] PUT /identity/v3/projects/78b7b7070e5d4d73a214a009fa95a603/users/a5fdac072a684b9789963e94b9edf908/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:29.091550 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9487a-6b74-4c45-9de0-877e9a2960c1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:29.099561 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d6dcd-7d97-4a30-b3f2-0c38e922bda8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.100016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d6dcd-7d97-4a30-b3f2-0c38e922bda8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.100300 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d6dcd-7d97-4a30-b3f2-0c38e922bda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.126560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8f0d6dcd-7d97-4a30-b3f2-0c38e922bda8 None None] MFA Rules not processed for user `a5fdac072a684b9789963e94b9edf908`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:29.127792 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8f0d6dcd-7d97-4a30-b3f2-0c38e922bda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:29.147657 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d1d7-3629-483d-af98-a542e01e30aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:29.148386 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d1d7-3629-483d-af98-a542e01e30aa admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.148671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d1d7-3629-483d-af98-a542e01e30aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.148947 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d1d7-3629-483d-af98-a542e01e30aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.149626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0d1d7-3629-483d-af98-a542e01e30aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:29.151515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0d1d7-3629-483d-af98-a542e01e30aa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:29.197131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1037/2109] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:29.208606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d6dcd-7d97-4a30-b3f2-0c38e922bda8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.210001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8f0d6dcd-7d97-4a30-b3f2-0c38e922bda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:29.266878 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d6dcd-7d97-4a30-b3f2-0c38e922bda8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:29.270514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca612956-f498-4814-8a3e-048df529411e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:29.271161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca612956-f498-4814-8a3e-048df529411e service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.271448 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca612956-f498-4814-8a3e-048df529411e service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.271731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca612956-f498-4814-8a3e-048df529411e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.280919 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca612956-f498-4814-8a3e-048df529411e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:29.282355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca612956-f498-4814-8a3e-048df529411e service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:29.289274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1073/2110] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:29 2022] POST /identity/v3/projects => generated 377 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:29.290296 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d1d7-3629-483d-af98-a542e01e30aa admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.292410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1038/2111] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:29.358504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d1d7-3629-483d-af98-a542e01e30aa admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:29.363241 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd839394-f586-432c-9ec9-d3dd74b5ccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:29.363928 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd839394-f586-432c-9ec9-d3dd74b5ccc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.364223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd839394-f586-432c-9ec9-d3dd74b5ccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.364695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd839394-f586-432c-9ec9-d3dd74b5ccc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.365341 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd839394-f586-432c-9ec9-d3dd74b5ccc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:29.367412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd839394-f586-432c-9ec9-d3dd74b5ccc2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:29.428115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca612956-f498-4814-8a3e-048df529411e service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.438454 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca612956-f498-4814-8a3e-048df529411e service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:29.443101 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12dc29-733a-46a5-bd47-779de7548fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:29.443956 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12dc29-733a-46a5-bd47-779de7548fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.444276 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12dc29-733a-46a5-bd47-779de7548fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.444558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12dc29-733a-46a5-bd47-779de7548fea admin admin] PATH_INFO: `/v3/users/69aabfed13aa476da9321e9923fd9f4c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.445756 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12dc29-733a-46a5-bd47-779de7548fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=69aabfed13aa476da9321e9923fd9f4c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:29.447689 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12dc29-733a-46a5-bd47-779de7548fea admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:29.485436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1074/2112] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:29 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:29.489616 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd839394-f586-432c-9ec9-d3dd74b5ccc2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.499546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd839394-f586-432c-9ec9-d3dd74b5ccc2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:29.504688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb568202-d7ec-4d52-9604-6ed57822a15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:29.505347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb568202-d7ec-4d52-9604-6ed57822a15e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.505629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb568202-d7ec-4d52-9604-6ed57822a15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.505907 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb568202-d7ec-4d52-9604-6ed57822a15e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.506628 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb568202-d7ec-4d52-9604-6ed57822a15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:29.508240 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb568202-d7ec-4d52-9604-6ed57822a15e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:29.519027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1075/2113] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:29.526439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb568202-d7ec-4d52-9604-6ed57822a15e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.536645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb568202-d7ec-4d52-9604-6ed57822a15e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:29.541309 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21055c5-78d5-430d-8e8e-bbc7f726b16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:29.542192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21055c5-78d5-430d-8e8e-bbc7f726b16b admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.542458 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21055c5-78d5-430d-8e8e-bbc7f726b16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.542767 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21055c5-78d5-430d-8e8e-bbc7f726b16b admin admin] PATH_INFO: `/v3/projects/c8bfaf4404ea46bf871a9ecf3c76ae2d/users/bef8c0c83c7b49c4801e2e9c66be77b5/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.558535 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21055c5-78d5-430d-8e8e-bbc7f726b16b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bfaf4404ea46bf871a9ecf3c76ae2d, user_id=bef8c0c83c7b49c4801e2e9c66be77b5, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:29.561268 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21055c5-78d5-430d-8e8e-bbc7f726b16b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:29.624979 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-eb12dc29-733a-46a5-bd47-779de7548fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69aabfed13aa476da9321e9923fd9f4c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.637225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-eb12dc29-733a-46a5-bd47-779de7548fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69aabfed13aa476da9321e9923fd9f4c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.638589 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-eb12dc29-733a-46a5-bd47-779de7548fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69aabfed13aa476da9321e9923fd9f4c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.646623 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-eb12dc29-733a-46a5-bd47-779de7548fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69aabfed13aa476da9321e9923fd9f4c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.647300 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-eb12dc29-733a-46a5-bd47-779de7548fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69aabfed13aa476da9321e9923fd9f4c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:29.701078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1076/2114] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:29 2022] PUT /identity/v3/projects/c8bfaf4404ea46bf871a9ecf3c76ae2d/users/bef8c0c83c7b49c4801e2e9c66be77b5/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:29.705015 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21055c5-78d5-430d-8e8e-bbc7f726b16b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.707164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c21055c5-78d5-430d-8e8e-bbc7f726b16b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:29.768719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21055c5-78d5-430d-8e8e-bbc7f726b16b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:29.773973 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124290d5-6e19-4533-a7c4-b0fab6ed3aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:29.774640 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124290d5-6e19-4533-a7c4-b0fab6ed3aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.774925 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124290d5-6e19-4533-a7c4-b0fab6ed3aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.775363 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124290d5-6e19-4533-a7c4-b0fab6ed3aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.776295 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124290d5-6e19-4533-a7c4-b0fab6ed3aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:29.777951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124290d5-6e19-4533-a7c4-b0fab6ed3aa4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:29.789002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1077/2115] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:29.793076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124290d5-6e19-4533-a7c4-b0fab6ed3aa4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.802861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124290d5-6e19-4533-a7c4-b0fab6ed3aa4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:29.808008 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1039/2116] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:29 2022] DELETE /identity/v3/users/69aabfed13aa476da9321e9923fd9f4c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:29.809657 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca790648-1345-4639-802d-a352b9155baf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.809952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca790648-1345-4639-802d-a352b9155baf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.810286 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca790648-1345-4639-802d-a352b9155baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.834717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ca790648-1345-4639-802d-a352b9155baf None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:29.835971 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ca790648-1345-4639-802d-a352b9155baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:29.864927 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a25410-8fcd-4a2f-ab87-32287233ecf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:29.865820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a25410-8fcd-4a2f-ab87-32287233ecf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.866307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a25410-8fcd-4a2f-ab87-32287233ecf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.866593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a25410-8fcd-4a2f-ab87-32287233ecf3 admin admin] PATH_INFO: `/v3/projects/c8bfaf4404ea46bf871a9ecf3c76ae2d/users/bef8c0c83c7b49c4801e2e9c66be77b5/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.868566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a25410-8fcd-4a2f-ab87-32287233ecf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bfaf4404ea46bf871a9ecf3c76ae2d, user_id=bef8c0c83c7b49c4801e2e9c66be77b5, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:29.871249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a25410-8fcd-4a2f-ab87-32287233ecf3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:29.895354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1078/2117] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:29 2022] PUT /identity/v3/projects/c8bfaf4404ea46bf871a9ecf3c76ae2d/users/bef8c0c83c7b49c4801e2e9c66be77b5/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:29.897770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b7e61-f928-4ae5-ad0c-50763546cc58 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:29.898233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b7e61-f928-4ae5-ad0c-50763546cc58 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:29.898521 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b7e61-f928-4ae5-ad0c-50763546cc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:29.910724 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1040/2118] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:29.927853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca790648-1345-4639-802d-a352b9155baf None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:29.929588 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ca790648-1345-4639-802d-a352b9155baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:29.962481 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d09b7e61-f928-4ae5-ad0c-50763546cc58 None None] MFA Rules not processed for user `bef8c0c83c7b49c4801e2e9c66be77b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:29.962481 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d09b7e61-f928-4ae5-ad0c-50763546cc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:30.013131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca790648-1345-4639-802d-a352b9155baf None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:30.044320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1079/2119] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:30.056497 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b7e61-f928-4ae5-ad0c-50763546cc58 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:30.057959 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d09b7e61-f928-4ae5-ad0c-50763546cc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:30.072882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33229490-e1b8-41b8-bc1a-2a4bc856f4d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:30.073786 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33229490-e1b8-41b8-bc1a-2a4bc856f4d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:30.074224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33229490-e1b8-41b8-bc1a-2a4bc856f4d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:30.074857 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33229490-e1b8-41b8-bc1a-2a4bc856f4d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:30.132922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b7e61-f928-4ae5-ad0c-50763546cc58 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:30.136603 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135db3cb-dce9-4237-816c-c144d0886cd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:30.137278 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135db3cb-dce9-4237-816c-c144d0886cd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:30.137537 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135db3cb-dce9-4237-816c-c144d0886cd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:30.137817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135db3cb-dce9-4237-816c-c144d0886cd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:30.140040 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-135db3cb-dce9-4237-816c-c144d0886cd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:30.156660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33229490-e1b8-41b8-bc1a-2a4bc856f4d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:30.158336 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33229490-e1b8-41b8-bc1a-2a4bc856f4d8 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:30.169342 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1041/2120] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:30.206614 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135db3cb-dce9-4237-816c-c144d0886cd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:30.208236 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135db3cb-dce9-4237-816c-c144d0886cd9 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:30.217700 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1080/2121] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:30.712381 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33229490-e1b8-41b8-bc1a-2a4bc856f4d8 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:30.713826 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-33229490-e1b8-41b8-bc1a-2a4bc856f4d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:30.726691 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33229490-e1b8-41b8-bc1a-2a4bc856f4d8 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:30.731315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:30.732207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:30.732495 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:30.732776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e admin admin] PATH_INFO: `/v3/projects/01c6b314d80847b5a78d2e0c8b7539a5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:30.733985 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c6b314d80847b5a78d2e0c8b7539a5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:30.735886 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:30.910959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c6b314d80847b5a78d2e0c8b7539a5', 'request_id': 'req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:30.916458 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c6b314d80847b5a78d2e0c8b7539a5', 'request_id': 'req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.033140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c6b314d80847b5a78d2e0c8b7539a5', 'request_id': 'req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.050959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e admin admin] The token cache is being invalidate because project 01c6b314d80847b5a78d2e0c8b7539a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:31.050959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.059981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.072070 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1042/2122] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:30 2022] DELETE /identity/v3/projects/01c6b314d80847b5a78d2e0c8b7539a5 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:31.076799 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135db3cb-dce9-4237-816c-c144d0886cd9 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:31.091188 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135db3cb-dce9-4237-816c-c144d0886cd9 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:31.126354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:31.183059 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ecfc8-f7da-4b3c-8b33-ceb0e93b4937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:31.183941 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ecfc8-f7da-4b3c-8b33-ceb0e93b4937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:31.184275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ecfc8-f7da-4b3c-8b33-ceb0e93b4937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:31.184605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ecfc8-f7da-4b3c-8b33-ceb0e93b4937 admin admin] PATH_INFO: `/v3/users/a5fdac072a684b9789963e94b9edf908` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:31.185999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ecfc8-f7da-4b3c-8b33-ceb0e93b4937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fdac072a684b9789963e94b9edf908)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:31.188119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ecfc8-f7da-4b3c-8b33-ceb0e93b4937 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:31.490429 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:31.580845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e07ecfc8-f7da-4b3c-8b33-ceb0e93b4937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fdac072a684b9789963e94b9edf908'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.581564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e07ecfc8-f7da-4b3c-8b33-ceb0e93b4937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fdac072a684b9789963e94b9edf908'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.717898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e07ecfc8-f7da-4b3c-8b33-ceb0e93b4937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fdac072a684b9789963e94b9edf908'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.725710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e07ecfc8-f7da-4b3c-8b33-ceb0e93b4937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fdac072a684b9789963e94b9edf908'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.726335 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e07ecfc8-f7da-4b3c-8b33-ceb0e93b4937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fdac072a684b9789963e94b9edf908'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:31.743785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1081/2123] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:31 2022] DELETE /identity/v3/users/a5fdac072a684b9789963e94b9edf908 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:32.270416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:32.272286 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:32.302917 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341307a-2a1d-4b1a-8ba4-6bb4643ac79e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:32.384492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362c645-2f70-4c43-ac18-2a786d468974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:32.385633 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c645-2f70-4c43-ac18-2a786d468974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:32.386084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c645-2f70-4c43-ac18-2a786d468974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:32.386713 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362c645-2f70-4c43-ac18-2a786d468974 admin admin] PATH_INFO: `/v3/projects/78b7b7070e5d4d73a214a009fa95a603` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:32.388252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362c645-2f70-4c43-ac18-2a786d468974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b7b7070e5d4d73a214a009fa95a603)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:32.392677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362c645-2f70-4c43-ac18-2a786d468974 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:32.474154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ecfc8-f7da-4b3c-8b33-ceb0e93b4937 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:32.475676 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e07ecfc8-f7da-4b3c-8b33-ceb0e93b4937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:32.528078 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3362c645-2f70-4c43-ac18-2a786d468974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b7b7070e5d4d73a214a009fa95a603', 'request_id': 'req-3362c645-2f70-4c43-ac18-2a786d468974'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.534818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3362c645-2f70-4c43-ac18-2a786d468974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b7b7070e5d4d73a214a009fa95a603', 'request_id': 'req-3362c645-2f70-4c43-ac18-2a786d468974'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.535958 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ecfc8-f7da-4b3c-8b33-ceb0e93b4937 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:32.584592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b6105-f3ff-4ddd-8f4d-3ccba7002d58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:32.585244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b6105-f3ff-4ddd-8f4d-3ccba7002d58 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:32.585534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b6105-f3ff-4ddd-8f4d-3ccba7002d58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:32.585825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b6105-f3ff-4ddd-8f4d-3ccba7002d58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:32.587633 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-059b6105-f3ff-4ddd-8f4d-3ccba7002d58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:32.621180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3362c645-2f70-4c43-ac18-2a786d468974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b7b7070e5d4d73a214a009fa95a603', 'request_id': 'req-3362c645-2f70-4c43-ac18-2a786d468974'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.633677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3362c645-2f70-4c43-ac18-2a786d468974 admin admin] The token cache is being invalidate because project 78b7b7070e5d4d73a214a009fa95a603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:32.633973 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3362c645-2f70-4c43-ac18-2a786d468974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.634635 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3362c645-2f70-4c43-ac18-2a786d468974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:32.636238 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1043/2124] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:32 2022] DELETE /identity/v3/projects/78b7b7070e5d4d73a214a009fa95a603 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:32.641145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8baff-1c28-4045-833f-d65babd47539 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:32.641442 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8baff-1c28-4045-833f-d65babd47539 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:32.641728 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8baff-1c28-4045-833f-d65babd47539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:32.648008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b6105-f3ff-4ddd-8f4d-3ccba7002d58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:32.649466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b6105-f3ff-4ddd-8f4d-3ccba7002d58 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:32.659086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1082/2125] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:32.662234 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-97b8baff-1c28-4045-833f-d65babd47539 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:32.663429 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-97b8baff-1c28-4045-833f-d65babd47539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:32.722282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1044/2126] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:32.731146 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732499f-2a4c-4089-bf21-cd544b5dd65d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:32.731443 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732499f-2a4c-4089-bf21-cd544b5dd65d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:32.731761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732499f-2a4c-4089-bf21-cd544b5dd65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:32.750086 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6732499f-2a4c-4089-bf21-cd544b5dd65d None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:32.751235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6732499f-2a4c-4089-bf21-cd544b5dd65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:32.759174 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1083/2127] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:32.763442 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8baff-1c28-4045-833f-d65babd47539 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:32.773450 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8baff-1c28-4045-833f-d65babd47539 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:32.778053 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628bc5-3e0e-4759-8711-6ce7c74c1445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:32.778722 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628bc5-3e0e-4759-8711-6ce7c74c1445 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:32.778992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628bc5-3e0e-4759-8711-6ce7c74c1445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:32.779273 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da628bc5-3e0e-4759-8711-6ce7c74c1445 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:32.780002 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da628bc5-3e0e-4759-8711-6ce7c74c1445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:32.780329 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da628bc5-3e0e-4759-8711-6ce7c74c1445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:32.781965 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da628bc5-3e0e-4759-8711-6ce7c74c1445 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:32.793955 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1045/2128] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:32.798234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732499f-2a4c-4089-bf21-cd544b5dd65d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:32.808002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732499f-2a4c-4089-bf21-cd544b5dd65d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:32.812677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9c710-c1c2-40eb-891b-2e674fff573d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:32.813352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9c710-c1c2-40eb-891b-2e674fff573d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:32.813639 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9c710-c1c2-40eb-891b-2e674fff573d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:32.813919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9c710-c1c2-40eb-891b-2e674fff573d admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:32.814633 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9c710-c1c2-40eb-891b-2e674fff573d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:32.816619 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9c710-c1c2-40eb-891b-2e674fff573d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:32.931627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1084/2129] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:32 2022] POST /identity/v3/projects => generated 363 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:32.937543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628bc5-3e0e-4759-8711-6ce7c74c1445 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:32.948523 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da628bc5-3e0e-4759-8711-6ce7c74c1445 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.007782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66370b-a257-460d-a67e-1d497130500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.008500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66370b-a257-460d-a67e-1d497130500f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.008787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66370b-a257-460d-a67e-1d497130500f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.009209 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66370b-a257-460d-a67e-1d497130500f admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.009872 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66370b-a257-460d-a67e-1d497130500f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.014727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66370b-a257-460d-a67e-1d497130500f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:33.182854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:33.193257 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1046/2130] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:32 2022] POST /identity/v3/users => generated 282 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:33.203376 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9c710-c1c2-40eb-891b-2e674fff573d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.204994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9c710-c1c2-40eb-891b-2e674fff573d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.210064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d89423-598e-4f1c-80aa-6ae0b4c7e395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.210747 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d89423-598e-4f1c-80aa-6ae0b4c7e395 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.211034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d89423-598e-4f1c-80aa-6ae0b4c7e395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.211310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d89423-598e-4f1c-80aa-6ae0b4c7e395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.212067 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d89423-598e-4f1c-80aa-6ae0b4c7e395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.213697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d89423-598e-4f1c-80aa-6ae0b4c7e395 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:33.224659 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1085/2131] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:33.228809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66370b-a257-460d-a67e-1d497130500f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.238759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66370b-a257-460d-a67e-1d497130500f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.243368 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32112b-7097-4e41-a643-6a75447aae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.249195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32112b-7097-4e41-a643-6a75447aae87 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.249195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32112b-7097-4e41-a643-6a75447aae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.249195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32112b-7097-4e41-a643-6a75447aae87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.249195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32112b-7097-4e41-a643-6a75447aae87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.249195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32112b-7097-4e41-a643-6a75447aae87 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:33.256569 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1047/2132] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:33.260489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d89423-598e-4f1c-80aa-6ae0b4c7e395 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.270920 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d89423-598e-4f1c-80aa-6ae0b4c7e395 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.275395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d1888-8df8-40d7-95cb-3a35c1082503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.276296 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d1888-8df8-40d7-95cb-3a35c1082503 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.276765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d1888-8df8-40d7-95cb-3a35c1082503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.276952 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d1888-8df8-40d7-95cb-3a35c1082503 admin admin] PATH_INFO: `/v3/projects/f5fcc21393d6483194dd4d321197cde1/users/4c312ba1385f470cbedd4fe9bee0f1d7/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.295701 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d1888-8df8-40d7-95cb-3a35c1082503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5fcc21393d6483194dd4d321197cde1, user_id=4c312ba1385f470cbedd4fe9bee0f1d7, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.295805 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d1888-8df8-40d7-95cb-3a35c1082503 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:33.517260 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1086/2133] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:33 2022] PUT /identity/v3/projects/f5fcc21393d6483194dd4d321197cde1/users/4c312ba1385f470cbedd4fe9bee0f1d7/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:33.528168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b123737-85a3-4274-8ec7-bcfc890005c7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.528666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b123737-85a3-4274-8ec7-bcfc890005c7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.528777 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b123737-85a3-4274-8ec7-bcfc890005c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.568042 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8b123737-85a3-4274-8ec7-bcfc890005c7 None None] MFA Rules not processed for user `4c312ba1385f470cbedd4fe9bee0f1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:33.569538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8b123737-85a3-4274-8ec7-bcfc890005c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:33.639513 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1048/2134] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:33.644783 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d1888-8df8-40d7-95cb-3a35c1082503 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.706872 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d1888-8df8-40d7-95cb-3a35c1082503 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.712444 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4eb8b1-ad3d-4feb-8770-c7ea2943004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.713165 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4eb8b1-ad3d-4feb-8770-c7ea2943004b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.713567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4eb8b1-ad3d-4feb-8770-c7ea2943004b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.713906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4eb8b1-ad3d-4feb-8770-c7ea2943004b admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.714801 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4eb8b1-ad3d-4feb-8770-c7ea2943004b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.716752 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4eb8b1-ad3d-4feb-8770-c7ea2943004b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:33.863243 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1087/2135] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:33 2022] POST /identity/v3/projects => generated 365 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:33.866833 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b123737-85a3-4274-8ec7-bcfc890005c7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:33.878380 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b123737-85a3-4274-8ec7-bcfc890005c7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:33.935183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c295692-4a9f-429e-ade3-1577643759c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:33.935854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c295692-4a9f-429e-ade3-1577643759c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:33.936231 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c295692-4a9f-429e-ade3-1577643759c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:33.936519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c295692-4a9f-429e-ade3-1577643759c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:33.937275 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c295692-4a9f-429e-ade3-1577643759c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:33.939287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c295692-4a9f-429e-ade3-1577643759c3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:34.082757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1049/2136] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:33 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:34.084276 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4eb8b1-ad3d-4feb-8770-c7ea2943004b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:34.094664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4eb8b1-ad3d-4feb-8770-c7ea2943004b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:34.099791 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7c404-af48-4866-af0a-de009be96f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:34.100492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7c404-af48-4866-af0a-de009be96f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.100776 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7c404-af48-4866-af0a-de009be96f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.101056 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7c404-af48-4866-af0a-de009be96f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.101779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7c404-af48-4866-af0a-de009be96f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:34.103377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7c404-af48-4866-af0a-de009be96f17 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:34.124269 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1088/2137] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:34.128905 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c295692-4a9f-429e-ade3-1577643759c3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:34.142083 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c295692-4a9f-429e-ade3-1577643759c3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:34.149490 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a9da7-4edc-4c7a-9452-ec86688bfdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:34.150009 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a9da7-4edc-4c7a-9452-ec86688bfdff admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.150297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a9da7-4edc-4c7a-9452-ec86688bfdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.150578 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a9da7-4edc-4c7a-9452-ec86688bfdff admin admin] PATH_INFO: `/v3/projects/56cb31b3c47349b294cd3ad614e2eae7/users/517a2e4fa477472c9172293e1ce6c55c/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.171169 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a9da7-4edc-4c7a-9452-ec86688bfdff admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cb31b3c47349b294cd3ad614e2eae7, user_id=517a2e4fa477472c9172293e1ce6c55c, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:34.175579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a9da7-4edc-4c7a-9452-ec86688bfdff admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:34.389802 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1050/2138] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:34 2022] PUT /identity/v3/projects/56cb31b3c47349b294cd3ad614e2eae7/users/517a2e4fa477472c9172293e1ce6c55c/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:34.391073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7c404-af48-4866-af0a-de009be96f17 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:34.402997 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7c404-af48-4866-af0a-de009be96f17 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:34.458338 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46714871-eb68-4c75-ae1a-bb38e8915de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:34.458999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46714871-eb68-4c75-ae1a-bb38e8915de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.459285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46714871-eb68-4c75-ae1a-bb38e8915de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.459567 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46714871-eb68-4c75-ae1a-bb38e8915de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.460322 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46714871-eb68-4c75-ae1a-bb38e8915de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:34.461918 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46714871-eb68-4c75-ae1a-bb38e8915de1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:34.472245 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1089/2139] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:34.476373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a9da7-4edc-4c7a-9452-ec86688bfdff admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:34.486732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a9da7-4edc-4c7a-9452-ec86688bfdff admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:34.491253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325a473-f1ce-4f51-a979-b5001ca52ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:34.492193 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325a473-f1ce-4f51-a979-b5001ca52ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.492480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325a473-f1ce-4f51-a979-b5001ca52ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.492763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325a473-f1ce-4f51-a979-b5001ca52ee8 admin admin] PATH_INFO: `/v3/projects/56cb31b3c47349b294cd3ad614e2eae7/users/517a2e4fa477472c9172293e1ce6c55c/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.494748 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325a473-f1ce-4f51-a979-b5001ca52ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cb31b3c47349b294cd3ad614e2eae7, user_id=517a2e4fa477472c9172293e1ce6c55c, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:34.497428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325a473-f1ce-4f51-a979-b5001ca52ee8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:34.507392 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1051/2140] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:34 2022] PUT /identity/v3/projects/56cb31b3c47349b294cd3ad614e2eae7/users/517a2e4fa477472c9172293e1ce6c55c/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:34.519579 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0a0a1-612e-4634-bc1c-544dedd735d2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.520091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0a0a1-612e-4634-bc1c-544dedd735d2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.520183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0a0a1-612e-4634-bc1c-544dedd735d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.547559 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-edd0a0a1-612e-4634-bc1c-544dedd735d2 None None] MFA Rules not processed for user `517a2e4fa477472c9172293e1ce6c55c`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:34.548975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-edd0a0a1-612e-4634-bc1c-544dedd735d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:34.615210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1090/2141] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:34.806950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325a473-f1ce-4f51-a979-b5001ca52ee8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:34.808818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d325a473-f1ce-4f51-a979-b5001ca52ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:34.868121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325a473-f1ce-4f51-a979-b5001ca52ee8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:34.872283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac7244-8e9e-49e9-aca4-dee75bb3ead6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:34.873283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac7244-8e9e-49e9-aca4-dee75bb3ead6 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:34.873569 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac7244-8e9e-49e9-aca4-dee75bb3ead6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:34.873851 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac7244-8e9e-49e9-aca4-dee75bb3ead6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:34.884217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac7244-8e9e-49e9-aca4-dee75bb3ead6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:34.885594 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac7244-8e9e-49e9-aca4-dee75bb3ead6 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:34.895609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1052/2142] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:35.057333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0a0a1-612e-4634-bc1c-544dedd735d2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:35.058766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-edd0a0a1-612e-4634-bc1c-544dedd735d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:35.070960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0a0a1-612e-4634-bc1c-544dedd735d2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:35.074608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd0668-8a84-41b4-85e5-c1045ee5f4ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:35.075251 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd0668-8a84-41b4-85e5-c1045ee5f4ab service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.075543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd0668-8a84-41b4-85e5-c1045ee5f4ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.075827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd0668-8a84-41b4-85e5-c1045ee5f4ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.077602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a9fd0668-8a84-41b4-85e5-c1045ee5f4ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:35.140939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd0668-8a84-41b4-85e5-c1045ee5f4ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:35.143722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd0668-8a84-41b4-85e5-c1045ee5f4ab service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:35.153118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1091/2143] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:35.231624 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac7244-8e9e-49e9-aca4-dee75bb3ead6 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:35.241757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac7244-8e9e-49e9-aca4-dee75bb3ead6 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:35.245451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa70e8-3f75-4403-b705-0aa5dcfa9605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:35.246090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa70e8-3f75-4403-b705-0aa5dcfa9605 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.246373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa70e8-3f75-4403-b705-0aa5dcfa9605 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.246651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa70e8-3f75-4403-b705-0aa5dcfa9605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.312726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa70e8-3f75-4403-b705-0aa5dcfa9605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:35.314252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa70e8-3f75-4403-b705-0aa5dcfa9605 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:35.326045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1053/2144] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:35.330156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:35.506551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e98534-30b5-43dd-a5e3-55a8107daebc None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.506851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e98534-30b5-43dd-a5e3-55a8107daebc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.507139 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e98534-30b5-43dd-a5e3-55a8107daebc None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.508572 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1092/2145] 10.222.0.50 () {54 vars in 921 bytes} [Thu Jun 2 16:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 16:07:35.533312 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93308dca-79c5-4131-97e4-4719f97b06d4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.533654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93308dca-79c5-4131-97e4-4719f97b06d4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.533941 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93308dca-79c5-4131-97e4-4719f97b06d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.565739 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-93308dca-79c5-4131-97e4-4719f97b06d4 None None] MFA Rules not processed for user `8d60a2abffc04ba59b65d5fca5e318a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:35.565739 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-93308dca-79c5-4131-97e4-4719f97b06d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:35.646759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1054/2146] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Jun 2 16:07:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:35.669752 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e98534-30b5-43dd-a5e3-55a8107daebc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:35.673507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-72e98534-30b5-43dd-a5e3-55a8107daebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:35.693102 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e98534-30b5-43dd-a5e3-55a8107daebc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:35.698331 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810f8e2-47be-4e14-8b14-ae842ee65c6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60a2abffc04ba59b65d5fca5e318a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:35.698987 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810f8e2-47be-4e14-8b14-ae842ee65c6b service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:35.699278 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810f8e2-47be-4e14-8b14-ae842ee65c6b service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:35.699569 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810f8e2-47be-4e14-8b14-ae842ee65c6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:35.708771 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810f8e2-47be-4e14-8b14-ae842ee65c6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:35.710361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810f8e2-47be-4e14-8b14-ae842ee65c6b service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:35.720658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1093/2147] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:36.451786 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93308dca-79c5-4131-97e4-4719f97b06d4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:36.453931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-93308dca-79c5-4131-97e4-4719f97b06d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:36.524817 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93308dca-79c5-4131-97e4-4719f97b06d4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:36.529523 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6a045-97ee-4665-8a63-35ee4f41da4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:36.530428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6a045-97ee-4665-8a63-35ee4f41da4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:36.530714 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6a045-97ee-4665-8a63-35ee4f41da4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:36.530997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6a045-97ee-4665-8a63-35ee4f41da4f admin admin] PATH_INFO: `/v3/users/b4fc5b03167f49509cfa8354587d3048` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:36.532237 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6a045-97ee-4665-8a63-35ee4f41da4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4fc5b03167f49509cfa8354587d3048)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:36.534863 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6a045-97ee-4665-8a63-35ee4f41da4f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:36.561674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:36.783398 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbc6a045-97ee-4665-8a63-35ee4f41da4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4fc5b03167f49509cfa8354587d3048'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:36.795363 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbc6a045-97ee-4665-8a63-35ee4f41da4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4fc5b03167f49509cfa8354587d3048'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:36.796161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbc6a045-97ee-4665-8a63-35ee4f41da4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4fc5b03167f49509cfa8354587d3048'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:36.803458 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbc6a045-97ee-4665-8a63-35ee4f41da4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4fc5b03167f49509cfa8354587d3048'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:36.804179 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbc6a045-97ee-4665-8a63-35ee4f41da4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4fc5b03167f49509cfa8354587d3048'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:36.928412 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1055/2148] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:36 2022] DELETE /identity/v3/users/b4fc5b03167f49509cfa8354587d3048 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:37.440808 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810f8e2-47be-4e14-8b14-ae842ee65c6b service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:37.468079 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810f8e2-47be-4e14-8b14-ae842ee65c6b service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:37.528864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f549a7-7009-4051-bb32-b9555002cc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:37.529734 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f549a7-7009-4051-bb32-b9555002cc36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.530023 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f549a7-7009-4051-bb32-b9555002cc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.530307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f549a7-7009-4051-bb32-b9555002cc36 admin admin] PATH_INFO: `/v3/projects/9b919a573415476b88b1761ccc01073c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.531498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f549a7-7009-4051-bb32-b9555002cc36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b919a573415476b88b1761ccc01073c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:37.533464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f549a7-7009-4051-bb32-b9555002cc36 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:37.672745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b7f549a7-7009-4051-bb32-b9555002cc36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b919a573415476b88b1761ccc01073c', 'request_id': 'req-b7f549a7-7009-4051-bb32-b9555002cc36'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:37.778853 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b7f549a7-7009-4051-bb32-b9555002cc36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b919a573415476b88b1761ccc01073c', 'request_id': 'req-b7f549a7-7009-4051-bb32-b9555002cc36'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:37.787311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b7f549a7-7009-4051-bb32-b9555002cc36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b919a573415476b88b1761ccc01073c', 'request_id': 'req-b7f549a7-7009-4051-bb32-b9555002cc36'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:37.799847 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b7f549a7-7009-4051-bb32-b9555002cc36 admin admin] The token cache is being invalidate because project 9b919a573415476b88b1761ccc01073c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:37.800175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b7f549a7-7009-4051-bb32-b9555002cc36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:37.800843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b7f549a7-7009-4051-bb32-b9555002cc36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:37.802444 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1094/2149] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:37 2022] DELETE /identity/v3/projects/9b919a573415476b88b1761ccc01073c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:37.806471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6a045-97ee-4665-8a63-35ee4f41da4f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:37.807875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dbc6a045-97ee-4665-8a63-35ee4f41da4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:37.821215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6a045-97ee-4665-8a63-35ee4f41da4f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:37.876655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434f599-0d7e-4acf-94de-ec13b8c8cf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:37.877487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f599-0d7e-4acf-94de-ec13b8c8cf6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:37.877778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f599-0d7e-4acf-94de-ec13b8c8cf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:37.878063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f599-0d7e-4acf-94de-ec13b8c8cf6b admin admin] PATH_INFO: `/v3/users/c79651c0208548c097831828fef957db` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:37.879266 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434f599-0d7e-4acf-94de-ec13b8c8cf6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79651c0208548c097831828fef957db)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:37.881237 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434f599-0d7e-4acf-94de-ec13b8c8cf6b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:38.089316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8434f599-0d7e-4acf-94de-ec13b8c8cf6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79651c0208548c097831828fef957db'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:38.101469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8434f599-0d7e-4acf-94de-ec13b8c8cf6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79651c0208548c097831828fef957db'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:38.102187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8434f599-0d7e-4acf-94de-ec13b8c8cf6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79651c0208548c097831828fef957db'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:38.110625 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8434f599-0d7e-4acf-94de-ec13b8c8cf6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79651c0208548c097831828fef957db'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:38.110625 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8434f599-0d7e-4acf-94de-ec13b8c8cf6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79651c0208548c097831828fef957db'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:38.284533 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1056/2150] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:37 2022] DELETE /identity/v3/users/c79651c0208548c097831828fef957db => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:38.326872 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:38.560053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f549a7-7009-4051-bb32-b9555002cc36 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:38.561673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b7f549a7-7009-4051-bb32-b9555002cc36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:38.581070 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f549a7-7009-4051-bb32-b9555002cc36 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:38.643187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86794749-7eaa-451a-aa33-3102efcff836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:38.644128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86794749-7eaa-451a-aa33-3102efcff836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:38.644441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86794749-7eaa-451a-aa33-3102efcff836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:38.644770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86794749-7eaa-451a-aa33-3102efcff836 admin admin] PATH_INFO: `/v3/projects/057b636838734b9fab27c5094ec61a31` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:38.645923 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86794749-7eaa-451a-aa33-3102efcff836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=057b636838734b9fab27c5094ec61a31)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:38.647922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86794749-7eaa-451a-aa33-3102efcff836 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:38.678929 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:38.809661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-86794749-7eaa-451a-aa33-3102efcff836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '057b636838734b9fab27c5094ec61a31', 'request_id': 'req-86794749-7eaa-451a-aa33-3102efcff836'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:38.985415 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-86794749-7eaa-451a-aa33-3102efcff836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '057b636838734b9fab27c5094ec61a31', 'request_id': 'req-86794749-7eaa-451a-aa33-3102efcff836'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:38.992794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-86794749-7eaa-451a-aa33-3102efcff836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '057b636838734b9fab27c5094ec61a31', 'request_id': 'req-86794749-7eaa-451a-aa33-3102efcff836'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:39.004047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-86794749-7eaa-451a-aa33-3102efcff836 admin admin] The token cache is being invalidate because project 057b636838734b9fab27c5094ec61a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:39.004345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-86794749-7eaa-451a-aa33-3102efcff836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:39.005000 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-86794749-7eaa-451a-aa33-3102efcff836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:39.010102 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1095/2151] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:38 2022] DELETE /identity/v3/projects/057b636838734b9fab27c5094ec61a31 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:39.011704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fac42-61bb-4c3a-a46c-1e536561f3d3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:39.012139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fac42-61bb-4c3a-a46c-1e536561f3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:39.012457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fac42-61bb-4c3a-a46c-1e536561f3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:39.034583 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-909fac42-61bb-4c3a-a46c-1e536561f3d3 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:39.036391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-909fac42-61bb-4c3a-a46c-1e536561f3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:39.103612 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1057/2152] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:39.112427 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6788b46-a268-4683-9d83-bafe303d805f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:39.112725 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6788b46-a268-4683-9d83-bafe303d805f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:39.113178 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6788b46-a268-4683-9d83-bafe303d805f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:39.132733 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e6788b46-a268-4683-9d83-bafe303d805f None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:39.133947 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e6788b46-a268-4683-9d83-bafe303d805f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:39.143640 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1096/2153] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:39.148195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fac42-61bb-4c3a-a46c-1e536561f3d3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:39.158215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fac42-61bb-4c3a-a46c-1e536561f3d3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:39.162952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300c24d-4939-4baa-bf4a-9ea0675a6863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:39.163593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300c24d-4939-4baa-bf4a-9ea0675a6863 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:39.163879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300c24d-4939-4baa-bf4a-9ea0675a6863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:39.164192 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300c24d-4939-4baa-bf4a-9ea0675a6863 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:39.165175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300c24d-4939-4baa-bf4a-9ea0675a6863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:39.165489 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300c24d-4939-4baa-bf4a-9ea0675a6863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:39.167211 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300c24d-4939-4baa-bf4a-9ea0675a6863 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:39.179012 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1058/2154] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:39.183513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6788b46-a268-4683-9d83-bafe303d805f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:39.193375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6788b46-a268-4683-9d83-bafe303d805f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:39.198943 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fa6a6-233e-43ad-98a9-ee1573a27317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:39.199602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fa6a6-233e-43ad-98a9-ee1573a27317 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:39.199905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fa6a6-233e-43ad-98a9-ee1573a27317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:39.202519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fa6a6-233e-43ad-98a9-ee1573a27317 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:39.202519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fa6a6-233e-43ad-98a9-ee1573a27317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:39.202854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fa6a6-233e-43ad-98a9-ee1573a27317 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:39.382910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1097/2155] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:39 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:39.387068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300c24d-4939-4baa-bf4a-9ea0675a6863 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:39.397999 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300c24d-4939-4baa-bf4a-9ea0675a6863 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:39.456236 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871006f-034a-4763-857f-1d3536c27609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:39.457063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871006f-034a-4763-857f-1d3536c27609 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:39.457274 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871006f-034a-4763-857f-1d3536c27609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:39.457561 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871006f-034a-4763-857f-1d3536c27609 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:39.458265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871006f-034a-4763-857f-1d3536c27609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:39.460299 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871006f-034a-4763-857f-1d3536c27609 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:39.619845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1059/2156] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:39 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:39.621333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fa6a6-233e-43ad-98a9-ee1573a27317 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:39.635358 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fa6a6-233e-43ad-98a9-ee1573a27317 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:39.640641 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eb0f8-a5ac-4bed-9b56-0b9404c7c563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:39.641447 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eb0f8-a5ac-4bed-9b56-0b9404c7c563 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:39.641731 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eb0f8-a5ac-4bed-9b56-0b9404c7c563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:39.642237 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eb0f8-a5ac-4bed-9b56-0b9404c7c563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:39.643003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914eb0f8-a5ac-4bed-9b56-0b9404c7c563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:39.644692 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914eb0f8-a5ac-4bed-9b56-0b9404c7c563 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:39.655661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1098/2157] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:39.660839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871006f-034a-4763-857f-1d3536c27609 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:39.672087 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871006f-034a-4763-857f-1d3536c27609 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:39.678363 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965eab4a-2869-4304-826d-a29c605842b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:39.679511 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eab4a-2869-4304-826d-a29c605842b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:39.680163 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eab4a-2869-4304-826d-a29c605842b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:39.680667 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eab4a-2869-4304-826d-a29c605842b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:39.681681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965eab4a-2869-4304-826d-a29c605842b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:39.683660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965eab4a-2869-4304-826d-a29c605842b6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:39.696661 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1060/2158] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:39.699905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eb0f8-a5ac-4bed-9b56-0b9404c7c563 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:39.710985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eb0f8-a5ac-4bed-9b56-0b9404c7c563 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:39.715832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69636b84-ac19-469d-aeef-778a8b3a5b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:39.716795 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69636b84-ac19-469d-aeef-778a8b3a5b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:39.717085 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69636b84-ac19-469d-aeef-778a8b3a5b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:39.717972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69636b84-ac19-469d-aeef-778a8b3a5b2c admin admin] PATH_INFO: `/v3/projects/ecad3608e62349dca9f7338d9e1679fb/users/b309e382c8b04a138c683fa1aba10c4d/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:39.733082 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69636b84-ac19-469d-aeef-778a8b3a5b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecad3608e62349dca9f7338d9e1679fb, user_id=b309e382c8b04a138c683fa1aba10c4d, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:39.735885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69636b84-ac19-469d-aeef-778a8b3a5b2c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:39.866273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1099/2159] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:39 2022] PUT /identity/v3/projects/ecad3608e62349dca9f7338d9e1679fb/users/b309e382c8b04a138c683fa1aba10c4d/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:39.876648 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c60d1-6889-4b3c-8230-3e99701f53d5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:39.876972 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c60d1-6889-4b3c-8230-3e99701f53d5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:39.877257 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c60d1-6889-4b3c-8230-3e99701f53d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:39.905327 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b58c60d1-6889-4b3c-8230-3e99701f53d5 None None] MFA Rules not processed for user `b309e382c8b04a138c683fa1aba10c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:39.906986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b58c60d1-6889-4b3c-8230-3e99701f53d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:39.973482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1061/2160] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:40.017714 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69636b84-ac19-469d-aeef-778a8b3a5b2c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:40.019476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-69636b84-ac19-469d-aeef-778a8b3a5b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:40.077178 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69636b84-ac19-469d-aeef-778a8b3a5b2c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:40.080828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ff6fb-2b87-44b9-ad09-44705b126792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:40.081472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ff6fb-2b87-44b9-ad09-44705b126792 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:40.081761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ff6fb-2b87-44b9-ad09-44705b126792 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:40.082153 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ff6fb-2b87-44b9-ad09-44705b126792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:40.090314 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ff6fb-2b87-44b9-ad09-44705b126792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:40.091743 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ff6fb-2b87-44b9-ad09-44705b126792 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:40.102662 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1100/2161] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:40.124125 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:41.315578 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c60d1-6889-4b3c-8230-3e99701f53d5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:41.317215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b58c60d1-6889-4b3c-8230-3e99701f53d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:41.434655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c60d1-6889-4b3c-8230-3e99701f53d5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:41.440175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d12da-2ec4-4858-8e2a-100f63bb5bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:41.441053 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d12da-2ec4-4858-8e2a-100f63bb5bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:41.441617 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d12da-2ec4-4858-8e2a-100f63bb5bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:41.442135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d12da-2ec4-4858-8e2a-100f63bb5bb6 admin admin] PATH_INFO: `/v3/users/4fcb857bf24348f3a20dc5127afadefe` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:41.444242 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d12da-2ec4-4858-8e2a-100f63bb5bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fcb857bf24348f3a20dc5127afadefe)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:41.446163 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d12da-2ec4-4858-8e2a-100f63bb5bb6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:41.460091 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:41.562478 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ff6fb-2b87-44b9-ad09-44705b126792 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:41.565163 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a72ff6fb-2b87-44b9-ad09-44705b126792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:41.597085 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ff6fb-2b87-44b9-ad09-44705b126792 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:41.603877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde728b-2813-4437-98e2-885db58c07f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:41.605420 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde728b-2813-4437-98e2-885db58c07f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:41.605957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde728b-2813-4437-98e2-885db58c07f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:41.606401 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde728b-2813-4437-98e2-885db58c07f2 admin admin] PATH_INFO: `/v3/users/a2c33e28328f4cf181c9b21946c7e5a6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:41.607789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde728b-2813-4437-98e2-885db58c07f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c33e28328f4cf181c9b21946c7e5a6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:41.609821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde728b-2813-4437-98e2-885db58c07f2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:41.695497 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2b1d12da-2ec4-4858-8e2a-100f63bb5bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fcb857bf24348f3a20dc5127afadefe'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:41.709529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:41.709802 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2b1d12da-2ec4-4858-8e2a-100f63bb5bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fcb857bf24348f3a20dc5127afadefe'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:41.710818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2b1d12da-2ec4-4858-8e2a-100f63bb5bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fcb857bf24348f3a20dc5127afadefe'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:41.718843 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2b1d12da-2ec4-4858-8e2a-100f63bb5bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fcb857bf24348f3a20dc5127afadefe'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:41.719535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2b1d12da-2ec4-4858-8e2a-100f63bb5bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fcb857bf24348f3a20dc5127afadefe'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:41.825951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1062/2162] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:41 2022] DELETE /identity/v3/users/4fcb857bf24348f3a20dc5127afadefe => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:41.830430 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0b776-3d1d-4731-bc92-ec9c8886a849 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:41.830726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0b776-3d1d-4731-bc92-ec9c8886a849 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:41.831011 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0b776-3d1d-4731-bc92-ec9c8886a849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:41.835320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bbde728b-2813-4437-98e2-885db58c07f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c33e28328f4cf181c9b21946c7e5a6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:41.836851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bbde728b-2813-4437-98e2-885db58c07f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c33e28328f4cf181c9b21946c7e5a6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:41.849141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-23e0b776-3d1d-4731-bc92-ec9c8886a849 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:41.850700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-23e0b776-3d1d-4731-bc92-ec9c8886a849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:41.910509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1063/2163] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:41.919743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0b776-3d1d-4731-bc92-ec9c8886a849 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:41.921197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-23e0b776-3d1d-4731-bc92-ec9c8886a849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:41.942151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bbde728b-2813-4437-98e2-885db58c07f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c33e28328f4cf181c9b21946c7e5a6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:41.954515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bbde728b-2813-4437-98e2-885db58c07f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c33e28328f4cf181c9b21946c7e5a6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:41.955242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-bbde728b-2813-4437-98e2-885db58c07f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c33e28328f4cf181c9b21946c7e5a6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:41.975822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1101/2164] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:41 2022] DELETE /identity/v3/users/a2c33e28328f4cf181c9b21946c7e5a6 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:41.980320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f948e95-cdbe-4f6d-90e6-e0bf399aec2b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:41.980831 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f948e95-cdbe-4f6d-90e6-e0bf399aec2b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:41.981316 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f948e95-cdbe-4f6d-90e6-e0bf399aec2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:42.001167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2f948e95-cdbe-4f6d-90e6-e0bf399aec2b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:42.003939 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2f948e95-cdbe-4f6d-90e6-e0bf399aec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:42.061434 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0b776-3d1d-4731-bc92-ec9c8886a849 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:42.105818 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1102/2165] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:42.116780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f948e95-cdbe-4f6d-90e6-e0bf399aec2b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:42.138324 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6646e-9033-46fb-b0bc-5d965a66265c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:42.139304 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6646e-9033-46fb-b0bc-5d965a66265c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:42.139659 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6646e-9033-46fb-b0bc-5d965a66265c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:42.140529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6646e-9033-46fb-b0bc-5d965a66265c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:42.160748 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6646e-9033-46fb-b0bc-5d965a66265c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:42.162349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6646e-9033-46fb-b0bc-5d965a66265c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:42.173121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1064/2166] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:42.175027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f948e95-cdbe-4f6d-90e6-e0bf399aec2b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:42.178962 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0152fa7-064e-4953-9dd9-e567e3dabcfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:42.179722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0152fa7-064e-4953-9dd9-e567e3dabcfc service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:42.180196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0152fa7-064e-4953-9dd9-e567e3dabcfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:42.180485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0152fa7-064e-4953-9dd9-e567e3dabcfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:42.191112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0152fa7-064e-4953-9dd9-e567e3dabcfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:42.192603 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0152fa7-064e-4953-9dd9-e567e3dabcfc service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:42.207029 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1103/2167] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:42.768156 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6646e-9033-46fb-b0bc-5d965a66265c service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:42.769848 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-21a6646e-9033-46fb-b0bc-5d965a66265c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:42.783262 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6646e-9033-46fb-b0bc-5d965a66265c service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:42.788267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:42.789112 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:42.789404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:42.789687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634 admin admin] PATH_INFO: `/v3/projects/b99a8142479745999b1c3511cb98edd2` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:42.791126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b99a8142479745999b1c3511cb98edd2)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:42.793096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:42.847930 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0152fa7-064e-4953-9dd9-e567e3dabcfc service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:42.849424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f0152fa7-064e-4953-9dd9-e567e3dabcfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:42.864656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0152fa7-064e-4953-9dd9-e567e3dabcfc service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:42.869373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747328c-6324-4d43-a4ad-386d112179e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:42.870258 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747328c-6324-4d43-a4ad-386d112179e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:42.870549 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747328c-6324-4d43-a4ad-386d112179e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:42.870833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747328c-6324-4d43-a4ad-386d112179e3 admin admin] PATH_INFO: `/v3/users/beaa2d0578ea4f77b3b4aadd14ac1be9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:42.872049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747328c-6324-4d43-a4ad-386d112179e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beaa2d0578ea4f77b3b4aadd14ac1be9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:42.874145 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747328c-6324-4d43-a4ad-386d112179e3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:42.965350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b99a8142479745999b1c3511cb98edd2', 'request_id': 'req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:42.972561 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b99a8142479745999b1c3511cb98edd2', 'request_id': 'req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.077817 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b99a8142479745999b1c3511cb98edd2', 'request_id': 'req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.089502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634 admin admin] The token cache is being invalidate because project b99a8142479745999b1c3511cb98edd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:43.089799 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.090445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.092009 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1065/2168] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:42 2022] DELETE /identity/v3/projects/b99a8142479745999b1c3511cb98edd2 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:43.092854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:43.094166 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:43.138479 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c747328c-6324-4d43-a4ad-386d112179e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beaa2d0578ea4f77b3b4aadd14ac1be9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.139747 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c747328c-6324-4d43-a4ad-386d112179e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beaa2d0578ea4f77b3b4aadd14ac1be9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.168768 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c87be8-57b2-4f6b-85c6-f3c65f2f6634 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:43.169396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26316f7f-b73d-46b3-ae70-f521314d9383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:43.170172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316f7f-b73d-46b3-ae70-f521314d9383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:43.170444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316f7f-b73d-46b3-ae70-f521314d9383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:43.170745 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316f7f-b73d-46b3-ae70-f521314d9383 admin admin] PATH_INFO: `/v3/projects/e734f261852c4872b2a736bcdbfcf76c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:43.171979 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26316f7f-b73d-46b3-ae70-f521314d9383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e734f261852c4872b2a736bcdbfcf76c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:43.174531 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26316f7f-b73d-46b3-ae70-f521314d9383 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:43.222074 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:43.290647 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c747328c-6324-4d43-a4ad-386d112179e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beaa2d0578ea4f77b3b4aadd14ac1be9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.298642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c747328c-6324-4d43-a4ad-386d112179e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beaa2d0578ea4f77b3b4aadd14ac1be9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.299405 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c747328c-6324-4d43-a4ad-386d112179e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beaa2d0578ea4f77b3b4aadd14ac1be9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.317527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1104/2169] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:42 2022] DELETE /identity/v3/users/beaa2d0578ea4f77b3b4aadd14ac1be9 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:43.318381 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747328c-6324-4d43-a4ad-386d112179e3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:43.321566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c747328c-6324-4d43-a4ad-386d112179e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:43.338454 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-26316f7f-b73d-46b3-ae70-f521314d9383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e734f261852c4872b2a736bcdbfcf76c', 'request_id': 'req-26316f7f-b73d-46b3-ae70-f521314d9383'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.344235 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-26316f7f-b73d-46b3-ae70-f521314d9383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e734f261852c4872b2a736bcdbfcf76c', 'request_id': 'req-26316f7f-b73d-46b3-ae70-f521314d9383'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.385898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747328c-6324-4d43-a4ad-386d112179e3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:43.441490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f1f73-1894-4a74-ac16-b96261b30b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:43.442297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f1f73-1894-4a74-ac16-b96261b30b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:43.442586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f1f73-1894-4a74-ac16-b96261b30b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:43.442870 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f1f73-1894-4a74-ac16-b96261b30b9c admin admin] PATH_INFO: `/v3/users/0762ff7131e14f6eb2082dcda14dbf88` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:43.444108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f1f73-1894-4a74-ac16-b96261b30b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0762ff7131e14f6eb2082dcda14dbf88)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:43.446049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f1f73-1894-4a74-ac16-b96261b30b9c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:43.489439 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-26316f7f-b73d-46b3-ae70-f521314d9383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e734f261852c4872b2a736bcdbfcf76c', 'request_id': 'req-26316f7f-b73d-46b3-ae70-f521314d9383'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.501693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-26316f7f-b73d-46b3-ae70-f521314d9383 admin admin] The token cache is being invalidate because project e734f261852c4872b2a736bcdbfcf76c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:43.502780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-26316f7f-b73d-46b3-ae70-f521314d9383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.504782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-26316f7f-b73d-46b3-ae70-f521314d9383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.506402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1066/2170] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:43 2022] DELETE /identity/v3/projects/e734f261852c4872b2a736bcdbfcf76c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:43.507819 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f71e9e-1813-4ed9-947b-b1453ada94d6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:43.508145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f71e9e-1813-4ed9-947b-b1453ada94d6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:43.508431 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f71e9e-1813-4ed9-947b-b1453ada94d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:43.529226 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c4f71e9e-1813-4ed9-947b-b1453ada94d6 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:43.530460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c4f71e9e-1813-4ed9-947b-b1453ada94d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:43.539046 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1067/2171] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:43.539906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f71e9e-1813-4ed9-947b-b1453ada94d6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:43.541365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c4f71e9e-1813-4ed9-947b-b1453ada94d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:43.556264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f71e9e-1813-4ed9-947b-b1453ada94d6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:43.561324 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0c98c-3d63-48d1-baac-f5d7ec47c0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:43.562243 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0c98c-3d63-48d1-baac-f5d7ec47c0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:43.562557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0c98c-3d63-48d1-baac-f5d7ec47c0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:43.562836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0c98c-3d63-48d1-baac-f5d7ec47c0b5 admin admin] PATH_INFO: `/v3/users/1466305009e3481ca0955a3a38258eb6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:43.564626 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0c98c-3d63-48d1-baac-f5d7ec47c0b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1466305009e3481ca0955a3a38258eb6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:43.566536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0c98c-3d63-48d1-baac-f5d7ec47c0b5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:43.586668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:43.641160 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4f7f1f73-1894-4a74-ac16-b96261b30b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0762ff7131e14f6eb2082dcda14dbf88'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.641834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4f7f1f73-1894-4a74-ac16-b96261b30b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0762ff7131e14f6eb2082dcda14dbf88'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.740409 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4f7f1f73-1894-4a74-ac16-b96261b30b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0762ff7131e14f6eb2082dcda14dbf88'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.747516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4f7f1f73-1894-4a74-ac16-b96261b30b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0762ff7131e14f6eb2082dcda14dbf88'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.748188 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4f7f1f73-1894-4a74-ac16-b96261b30b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0762ff7131e14f6eb2082dcda14dbf88'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.765544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1105/2172] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:43 2022] DELETE /identity/v3/users/0762ff7131e14f6eb2082dcda14dbf88 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:43.766340 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f1f73-1894-4a74-ac16-b96261b30b9c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:43.768273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4f7f1f73-1894-4a74-ac16-b96261b30b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:43.826105 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f1f73-1894-4a74-ac16-b96261b30b9c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:43.831394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be2ae2-e6a8-429b-a470-ce420da8ab02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:43.832283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be2ae2-e6a8-429b-a470-ce420da8ab02 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:43.832951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be2ae2-e6a8-429b-a470-ce420da8ab02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:43.833291 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be2ae2-e6a8-429b-a470-ce420da8ab02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:43.835869 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f1be2ae2-e6a8-429b-a470-ce420da8ab02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:43.841387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c1a0c98c-3d63-48d1-baac-f5d7ec47c0b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1466305009e3481ca0955a3a38258eb6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.853859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c1a0c98c-3d63-48d1-baac-f5d7ec47c0b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1466305009e3481ca0955a3a38258eb6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.854586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c1a0c98c-3d63-48d1-baac-f5d7ec47c0b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1466305009e3481ca0955a3a38258eb6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.861796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c1a0c98c-3d63-48d1-baac-f5d7ec47c0b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1466305009e3481ca0955a3a38258eb6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.863848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:43.867481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c1a0c98c-3d63-48d1-baac-f5d7ec47c0b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1466305009e3481ca0955a3a38258eb6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:43.902072 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be2ae2-e6a8-429b-a470-ce420da8ab02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:43.902213 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be2ae2-e6a8-429b-a470-ce420da8ab02 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:43.911584 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1106/2173] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:43.958711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1068/2174] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:43 2022] DELETE /identity/v3/users/1466305009e3481ca0955a3a38258eb6 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:44.287739 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be2ae2-e6a8-429b-a470-ce420da8ab02 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:44.289487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f1be2ae2-e6a8-429b-a470-ce420da8ab02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:44.315731 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be2ae2-e6a8-429b-a470-ce420da8ab02 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:44.379047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0c98c-3d63-48d1-baac-f5d7ec47c0b5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:44.380461 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c1a0c98c-3d63-48d1-baac-f5d7ec47c0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:44.416807 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2f932-799d-4452-98da-207a0b9aaa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:44.420409 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2f932-799d-4452-98da-207a0b9aaa67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:44.420794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2f932-799d-4452-98da-207a0b9aaa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:44.421683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2f932-799d-4452-98da-207a0b9aaa67 admin admin] PATH_INFO: `/v3/projects/d7c73ddf696e495699b7dab6aa9c6608` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:44.424904 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2f932-799d-4452-98da-207a0b9aaa67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c73ddf696e495699b7dab6aa9c6608)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:44.427826 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2f932-799d-4452-98da-207a0b9aaa67 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:44.495307 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0c98c-3d63-48d1-baac-f5d7ec47c0b5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:44.501038 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63af4a-7254-48ea-9005-d7a74d7eaada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:44.502550 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63af4a-7254-48ea-9005-d7a74d7eaada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:44.502844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63af4a-7254-48ea-9005-d7a74d7eaada admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:44.503131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63af4a-7254-48ea-9005-d7a74d7eaada admin admin] PATH_INFO: `/v3/users/4c312ba1385f470cbedd4fe9bee0f1d7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:44.504410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63af4a-7254-48ea-9005-d7a74d7eaada admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c312ba1385f470cbedd4fe9bee0f1d7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:44.506552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf63af4a-7254-48ea-9005-d7a74d7eaada admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:44.666564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c4a2f932-799d-4452-98da-207a0b9aaa67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c73ddf696e495699b7dab6aa9c6608', 'request_id': 'req-c4a2f932-799d-4452-98da-207a0b9aaa67'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:44.790142 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c4a2f932-799d-4452-98da-207a0b9aaa67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c73ddf696e495699b7dab6aa9c6608', 'request_id': 'req-c4a2f932-799d-4452-98da-207a0b9aaa67'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:44.800704 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c4a2f932-799d-4452-98da-207a0b9aaa67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c73ddf696e495699b7dab6aa9c6608', 'request_id': 'req-c4a2f932-799d-4452-98da-207a0b9aaa67'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:44.808310 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cf63af4a-7254-48ea-9005-d7a74d7eaada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c312ba1385f470cbedd4fe9bee0f1d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:44.808916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c4a2f932-799d-4452-98da-207a0b9aaa67 admin admin] The token cache is being invalidate because project d7c73ddf696e495699b7dab6aa9c6608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:44.809204 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c4a2f932-799d-4452-98da-207a0b9aaa67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:44.809854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c4a2f932-799d-4452-98da-207a0b9aaa67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:44.811510 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1107/2175] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:44 2022] DELETE /identity/v3/projects/d7c73ddf696e495699b7dab6aa9c6608 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:44.812395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2f932-799d-4452-98da-207a0b9aaa67 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:44.816474 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c4a2f932-799d-4452-98da-207a0b9aaa67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:44.823673 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cf63af4a-7254-48ea-9005-d7a74d7eaada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c312ba1385f470cbedd4fe9bee0f1d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:44.824423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cf63af4a-7254-48ea-9005-d7a74d7eaada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c312ba1385f470cbedd4fe9bee0f1d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:44.831680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cf63af4a-7254-48ea-9005-d7a74d7eaada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c312ba1385f470cbedd4fe9bee0f1d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:44.832357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cf63af4a-7254-48ea-9005-d7a74d7eaada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c312ba1385f470cbedd4fe9bee0f1d7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:44.877713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2f932-799d-4452-98da-207a0b9aaa67 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:44.882312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd036f6-541a-476c-ba70-bc6b19981c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:44.883163 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd036f6-541a-476c-ba70-bc6b19981c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:44.883445 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd036f6-541a-476c-ba70-bc6b19981c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:44.883720 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd036f6-541a-476c-ba70-bc6b19981c3b admin admin] PATH_INFO: `/v3/projects/db0ab8a7ac7548be9f23595ef70245a6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:44.884920 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd036f6-541a-476c-ba70-bc6b19981c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0ab8a7ac7548be9f23595ef70245a6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:44.886824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd036f6-541a-476c-ba70-bc6b19981c3b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:44.963257 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1069/2176] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:44 2022] DELETE /identity/v3/users/4c312ba1385f470cbedd4fe9bee0f1d7 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:44.964796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63af4a-7254-48ea-9005-d7a74d7eaada admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:44.966174 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cf63af4a-7254-48ea-9005-d7a74d7eaada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:45.031909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63af4a-7254-48ea-9005-d7a74d7eaada admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:45.038261 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1434fe-9338-4c14-98ed-b3ae73f8bbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:45.039117 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1434fe-9338-4c14-98ed-b3ae73f8bbd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:45.039401 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1434fe-9338-4c14-98ed-b3ae73f8bbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:45.039678 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1434fe-9338-4c14-98ed-b3ae73f8bbd1 admin admin] PATH_INFO: `/v3/projects/66af98cfdeb647abb58c0bb7e5915b3e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:45.040892 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1434fe-9338-4c14-98ed-b3ae73f8bbd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66af98cfdeb647abb58c0bb7e5915b3e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:45.042871 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1434fe-9338-4c14-98ed-b3ae73f8bbd1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:45.061824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5bd036f6-541a-476c-ba70-bc6b19981c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0ab8a7ac7548be9f23595ef70245a6', 'request_id': 'req-5bd036f6-541a-476c-ba70-bc6b19981c3b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:45.144601 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5bd036f6-541a-476c-ba70-bc6b19981c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0ab8a7ac7548be9f23595ef70245a6', 'request_id': 'req-5bd036f6-541a-476c-ba70-bc6b19981c3b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:45.151318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5bd036f6-541a-476c-ba70-bc6b19981c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0ab8a7ac7548be9f23595ef70245a6', 'request_id': 'req-5bd036f6-541a-476c-ba70-bc6b19981c3b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:45.162007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5bd036f6-541a-476c-ba70-bc6b19981c3b admin admin] The token cache is being invalidate because project db0ab8a7ac7548be9f23595ef70245a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:45.162302 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5bd036f6-541a-476c-ba70-bc6b19981c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:45.162957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5bd036f6-541a-476c-ba70-bc6b19981c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:45.164581 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1108/2177] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:44 2022] DELETE /identity/v3/projects/db0ab8a7ac7548be9f23595ef70245a6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:45.165430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd036f6-541a-476c-ba70-bc6b19981c3b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:45.166735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5bd036f6-541a-476c-ba70-bc6b19981c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:45.242404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd036f6-541a-476c-ba70-bc6b19981c3b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:45.448665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484cf8c-d750-4cc3-9725-2350a6bcdf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:45.448665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484cf8c-d750-4cc3-9725-2350a6bcdf8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:45.448665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484cf8c-d750-4cc3-9725-2350a6bcdf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:45.448665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484cf8c-d750-4cc3-9725-2350a6bcdf8d admin admin] PATH_INFO: `/v3/users/bef8c0c83c7b49c4801e2e9c66be77b5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:45.449054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484cf8c-d750-4cc3-9725-2350a6bcdf8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef8c0c83c7b49c4801e2e9c66be77b5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:45.449054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484cf8c-d750-4cc3-9725-2350a6bcdf8d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:45.449054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:45.449306 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3e1434fe-9338-4c14-98ed-b3ae73f8bbd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66af98cfdeb647abb58c0bb7e5915b3e', 'request_id': 'req-3e1434fe-9338-4c14-98ed-b3ae73f8bbd1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:45.449306 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3e1434fe-9338-4c14-98ed-b3ae73f8bbd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66af98cfdeb647abb58c0bb7e5915b3e', 'request_id': 'req-3e1434fe-9338-4c14-98ed-b3ae73f8bbd1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:45.621307 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3e1434fe-9338-4c14-98ed-b3ae73f8bbd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66af98cfdeb647abb58c0bb7e5915b3e', 'request_id': 'req-3e1434fe-9338-4c14-98ed-b3ae73f8bbd1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:45.634440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3e1434fe-9338-4c14-98ed-b3ae73f8bbd1 admin admin] The token cache is being invalidate because project 66af98cfdeb647abb58c0bb7e5915b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:45.634881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3e1434fe-9338-4c14-98ed-b3ae73f8bbd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:45.635539 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3e1434fe-9338-4c14-98ed-b3ae73f8bbd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:45.641431 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1070/2178] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:44 2022] DELETE /identity/v3/projects/66af98cfdeb647abb58c0bb7e5915b3e => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:45.641431 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc833b1-cf82-4abc-8991-a2351d93837b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:45.641431 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc833b1-cf82-4abc-8991-a2351d93837b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:45.641431 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc833b1-cf82-4abc-8991-a2351d93837b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:45.686698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dbc833b1-cf82-4abc-8991-a2351d93837b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:45.687931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dbc833b1-cf82-4abc-8991-a2351d93837b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:45.765678 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1071/2179] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:45.766944 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1144f-17bc-4ce2-ad93-544c103cb724 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:45.767756 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1144f-17bc-4ce2-ad93-544c103cb724 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:45.768072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1144f-17bc-4ce2-ad93-544c103cb724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:45.801637 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0484cf8c-d750-4cc3-9725-2350a6bcdf8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef8c0c83c7b49c4801e2e9c66be77b5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:45.802302 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0484cf8c-d750-4cc3-9725-2350a6bcdf8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef8c0c83c7b49c4801e2e9c66be77b5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:45.806620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-82c1144f-17bc-4ce2-ad93-544c103cb724 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:45.807838 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-82c1144f-17bc-4ce2-ad93-544c103cb724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:45.818032 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1072/2180] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:45.819252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1144f-17bc-4ce2-ad93-544c103cb724 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:45.820227 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-82c1144f-17bc-4ce2-ad93-544c103cb724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:45.880089 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1144f-17bc-4ce2-ad93-544c103cb724 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:45.884141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6e067-76a3-44ad-8bb2-8c08f5487b8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:45.884828 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6e067-76a3-44ad-8bb2-8c08f5487b8f service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:45.885125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6e067-76a3-44ad-8bb2-8c08f5487b8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:45.885414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6e067-76a3-44ad-8bb2-8c08f5487b8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:45.887501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8ea6e067-76a3-44ad-8bb2-8c08f5487b8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:45.900883 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6e067-76a3-44ad-8bb2-8c08f5487b8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:45.901896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6e067-76a3-44ad-8bb2-8c08f5487b8f service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:45.913131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1073/2181] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:45.914793 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8518961-03b3-4df9-ae40-c08dc95a1fab None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:45.915191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8518961-03b3-4df9-ae40-c08dc95a1fab None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:45.915552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8518961-03b3-4df9-ae40-c08dc95a1fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:45.916975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0484cf8c-d750-4cc3-9725-2350a6bcdf8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef8c0c83c7b49c4801e2e9c66be77b5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:45.927154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0484cf8c-d750-4cc3-9725-2350a6bcdf8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef8c0c83c7b49c4801e2e9c66be77b5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:45.928792 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0484cf8c-d750-4cc3-9725-2350a6bcdf8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef8c0c83c7b49c4801e2e9c66be77b5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:45.942072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d8518961-03b3-4df9-ae40-c08dc95a1fab None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:45.943282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d8518961-03b3-4df9-ae40-c08dc95a1fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:45.948770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1109/2182] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:45 2022] DELETE /identity/v3/users/bef8c0c83c7b49c4801e2e9c66be77b5 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:45.959524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:45.972246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1074/2183] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:45.977381 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484cf8c-d750-4cc3-9725-2350a6bcdf8d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:46.086039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484cf8c-d750-4cc3-9725-2350a6bcdf8d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:46.091406 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23f347-b77b-42e1-af2b-b19689be9e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:46.092106 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23f347-b77b-42e1-af2b-b19689be9e9b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:46.092612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23f347-b77b-42e1-af2b-b19689be9e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:46.092987 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23f347-b77b-42e1-af2b-b19689be9e9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:46.093752 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23f347-b77b-42e1-af2b-b19689be9e9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:46.094073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23f347-b77b-42e1-af2b-b19689be9e9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:46.096262 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23f347-b77b-42e1-af2b-b19689be9e9b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:46.108833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1110/2184] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:46.113962 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8518961-03b3-4df9-ae40-c08dc95a1fab None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:46.124797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8518961-03b3-4df9-ae40-c08dc95a1fab None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:46.130050 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4caea-6332-44e4-b2ab-ffabb527d0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:46.131012 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4caea-6332-44e4-b2ab-ffabb527d0ed admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:46.131705 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4caea-6332-44e4-b2ab-ffabb527d0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:46.132231 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4caea-6332-44e4-b2ab-ffabb527d0ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:46.133155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4caea-6332-44e4-b2ab-ffabb527d0ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:46.135312 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4caea-6332-44e4-b2ab-ffabb527d0ed admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:46.297203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1075/2185] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:46 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:46.301300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23f347-b77b-42e1-af2b-b19689be9e9b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:46.312520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23f347-b77b-42e1-af2b-b19689be9e9b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:46.410717 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b77d7-2d5b-4f12-8adc-418c5fc3d98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:46.411555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b77d7-2d5b-4f12-8adc-418c5fc3d98b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:46.411854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b77d7-2d5b-4f12-8adc-418c5fc3d98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:46.412169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b77d7-2d5b-4f12-8adc-418c5fc3d98b admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:46.412886 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b77d7-2d5b-4f12-8adc-418c5fc3d98b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:46.414849 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b77d7-2d5b-4f12-8adc-418c5fc3d98b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:46.491092 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4caea-6332-44e4-b2ab-ffabb527d0ed admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:46.492899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b7d4caea-6332-44e4-b2ab-ffabb527d0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:46.505794 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4caea-6332-44e4-b2ab-ffabb527d0ed admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:46.510687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:46.512302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:46.512901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:46.513348 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28 admin admin] PATH_INFO: `/v3/projects/f5fcc21393d6483194dd4d321197cde1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:46.515143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5fcc21393d6483194dd4d321197cde1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:46.517811 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:46.533955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1111/2186] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:46 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:46.536835 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b77d7-2d5b-4f12-8adc-418c5fc3d98b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:46.554081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b77d7-2d5b-4f12-8adc-418c5fc3d98b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:46.562412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc2d44-cd92-42da-99e8-1cc468699608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:46.565411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2d44-cd92-42da-99e8-1cc468699608 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:46.565784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2d44-cd92-42da-99e8-1cc468699608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:46.566070 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2d44-cd92-42da-99e8-1cc468699608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:46.566837 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc2d44-cd92-42da-99e8-1cc468699608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:46.568690 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc2d44-cd92-42da-99e8-1cc468699608 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:46.587594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1112/2187] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:46.591785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc2d44-cd92-42da-99e8-1cc468699608 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:46.593559 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5cfc2d44-cd92-42da-99e8-1cc468699608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:46.606326 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc2d44-cd92-42da-99e8-1cc468699608 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:46.611094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:46.611960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:46.612399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:46.612683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be admin admin] PATH_INFO: `/v3/projects/c8bfaf4404ea46bf871a9ecf3c76ae2d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:46.613894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8bfaf4404ea46bf871a9ecf3c76ae2d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:46.615787 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:46.668352 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5fcc21393d6483194dd4d321197cde1', 'request_id': 'req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:46.673745 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5fcc21393d6483194dd4d321197cde1', 'request_id': 'req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:46.753607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8bfaf4404ea46bf871a9ecf3c76ae2d', 'request_id': 'req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:46.763900 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5fcc21393d6483194dd4d321197cde1', 'request_id': 'req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:46.778210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28 admin admin] The token cache is being invalidate because project f5fcc21393d6483194dd4d321197cde1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:46.778570 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:46.779422 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:46.781494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1076/2188] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:46 2022] DELETE /identity/v3/projects/f5fcc21393d6483194dd4d321197cde1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:46.782355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:46.784090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:46.861955 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e50b24-6b3e-4d66-8ec6-aa7425d02b28 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:46.912367 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8bfaf4404ea46bf871a9ecf3c76ae2d', 'request_id': 'req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:46.919779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093329c-5702-4801-b387-1775dc6e5b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:46.927143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093329c-5702-4801-b387-1775dc6e5b9f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:46.927143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093329c-5702-4801-b387-1775dc6e5b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:46.927143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093329c-5702-4801-b387-1775dc6e5b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:46.927143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093329c-5702-4801-b387-1775dc6e5b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:46.927932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8bfaf4404ea46bf871a9ecf3c76ae2d', 'request_id': 'req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:46.928404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093329c-5702-4801-b387-1775dc6e5b9f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:46.934627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1077/2189] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:46.935425 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093329c-5702-4801-b387-1775dc6e5b9f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:46.937069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be admin admin] The token cache is being invalidate because project c8bfaf4404ea46bf871a9ecf3c76ae2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:46.937228 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2093329c-5702-4801-b387-1775dc6e5b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:46.937565 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:46.938373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:46.940960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1113/2190] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:46 2022] DELETE /identity/v3/projects/c8bfaf4404ea46bf871a9ecf3c76ae2d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:46.941851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:46.943484 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:46.953930 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093329c-5702-4801-b387-1775dc6e5b9f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:46.959220 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7957a6-f975-4641-aa46-1825421176a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:46.962492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7957a6-f975-4641-aa46-1825421176a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:46.962492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7957a6-f975-4641-aa46-1825421176a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:46.962492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7957a6-f975-4641-aa46-1825421176a5 admin admin] PATH_INFO: `/v3/users/517a2e4fa477472c9172293e1ce6c55c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:46.964432 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7957a6-f975-4641-aa46-1825421176a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=517a2e4fa477472c9172293e1ce6c55c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:46.965994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7957a6-f975-4641-aa46-1825421176a5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:46.966088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fd94b-0dd7-472b-a1e4-d2e3fbb167be admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:46.976349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081e6ed-441a-428f-b32e-26405f710270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:46.979104 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081e6ed-441a-428f-b32e-26405f710270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:46.981525 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081e6ed-441a-428f-b32e-26405f710270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:46.982024 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081e6ed-441a-428f-b32e-26405f710270 admin admin] PATH_INFO: `/v3/projects/5fc05693b0a54b8585ff14f45829b6ac/users/c8dc0c6c438b4c6aba78908cded7734e/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:47.010841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081e6ed-441a-428f-b32e-26405f710270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc05693b0a54b8585ff14f45829b6ac, user_id=c8dc0c6c438b4c6aba78908cded7734e, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:47.014822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081e6ed-441a-428f-b32e-26405f710270 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:47.143423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1114/2191] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:46 2022] PUT /identity/v3/projects/5fc05693b0a54b8585ff14f45829b6ac/users/c8dc0c6c438b4c6aba78908cded7734e/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:47.144738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28857f19-d783-475b-a349-ad00d9b55c99 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:47.145255 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28857f19-d783-475b-a349-ad00d9b55c99 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:47.145742 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28857f19-d783-475b-a349-ad00d9b55c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:47.184627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-28857f19-d783-475b-a349-ad00d9b55c99 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:47.184627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-28857f19-d783-475b-a349-ad00d9b55c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:47.218075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-de7957a6-f975-4641-aa46-1825421176a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517a2e4fa477472c9172293e1ce6c55c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:47.240658 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-de7957a6-f975-4641-aa46-1825421176a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517a2e4fa477472c9172293e1ce6c55c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:47.240658 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-de7957a6-f975-4641-aa46-1825421176a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517a2e4fa477472c9172293e1ce6c55c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:47.240814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1115/2192] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:47.241389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b5b85-396e-4d69-8ab0-561c51914e96 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:47.241682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b5b85-396e-4d69-8ab0-561c51914e96 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:47.241966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b5b85-396e-4d69-8ab0-561c51914e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:47.246225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-de7957a6-f975-4641-aa46-1825421176a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517a2e4fa477472c9172293e1ce6c55c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:47.247241 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-de7957a6-f975-4641-aa46-1825421176a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517a2e4fa477472c9172293e1ce6c55c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:47.279568 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-af0b5b85-396e-4d69-8ab0-561c51914e96 None None] MFA Rules not processed for user `c8dc0c6c438b4c6aba78908cded7734e`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:47.280819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-af0b5b85-396e-4d69-8ab0-561c51914e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:47.319507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:47.356748 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1116/2193] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:47.358096 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b548913-b0d6-4c77-a04a-8b1076f88341 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:47.358393 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b548913-b0d6-4c77-a04a-8b1076f88341 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:47.358727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b548913-b0d6-4c77-a04a-8b1076f88341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:47.377727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1b548913-b0d6-4c77-a04a-8b1076f88341 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:47.378956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1b548913-b0d6-4c77-a04a-8b1076f88341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:47.386972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1117/2194] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:47.387747 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b548913-b0d6-4c77-a04a-8b1076f88341 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:47.391266 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1b548913-b0d6-4c77-a04a-8b1076f88341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:47.402899 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b548913-b0d6-4c77-a04a-8b1076f88341 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:47.408183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160a7fe-56a9-4543-9c12-85d3e09acf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:47.408839 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160a7fe-56a9-4543-9c12-85d3e09acf7f admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:47.409127 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160a7fe-56a9-4543-9c12-85d3e09acf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:47.409410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160a7fe-56a9-4543-9c12-85d3e09acf7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:47.410098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160a7fe-56a9-4543-9c12-85d3e09acf7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:47.412094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160a7fe-56a9-4543-9c12-85d3e09acf7f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:47.428091 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1078/2195] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:46 2022] DELETE /identity/v3/users/517a2e4fa477472c9172293e1ce6c55c => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:47.428996 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7957a6-f975-4641-aa46-1825421176a5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:47.498275 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7957a6-f975-4641-aa46-1825421176a5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:47.503263 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd9f97-ec5b-4eed-a147-a3c038c95eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:47.504053 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd9f97-ec5b-4eed-a147-a3c038c95eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:47.504357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd9f97-ec5b-4eed-a147-a3c038c95eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:47.504702 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd9f97-ec5b-4eed-a147-a3c038c95eb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:47.505476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd9f97-ec5b-4eed-a147-a3c038c95eb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:47.505850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd9f97-ec5b-4eed-a147-a3c038c95eb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:47.507560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd9f97-ec5b-4eed-a147-a3c038c95eb1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:47.513000 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1118/2196] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:47 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:47.518198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160a7fe-56a9-4543-9c12-85d3e09acf7f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:47.529705 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1079/2197] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:47.530920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd9f97-ec5b-4eed-a147-a3c038c95eb1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:47.548871 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd9f97-ec5b-4eed-a147-a3c038c95eb1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:47.594627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160a7fe-56a9-4543-9c12-85d3e09acf7f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:47.611834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea53b1-e4ab-4d13-96c9-bc011858ad8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:47.612577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea53b1-e4ab-4d13-96c9-bc011858ad8a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:47.612865 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea53b1-e4ab-4d13-96c9-bc011858ad8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:47.613148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea53b1-e4ab-4d13-96c9-bc011858ad8a admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:47.613994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea53b1-e4ab-4d13-96c9-bc011858ad8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:47.616519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea53b1-e4ab-4d13-96c9-bc011858ad8a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:47.630127 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff845c07-a204-4eab-b2bd-d7d40199b979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:47.630933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff845c07-a204-4eab-b2bd-d7d40199b979 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:47.631291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff845c07-a204-4eab-b2bd-d7d40199b979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:47.631922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff845c07-a204-4eab-b2bd-d7d40199b979 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:47.632756 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff845c07-a204-4eab-b2bd-d7d40199b979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:47.635742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff845c07-a204-4eab-b2bd-d7d40199b979 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:47.716094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1119/2198] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:47 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:47.719814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea53b1-e4ab-4d13-96c9-bc011858ad8a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:47.730664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea53b1-e4ab-4d13-96c9-bc011858ad8a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:47.736365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b0ee5-f7fa-4443-940b-edb5ca04c064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:47.737101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b0ee5-f7fa-4443-940b-edb5ca04c064 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:47.737389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b0ee5-f7fa-4443-940b-edb5ca04c064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:47.737673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b0ee5-f7fa-4443-940b-edb5ca04c064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:47.738410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b0ee5-f7fa-4443-940b-edb5ca04c064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:47.740053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b0ee5-f7fa-4443-940b-edb5ca04c064 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:47.750441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1120/2199] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:47.754396 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b0ee5-f7fa-4443-940b-edb5ca04c064 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:47.765857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b0ee5-f7fa-4443-940b-edb5ca04c064 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:47.771243 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd85cb-18a6-4ab1-913e-9327e3725750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:47.772235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd85cb-18a6-4ab1-913e-9327e3725750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:47.777693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd85cb-18a6-4ab1-913e-9327e3725750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:47.777693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd85cb-18a6-4ab1-913e-9327e3725750 admin admin] PATH_INFO: `/v3/projects/3235b2a100874ca4a2a8188da5f0e035/users/bc1cd096f34b4b9e87b01eeb1ce663fc/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:47.777907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1080/2200] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:47 2022] POST /identity/v3/projects => generated 373 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:47.781793 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff845c07-a204-4eab-b2bd-d7d40199b979 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:47.791892 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd85cb-18a6-4ab1-913e-9327e3725750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3235b2a100874ca4a2a8188da5f0e035, user_id=bc1cd096f34b4b9e87b01eeb1ce663fc, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:47.794838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd85cb-18a6-4ab1-913e-9327e3725750 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:47.853938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff845c07-a204-4eab-b2bd-d7d40199b979 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:47.860483 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58ee36-bb9f-4e91-9b40-38bb5c3a4d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:47.862129 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58ee36-bb9f-4e91-9b40-38bb5c3a4d69 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:47.862494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58ee36-bb9f-4e91-9b40-38bb5c3a4d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:47.862780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58ee36-bb9f-4e91-9b40-38bb5c3a4d69 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:47.863545 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58ee36-bb9f-4e91-9b40-38bb5c3a4d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:47.865577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58ee36-bb9f-4e91-9b40-38bb5c3a4d69 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:47.885758 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1121/2201] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:47 2022] PUT /identity/v3/projects/3235b2a100874ca4a2a8188da5f0e035/users/bc1cd096f34b4b9e87b01eeb1ce663fc/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:47.886716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd85cb-18a6-4ab1-913e-9327e3725750 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:47.972776 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd85cb-18a6-4ab1-913e-9327e3725750 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:47.978699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a0591-2a2d-4379-bc68-5518804e76c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:47.979494 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a0591-2a2d-4379-bc68-5518804e76c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:47.979788 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a0591-2a2d-4379-bc68-5518804e76c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:47.980112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a0591-2a2d-4379-bc68-5518804e76c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:47.980986 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a0591-2a2d-4379-bc68-5518804e76c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:47.982462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a0591-2a2d-4379-bc68-5518804e76c0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:47.999667 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1122/2202] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:47 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:48.002757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1081/2203] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:47 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:48.007898 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58ee36-bb9f-4e91-9b40-38bb5c3a4d69 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:48.008669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a0591-2a2d-4379-bc68-5518804e76c0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:48.019144 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58ee36-bb9f-4e91-9b40-38bb5c3a4d69 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:48.025539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a0591-2a2d-4379-bc68-5518804e76c0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:48.027655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2ea44-bd19-49ee-96c5-a6dd0cb4eb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:48.029057 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2ea44-bd19-49ee-96c5-a6dd0cb4eb21 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:48.029515 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2ea44-bd19-49ee-96c5-a6dd0cb4eb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:48.030326 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2ea44-bd19-49ee-96c5-a6dd0cb4eb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:48.031316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2ea44-bd19-49ee-96c5-a6dd0cb4eb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:48.033020 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2ea44-bd19-49ee-96c5-a6dd0cb4eb21 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:48.033172 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870463d-6033-4df7-8d6c-41421526500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:48.034165 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870463d-6033-4df7-8d6c-41421526500b admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:48.034585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870463d-6033-4df7-8d6c-41421526500b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:48.034968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870463d-6033-4df7-8d6c-41421526500b admin admin] PATH_INFO: `/v3/projects/3235b2a100874ca4a2a8188da5f0e035/users/bc1cd096f34b4b9e87b01eeb1ce663fc/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:48.037342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870463d-6033-4df7-8d6c-41421526500b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3235b2a100874ca4a2a8188da5f0e035, user_id=bc1cd096f34b4b9e87b01eeb1ce663fc, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:48.040195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870463d-6033-4df7-8d6c-41421526500b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:48.044176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1082/2204] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:48.048703 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2ea44-bd19-49ee-96c5-a6dd0cb4eb21 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:48.060402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1123/2205] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:48 2022] PUT /identity/v3/projects/3235b2a100874ca4a2a8188da5f0e035/users/bc1cd096f34b4b9e87b01eeb1ce663fc/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:48.064943 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2ea44-bd19-49ee-96c5-a6dd0cb4eb21 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:48.072601 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb1739-9b0a-41f5-95a9-65954f264d5e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:48.073183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb1739-9b0a-41f5-95a9-65954f264d5e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:48.073756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb1739-9b0a-41f5-95a9-65954f264d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:48.110256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:48.114386 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-80bb1739-9b0a-41f5-95a9-65954f264d5e None None] MFA Rules not processed for user `bc1cd096f34b4b9e87b01eeb1ce663fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:48.115968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-80bb1739-9b0a-41f5-95a9-65954f264d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:48.142226 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9af24-da97-4249-80d5-a90b2f3ae88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:48.143603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9af24-da97-4249-80d5-a90b2f3ae88e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:48.143897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9af24-da97-4249-80d5-a90b2f3ae88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:48.144221 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9af24-da97-4249-80d5-a90b2f3ae88e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:48.145432 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9af24-da97-4249-80d5-a90b2f3ae88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:48.147152 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c9af24-da97-4249-80d5-a90b2f3ae88e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:48.160341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1083/2206] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:48.161321 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9af24-da97-4249-80d5-a90b2f3ae88e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:48.163820 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-57c9af24-da97-4249-80d5-a90b2f3ae88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:48.177883 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c9af24-da97-4249-80d5-a90b2f3ae88e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:48.196580 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8c229-75c1-4104-bcac-12421e35c377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:48.198319 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8c229-75c1-4104-bcac-12421e35c377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:48.198616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8c229-75c1-4104-bcac-12421e35c377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:48.198904 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8c229-75c1-4104-bcac-12421e35c377 admin admin] PATH_INFO: `/v3/projects/56cb31b3c47349b294cd3ad614e2eae7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:48.200392 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8c229-75c1-4104-bcac-12421e35c377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56cb31b3c47349b294cd3ad614e2eae7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:48.202378 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8c229-75c1-4104-bcac-12421e35c377 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:48.245461 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1124/2207] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:48 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:48.246101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb1739-9b0a-41f5-95a9-65954f264d5e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:48.260299 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb1739-9b0a-41f5-95a9-65954f264d5e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:48.265921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe83d8-7aa4-4a08-bf77-5d406137bef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:48.267018 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe83d8-7aa4-4a08-bf77-5d406137bef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:48.267905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe83d8-7aa4-4a08-bf77-5d406137bef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:48.268345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe83d8-7aa4-4a08-bf77-5d406137bef6 admin admin] PATH_INFO: `/v3/projects/7b217721b49c485196adab69b8dbf972/users/c129d5516af2481081596ffa775d3ba1/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:48.284696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe83d8-7aa4-4a08-bf77-5d406137bef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b217721b49c485196adab69b8dbf972, user_id=c129d5516af2481081596ffa775d3ba1, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:48.287938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe83d8-7aa4-4a08-bf77-5d406137bef6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:48.429279 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:48.438635 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1125/2208] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:48 2022] PUT /identity/v3/projects/7b217721b49c485196adab69b8dbf972/users/c129d5516af2481081596ffa775d3ba1/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:48.440822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe83d8-7aa4-4a08-bf77-5d406137bef6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:48.442758 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-aabe83d8-7aa4-4a08-bf77-5d406137bef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:48.473056 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17a8c229-75c1-4104-bcac-12421e35c377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56cb31b3c47349b294cd3ad614e2eae7', 'request_id': 'req-17a8c229-75c1-4104-bcac-12421e35c377'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:48.495410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17a8c229-75c1-4104-bcac-12421e35c377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56cb31b3c47349b294cd3ad614e2eae7', 'request_id': 'req-17a8c229-75c1-4104-bcac-12421e35c377'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:48.528973 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe83d8-7aa4-4a08-bf77-5d406137bef6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:48.585324 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff317f-5d77-4b10-87fb-1a2c1b573272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:48.586104 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff317f-5d77-4b10-87fb-1a2c1b573272 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:48.586397 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff317f-5d77-4b10-87fb-1a2c1b573272 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:48.586692 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17a8c229-75c1-4104-bcac-12421e35c377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56cb31b3c47349b294cd3ad614e2eae7', 'request_id': 'req-17a8c229-75c1-4104-bcac-12421e35c377'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:48.586809 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff317f-5d77-4b10-87fb-1a2c1b573272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:48.602291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17a8c229-75c1-4104-bcac-12421e35c377 admin admin] The token cache is being invalidate because project 56cb31b3c47349b294cd3ad614e2eae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:48.602593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17a8c229-75c1-4104-bcac-12421e35c377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:48.603269 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-17a8c229-75c1-4104-bcac-12421e35c377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:48.608134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1084/2209] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:48 2022] DELETE /identity/v3/projects/56cb31b3c47349b294cd3ad614e2eae7 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:48.608927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ed0fb-d30d-4406-9bca-c8c1c005a3ed None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:48.609259 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ed0fb-d30d-4406-9bca-c8c1c005a3ed None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:48.609625 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ed0fb-d30d-4406-9bca-c8c1c005a3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:48.639254 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-111ed0fb-d30d-4406-9bca-c8c1c005a3ed None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:48.641476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-111ed0fb-d30d-4406-9bca-c8c1c005a3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:48.654719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff317f-5d77-4b10-87fb-1a2c1b573272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:48.656235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff317f-5d77-4b10-87fb-1a2c1b573272 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:48.666753 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1126/2210] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:48 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:48.668043 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce5554-7eb8-4773-ae50-1cd54d071bba None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:48.668469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce5554-7eb8-4773-ae50-1cd54d071bba None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:48.668765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce5554-7eb8-4773-ae50-1cd54d071bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:48.688311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-40ce5554-7eb8-4773-ae50-1cd54d071bba None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:48.690076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-40ce5554-7eb8-4773-ae50-1cd54d071bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:48.701102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1085/2211] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:48.702143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ed0fb-d30d-4406-9bca-c8c1c005a3ed None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:48.713199 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-111ed0fb-d30d-4406-9bca-c8c1c005a3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:48.716841 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ed0fb-d30d-4406-9bca-c8c1c005a3ed None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:48.723726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be844de-9d08-41ad-aec0-0080627780e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:48.724719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be844de-9d08-41ad-aec0-0080627780e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:48.725120 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be844de-9d08-41ad-aec0-0080627780e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:48.725495 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be844de-9d08-41ad-aec0-0080627780e3 admin admin] PATH_INFO: `/v3/users/b309e382c8b04a138c683fa1aba10c4d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:48.726950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be844de-9d08-41ad-aec0-0080627780e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b309e382c8b04a138c683fa1aba10c4d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:48.729015 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be844de-9d08-41ad-aec0-0080627780e3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:48.758666 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1127/2212] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:48.759727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce5554-7eb8-4773-ae50-1cd54d071bba None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:48.761269 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-40ce5554-7eb8-4773-ae50-1cd54d071bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:48.830758 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce5554-7eb8-4773-ae50-1cd54d071bba None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:48.834417 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc6a38-f996-4061-a7fe-62fa05b4dea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:48.835069 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc6a38-f996-4061-a7fe-62fa05b4dea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:48.835359 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc6a38-f996-4061-a7fe-62fa05b4dea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:48.835812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc6a38-f996-4061-a7fe-62fa05b4dea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:48.845599 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc6a38-f996-4061-a7fe-62fa05b4dea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:48.846934 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc6a38-f996-4061-a7fe-62fa05b4dea5 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:48.856822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1128/2213] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:48.858061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf2402-8d9b-476e-8db1-36fc6671efc6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:48.860681 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf2402-8d9b-476e-8db1-36fc6671efc6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:48.860681 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf2402-8d9b-476e-8db1-36fc6671efc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:48.876800 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b6cf2402-8d9b-476e-8db1-36fc6671efc6 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:48.878004 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b6cf2402-8d9b-476e-8db1-36fc6671efc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:48.885820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1129/2214] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:48.889999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf2402-8d9b-476e-8db1-36fc6671efc6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:48.898569 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf2402-8d9b-476e-8db1-36fc6671efc6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:48.903108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395dff5-2a27-4a21-8947-aba32dd0cc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:48.903735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395dff5-2a27-4a21-8947-aba32dd0cc5d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:48.904046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395dff5-2a27-4a21-8947-aba32dd0cc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:48.904333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395dff5-2a27-4a21-8947-aba32dd0cc5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:48.905045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395dff5-2a27-4a21-8947-aba32dd0cc5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:48.905359 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395dff5-2a27-4a21-8947-aba32dd0cc5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:48.906947 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395dff5-2a27-4a21-8947-aba32dd0cc5d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:48.918673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1130/2215] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 16:07:48.929366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395dff5-2a27-4a21-8947-aba32dd0cc5d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:48.938693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395dff5-2a27-4a21-8947-aba32dd0cc5d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:48.948924 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d488895-2cd9-465b-b3f0-da95311f5919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:48.949588 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d488895-2cd9-465b-b3f0-da95311f5919 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:48.949874 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d488895-2cd9-465b-b3f0-da95311f5919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:48.950151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d488895-2cd9-465b-b3f0-da95311f5919 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:48.950839 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d488895-2cd9-465b-b3f0-da95311f5919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:48.952785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d488895-2cd9-465b-b3f0-da95311f5919 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:49.066324 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1131/2216] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:48 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:07:49.067940 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d488895-2cd9-465b-b3f0-da95311f5919 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:49.068275 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8be844de-9d08-41ad-aec0-0080627780e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b309e382c8b04a138c683fa1aba10c4d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:49.070711 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3d488895-2cd9-465b-b3f0-da95311f5919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:49.080577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8be844de-9d08-41ad-aec0-0080627780e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b309e382c8b04a138c683fa1aba10c4d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:49.081486 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8be844de-9d08-41ad-aec0-0080627780e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b309e382c8b04a138c683fa1aba10c4d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:49.092038 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8be844de-9d08-41ad-aec0-0080627780e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b309e382c8b04a138c683fa1aba10c4d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:49.092766 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8be844de-9d08-41ad-aec0-0080627780e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b309e382c8b04a138c683fa1aba10c4d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:49.132966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d488895-2cd9-465b-b3f0-da95311f5919 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:49.136667 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79e6c9-a648-443e-84fa-b516f5c7d5c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:49.144403 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79e6c9-a648-443e-84fa-b516f5c7d5c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.144403 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79e6c9-a648-443e-84fa-b516f5c7d5c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.144403 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79e6c9-a648-443e-84fa-b516f5c7d5c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.144403 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3d79e6c9-a648-443e-84fa-b516f5c7d5c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:49.200895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79e6c9-a648-443e-84fa-b516f5c7d5c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:49.202447 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79e6c9-a648-443e-84fa-b516f5c7d5c7 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:49.210788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1086/2217] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:48 2022] DELETE /identity/v3/users/b309e382c8b04a138c683fa1aba10c4d => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:49.213004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be844de-9d08-41ad-aec0-0080627780e3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:49.213500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8be844de-9d08-41ad-aec0-0080627780e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:49.216210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1132/2218] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:49.217879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d666c21-6c34-4c5d-800b-dabce122ea0f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.218277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d666c21-6c34-4c5d-800b-dabce122ea0f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.218666 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d666c21-6c34-4c5d-800b-dabce122ea0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.243125 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3d666c21-6c34-4c5d-800b-dabce122ea0f None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:49.245057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3d666c21-6c34-4c5d-800b-dabce122ea0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:49.295819 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be844de-9d08-41ad-aec0-0080627780e3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:49.302145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e96089-45ac-4e04-a376-5625bb311f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:49.303073 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e96089-45ac-4e04-a376-5625bb311f1a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.303417 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e96089-45ac-4e04-a376-5625bb311f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.304826 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e96089-45ac-4e04-a376-5625bb311f1a admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.304826 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e96089-45ac-4e04-a376-5625bb311f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:49.306836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e96089-45ac-4e04-a376-5625bb311f1a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:49.322640 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1133/2219] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:49.332441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d666c21-6c34-4c5d-800b-dabce122ea0f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:49.333746 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3d666c21-6c34-4c5d-800b-dabce122ea0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:49.395657 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d666c21-6c34-4c5d-800b-dabce122ea0f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:49.399480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f391f86-6372-4cb0-b1c9-0f9e1a5d0057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:49.400247 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f391f86-6372-4cb0-b1c9-0f9e1a5d0057 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.400604 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f391f86-6372-4cb0-b1c9-0f9e1a5d0057 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.400952 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f391f86-6372-4cb0-b1c9-0f9e1a5d0057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.414117 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f391f86-6372-4cb0-b1c9-0f9e1a5d0057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:49.415832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f391f86-6372-4cb0-b1c9-0f9e1a5d0057 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:49.428751 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1134/2220] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:07:49.432806 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1087/2221] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:49 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:49.436916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f391f86-6372-4cb0-b1c9-0f9e1a5d0057 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:49.449115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f391f86-6372-4cb0-b1c9-0f9e1a5d0057 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:49.455961 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016f312-0b6d-4d52-981e-6cda4fb1da8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:49.461582 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016f312-0b6d-4d52-981e-6cda4fb1da8f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.461582 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016f312-0b6d-4d52-981e-6cda4fb1da8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.461582 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016f312-0b6d-4d52-981e-6cda4fb1da8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.461582 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016f312-0b6d-4d52-981e-6cda4fb1da8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:49.461582 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016f312-0b6d-4d52-981e-6cda4fb1da8f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:49.471348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1135/2222] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:49.475849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e96089-45ac-4e04-a376-5625bb311f1a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:49.486648 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e96089-45ac-4e04-a376-5625bb311f1a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:49.491435 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ef67a-85f0-4974-a486-0cb0eb769c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:49.492139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ef67a-85f0-4974-a486-0cb0eb769c25 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.492437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ef67a-85f0-4974-a486-0cb0eb769c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.492720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ef67a-85f0-4974-a486-0cb0eb769c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.493481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ef67a-85f0-4974-a486-0cb0eb769c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:49.496095 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ef67a-85f0-4974-a486-0cb0eb769c25 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:49.515640 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1088/2223] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:49.517423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016f312-0b6d-4d52-981e-6cda4fb1da8f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:49.529488 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016f312-0b6d-4d52-981e-6cda4fb1da8f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:49.534404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7661b34-e2eb-43c7-89d0-597925505941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:49.535335 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7661b34-e2eb-43c7-89d0-597925505941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.535624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7661b34-e2eb-43c7-89d0-597925505941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.535909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7661b34-e2eb-43c7-89d0-597925505941 admin admin] PATH_INFO: `/v3/projects/05ebece07ee84df2a452c134d67b2cd8/users/914e0fe266204257a8b6ad568c6e1cb2/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.553181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7661b34-e2eb-43c7-89d0-597925505941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ebece07ee84df2a452c134d67b2cd8, user_id=914e0fe266204257a8b6ad568c6e1cb2, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:49.556093 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7661b34-e2eb-43c7-89d0-597925505941 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:49.634051 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1136/2224] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:49 2022] PUT /identity/v3/projects/05ebece07ee84df2a452c134d67b2cd8/users/914e0fe266204257a8b6ad568c6e1cb2/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:49.644438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaa6b7-1f2a-45a9-8b66-651166027734 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.645013 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaa6b7-1f2a-45a9-8b66-651166027734 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.645405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaa6b7-1f2a-45a9-8b66-651166027734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.678716 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c7eaa6b7-1f2a-45a9-8b66-651166027734 None None] MFA Rules not processed for user `914e0fe266204257a8b6ad568c6e1cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:49.680222 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c7eaa6b7-1f2a-45a9-8b66-651166027734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:49.759783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1089/2225] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:49.782337 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7661b34-e2eb-43c7-89d0-597925505941 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:49.784562 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e7661b34-e2eb-43c7-89d0-597925505941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:49.798932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c12aa9-566c-499b-9980-5b202a258dda None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.799325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c12aa9-566c-499b-9980-5b202a258dda None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.799749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c12aa9-566c-499b-9980-5b202a258dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.830840 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-02c12aa9-566c-499b-9980-5b202a258dda None None] MFA Rules not processed for user `fb70aacb7cfb41cea6a65a084e705ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:49.841342 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-02c12aa9-566c-499b-9980-5b202a258dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:49.903601 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7661b34-e2eb-43c7-89d0-597925505941 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:49.907773 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef301aa-c9a4-4c2d-8108-813924fc3b9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:49.908587 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef301aa-c9a4-4c2d-8108-813924fc3b9b service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:49.908877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef301aa-c9a4-4c2d-8108-813924fc3b9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:49.909157 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef301aa-c9a4-4c2d-8108-813924fc3b9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:49.918352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef301aa-c9a4-4c2d-8108-813924fc3b9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:49.919941 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef301aa-c9a4-4c2d-8108-813924fc3b9b service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:49.930508 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1137/2226] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:49.943434 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1090/2227] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:49.965907 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef301aa-c9a4-4c2d-8108-813924fc3b9b service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:50.059459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef301aa-c9a4-4c2d-8108-813924fc3b9b service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:50.065580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b710e2-72a1-4556-a978-014fdf852c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:50.066475 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b710e2-72a1-4556-a978-014fdf852c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:50.067028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b710e2-72a1-4556-a978-014fdf852c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:50.067028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b710e2-72a1-4556-a978-014fdf852c21 admin admin] PATH_INFO: `/v3/users/914e0fe266204257a8b6ad568c6e1cb2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:50.068571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b710e2-72a1-4556-a978-014fdf852c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=914e0fe266204257a8b6ad568c6e1cb2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:50.071353 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b710e2-72a1-4556-a978-014fdf852c21 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:50.253760 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:50.318347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-64b710e2-72a1-4556-a978-014fdf852c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '914e0fe266204257a8b6ad568c6e1cb2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:50.319011 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-64b710e2-72a1-4556-a978-014fdf852c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '914e0fe266204257a8b6ad568c6e1cb2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:50.430156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-64b710e2-72a1-4556-a978-014fdf852c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '914e0fe266204257a8b6ad568c6e1cb2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:50.440935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c12aa9-566c-499b-9980-5b202a258dda None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:50.441999 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-64b710e2-72a1-4556-a978-014fdf852c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '914e0fe266204257a8b6ad568c6e1cb2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:50.442517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-02c12aa9-566c-499b-9980-5b202a258dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:50.442926 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-64b710e2-72a1-4556-a978-014fdf852c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '914e0fe266204257a8b6ad568c6e1cb2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:50.459836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c12aa9-566c-499b-9980-5b202a258dda None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:50.466905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1138/2228] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:07:49 2022] DELETE /identity/v3/users/914e0fe266204257a8b6ad568c6e1cb2 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:07:50.467764 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8255e-d843-4bbf-bf22-a5dc0cbe6149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:50.468492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc6142-922d-42e2-a1f8-292d8c3dccbd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:50.468792 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc6142-922d-42e2-a1f8-292d8c3dccbd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:50.469079 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc6142-922d-42e2-a1f8-292d8c3dccbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:50.469373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8255e-d843-4bbf-bf22-a5dc0cbe6149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:50.469692 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8255e-d843-4bbf-bf22-a5dc0cbe6149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:50.470065 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8255e-d843-4bbf-bf22-a5dc0cbe6149 admin admin] PATH_INFO: `/v3/projects/ecad3608e62349dca9f7338d9e1679fb` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:50.471786 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8255e-d843-4bbf-bf22-a5dc0cbe6149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecad3608e62349dca9f7338d9e1679fb)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:50.473926 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8255e-d843-4bbf-bf22-a5dc0cbe6149 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:50.487672 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1edc6142-922d-42e2-a1f8-292d8c3dccbd None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:50.488983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1edc6142-922d-42e2-a1f8-292d8c3dccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:50.555699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1139/2229] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:50.562729 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc6142-922d-42e2-a1f8-292d8c3dccbd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:50.565160 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1edc6142-922d-42e2-a1f8-292d8c3dccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:50.624164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc6142-922d-42e2-a1f8-292d8c3dccbd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:50.627916 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aab8255e-d843-4bbf-bf22-a5dc0cbe6149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecad3608e62349dca9f7338d9e1679fb', 'request_id': 'req-aab8255e-d843-4bbf-bf22-a5dc0cbe6149'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:50.633872 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aab8255e-d843-4bbf-bf22-a5dc0cbe6149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecad3608e62349dca9f7338d9e1679fb', 'request_id': 'req-aab8255e-d843-4bbf-bf22-a5dc0cbe6149'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:50.676522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59a034-b313-44e5-92c4-89a93d9b4816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:50.676522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59a034-b313-44e5-92c4-89a93d9b4816 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:50.676522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59a034-b313-44e5-92c4-89a93d9b4816 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:50.676522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59a034-b313-44e5-92c4-89a93d9b4816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:50.742575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59a034-b313-44e5-92c4-89a93d9b4816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:50.744085 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59a034-b313-44e5-92c4-89a93d9b4816 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:50.754393 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1140/2230] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:50.773290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aab8255e-d843-4bbf-bf22-a5dc0cbe6149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecad3608e62349dca9f7338d9e1679fb', 'request_id': 'req-aab8255e-d843-4bbf-bf22-a5dc0cbe6149'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:50.789509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aab8255e-d843-4bbf-bf22-a5dc0cbe6149 admin admin] The token cache is being invalidate because project ecad3608e62349dca9f7338d9e1679fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:50.789509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aab8255e-d843-4bbf-bf22-a5dc0cbe6149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:50.789509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aab8255e-d843-4bbf-bf22-a5dc0cbe6149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:50.790577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1091/2231] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:50 2022] DELETE /identity/v3/projects/ecad3608e62349dca9f7338d9e1679fb => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:50.796278 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8744c-bf56-40b3-b34c-397cb371a51c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:50.796626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8744c-bf56-40b3-b34c-397cb371a51c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:50.803385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8744c-bf56-40b3-b34c-397cb371a51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:50.825338 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-12f8744c-bf56-40b3-b34c-397cb371a51c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:50.827315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-12f8744c-bf56-40b3-b34c-397cb371a51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:50.837794 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebb0a1-388b-456f-b314-25ff50ede2da None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:50.838908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebb0a1-388b-456f-b314-25ff50ede2da None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:50.840159 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebb0a1-388b-456f-b314-25ff50ede2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:50.856661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1141/2232] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:50.888573 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-10ebb0a1-388b-456f-b314-25ff50ede2da None None] MFA Rules not processed for user `c129d5516af2481081596ffa775d3ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:50.889880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b39c3-f9df-4943-8b8c-f4af97679e7a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:50.890042 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-10ebb0a1-388b-456f-b314-25ff50ede2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:50.890230 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b39c3-f9df-4943-8b8c-f4af97679e7a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:50.890453 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b39c3-f9df-4943-8b8c-f4af97679e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:50.933252 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1e1b39c3-f9df-4943-8b8c-f4af97679e7a None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:50.937106 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:50.938472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1e1b39c3-f9df-4943-8b8c-f4af97679e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:50.960010 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1142/2233] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:50.960973 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b39c3-f9df-4943-8b8c-f4af97679e7a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:50.996126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b39c3-f9df-4943-8b8c-f4af97679e7a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:50.998512 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96bc9e-1897-44d0-9e5d-b79b425652a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:50.999435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96bc9e-1897-44d0-9e5d-b79b425652a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:50.999625 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96bc9e-1897-44d0-9e5d-b79b425652a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:50.999911 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96bc9e-1897-44d0-9e5d-b79b425652a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:51.001914 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96bc9e-1897-44d0-9e5d-b79b425652a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:07:51.002047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96bc9e-1897-44d0-9e5d-b79b425652a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:51.004341 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96bc9e-1897-44d0-9e5d-b79b425652a2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:51.017896 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1143/2234] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:07:51.022223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96bc9e-1897-44d0-9e5d-b79b425652a2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:51.052081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96bc9e-1897-44d0-9e5d-b79b425652a2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:51.064566 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95c348-73ff-44a6-8534-ce80209a0616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:51.065440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95c348-73ff-44a6-8534-ce80209a0616 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:51.065739 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95c348-73ff-44a6-8534-ce80209a0616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:51.066029 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95c348-73ff-44a6-8534-ce80209a0616 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:51.066394 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1092/2235] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:51.070532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95c348-73ff-44a6-8534-ce80209a0616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:51.074785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95c348-73ff-44a6-8534-ce80209a0616 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:51.089536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebb0a1-388b-456f-b314-25ff50ede2da None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:51.098586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-10ebb0a1-388b-456f-b314-25ff50ede2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:51.220509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebb0a1-388b-456f-b314-25ff50ede2da None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:51.224287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1144/2236] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:07:51 2022] POST /identity/v3/projects => generated 365 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:51.225397 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95c348-73ff-44a6-8534-ce80209a0616 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:51.307341 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95c348-73ff-44a6-8534-ce80209a0616 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:51.313001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917fb73-ee86-4f3a-b687-2caa97326fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:51.314447 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb937d9-e317-407f-93b5-19b54177a628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:51.315133 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb937d9-e317-407f-93b5-19b54177a628 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:51.315913 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb937d9-e317-407f-93b5-19b54177a628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:51.315913 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb937d9-e317-407f-93b5-19b54177a628 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:51.316496 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb937d9-e317-407f-93b5-19b54177a628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:51.318481 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb937d9-e317-407f-93b5-19b54177a628 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:51.328122 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917fb73-ee86-4f3a-b687-2caa97326fbb service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:51.328122 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917fb73-ee86-4f3a-b687-2caa97326fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:51.328122 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917fb73-ee86-4f3a-b687-2caa97326fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:51.400343 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917fb73-ee86-4f3a-b687-2caa97326fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:51.401832 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917fb73-ee86-4f3a-b687-2caa97326fbb service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:51.411301 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1093/2237] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:51.489351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1145/2238] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:07:51 2022] POST /identity/v3/users => generated 283 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:07:51.493517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917fb73-ee86-4f3a-b687-2caa97326fbb service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:51.504366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917fb73-ee86-4f3a-b687-2caa97326fbb service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:51.509180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c8337-8539-4c01-9d6c-0b88d3e8ed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:51.509844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c8337-8539-4c01-9d6c-0b88d3e8ed7a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:51.510132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c8337-8539-4c01-9d6c-0b88d3e8ed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:51.510411 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c8337-8539-4c01-9d6c-0b88d3e8ed7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:51.511138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c8337-8539-4c01-9d6c-0b88d3e8ed7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:51.512841 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c8337-8539-4c01-9d6c-0b88d3e8ed7a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:51.523857 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1094/2239] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:07:51.528484 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb937d9-e317-407f-93b5-19b54177a628 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:51.539404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb937d9-e317-407f-93b5-19b54177a628 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:51.544406 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343558d-1e41-4454-9289-5a2ad10c848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:51.545143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343558d-1e41-4454-9289-5a2ad10c848f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:51.545521 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343558d-1e41-4454-9289-5a2ad10c848f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:51.545808 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343558d-1e41-4454-9289-5a2ad10c848f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:51.546540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343558d-1e41-4454-9289-5a2ad10c848f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:51.548185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343558d-1e41-4454-9289-5a2ad10c848f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:51.569145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c8337-8539-4c01-9d6c-0b88d3e8ed7a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:51.578404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1146/2240] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:07:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:07:51.578554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6e6c8337-8539-4c01-9d6c-0b88d3e8ed7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:51.580998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343558d-1e41-4454-9289-5a2ad10c848f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:51.592382 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c8337-8539-4c01-9d6c-0b88d3e8ed7a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:51.598782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090491ea-b183-4a49-b459-1275940a4dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:51.599796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090491ea-b183-4a49-b459-1275940a4dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:51.600132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090491ea-b183-4a49-b459-1275940a4dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:51.600417 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090491ea-b183-4a49-b459-1275940a4dbd admin admin] PATH_INFO: `/v3/projects/05ebece07ee84df2a452c134d67b2cd8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:51.601619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090491ea-b183-4a49-b459-1275940a4dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ebece07ee84df2a452c134d67b2cd8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:51.604288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090491ea-b183-4a49-b459-1275940a4dbd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:51.604777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343558d-1e41-4454-9289-5a2ad10c848f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:51.611349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8d13b-24fa-435c-a178-8107f69363c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:51.612463 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8d13b-24fa-435c-a178-8107f69363c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:51.613318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8d13b-24fa-435c-a178-8107f69363c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:51.613854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8d13b-24fa-435c-a178-8107f69363c4 admin admin] PATH_INFO: `/v3/projects/4f43e96fb95940dd9d9aa647cb42909f/users/ca672b5fa5b0463d9c7c005ce24e9039/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:51.633527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8d13b-24fa-435c-a178-8107f69363c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f43e96fb95940dd9d9aa647cb42909f, user_id=ca672b5fa5b0463d9c7c005ce24e9039, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:51.637699 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b8d13b-24fa-435c-a178-8107f69363c4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:51.750291 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1147/2241] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:07:51 2022] PUT /identity/v3/projects/4f43e96fb95940dd9d9aa647cb42909f/users/ca672b5fa5b0463d9c7c005ce24e9039/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:51.760932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e4521-4e44-426e-aebd-b94cf674509a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:51.761224 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e4521-4e44-426e-aebd-b94cf674509a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:51.761507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e4521-4e44-426e-aebd-b94cf674509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:51.762277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-090491ea-b183-4a49-b459-1275940a4dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ebece07ee84df2a452c134d67b2cd8', 'request_id': 'req-090491ea-b183-4a49-b459-1275940a4dbd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:51.769377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-090491ea-b183-4a49-b459-1275940a4dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ebece07ee84df2a452c134d67b2cd8', 'request_id': 'req-090491ea-b183-4a49-b459-1275940a4dbd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:51.786888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c57e4521-4e44-426e-aebd-b94cf674509a None None] MFA Rules not processed for user `ca672b5fa5b0463d9c7c005ce24e9039`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:51.788170 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c57e4521-4e44-426e-aebd-b94cf674509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:51.855806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1148/2242] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:07:51.911746 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-090491ea-b183-4a49-b459-1275940a4dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ebece07ee84df2a452c134d67b2cd8', 'request_id': 'req-090491ea-b183-4a49-b459-1275940a4dbd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:51.924450 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-090491ea-b183-4a49-b459-1275940a4dbd admin admin] The token cache is being invalidate because project 05ebece07ee84df2a452c134d67b2cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:07:51.924739 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-090491ea-b183-4a49-b459-1275940a4dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:51.925474 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-090491ea-b183-4a49-b459-1275940a4dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:07:51.927062 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1095/2243] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:07:51 2022] DELETE /identity/v3/projects/05ebece07ee84df2a452c134d67b2cd8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:07:52.165105 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e4521-4e44-426e-aebd-b94cf674509a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:07:52.228483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e4521-4e44-426e-aebd-b94cf674509a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:07:52.232647 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422641b0-851d-4382-8d35-78583806655c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:07:52.233381 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422641b0-851d-4382-8d35-78583806655c service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:52.233740 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422641b0-851d-4382-8d35-78583806655c service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:52.234087 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422641b0-851d-4382-8d35-78583806655c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:52.236530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-422641b0-851d-4382-8d35-78583806655c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:52.247749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422641b0-851d-4382-8d35-78583806655c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:07:52.249221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422641b0-851d-4382-8d35-78583806655c service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:07:52.259438 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1149/2244] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:07:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:07:52.430638 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:52.993921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:53.085371 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f8437-be18-41b8-ab5a-c4216f8165c9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:53.086187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f8437-be18-41b8-ab5a-c4216f8165c9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:53.086699 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f8437-be18-41b8-ab5a-c4216f8165c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:53.110055 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0d2f8437-be18-41b8-ab5a-c4216f8165c9 None None] MFA Rules not processed for user `c129d5516af2481081596ffa775d3ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:53.112348 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0d2f8437-be18-41b8-ab5a-c4216f8165c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:53.177619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1096/2245] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:55.004623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:55.502732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:57.944362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eda065-fc32-4e1a-9b40-544b6d2f58d9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:07:57.944899 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eda065-fc32-4e1a-9b40-544b6d2f58d9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:07:57.945136 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eda065-fc32-4e1a-9b40-544b6d2f58d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:07:57.966685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-88eda065-fc32-4e1a-9b40-544b6d2f58d9 None None] MFA Rules not processed for user `2a972defd2a841768633fac694002d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:07:57.967941 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-88eda065-fc32-4e1a-9b40-544b6d2f58d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:07:58.024347 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:07:58.027312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1150/2246] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:07:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:07:58.715596 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:01.273094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:01.500837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f8437-be18-41b8-ab5a-c4216f8165c9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:01.502273 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0d2f8437-be18-41b8-ab5a-c4216f8165c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:01.566186 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f8437-be18-41b8-ab5a-c4216f8165c9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:01.570682 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d9d52-8fe4-4fc1-959c-37bde0ba9d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:01.571591 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d9d52-8fe4-4fc1-959c-37bde0ba9d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:01.571832 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d9d52-8fe4-4fc1-959c-37bde0ba9d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:01.572159 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d9d52-8fe4-4fc1-959c-37bde0ba9d7a admin admin] PATH_INFO: `/v3/users/c8dc0c6c438b4c6aba78908cded7734e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:01.573357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d9d52-8fe4-4fc1-959c-37bde0ba9d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8dc0c6c438b4c6aba78908cded7734e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:01.575274 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d9d52-8fe4-4fc1-959c-37bde0ba9d7a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:01.804805 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a4d9d52-8fe4-4fc1-959c-37bde0ba9d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8dc0c6c438b4c6aba78908cded7734e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:01.817047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a4d9d52-8fe4-4fc1-959c-37bde0ba9d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8dc0c6c438b4c6aba78908cded7734e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:01.817759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a4d9d52-8fe4-4fc1-959c-37bde0ba9d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8dc0c6c438b4c6aba78908cded7734e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:01.835223 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a4d9d52-8fe4-4fc1-959c-37bde0ba9d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8dc0c6c438b4c6aba78908cded7734e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:01.835223 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a4d9d52-8fe4-4fc1-959c-37bde0ba9d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8dc0c6c438b4c6aba78908cded7734e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:01.966342 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1097/2247] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:01 2022] DELETE /identity/v3/users/c8dc0c6c438b4c6aba78908cded7734e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:01.967971 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96526fed-b49a-4653-a161-a82b409b42d4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:01.968449 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96526fed-b49a-4653-a161-a82b409b42d4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:01.968449 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96526fed-b49a-4653-a161-a82b409b42d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:01.973585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:01.992527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-96526fed-b49a-4653-a161-a82b409b42d4 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:01.993743 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-96526fed-b49a-4653-a161-a82b409b42d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:02.057824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1151/2248] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:02.076812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d9d52-8fe4-4fc1-959c-37bde0ba9d7a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:02.078080 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2a4d9d52-8fe4-4fc1-959c-37bde0ba9d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:02.144071 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d9d52-8fe4-4fc1-959c-37bde0ba9d7a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:02.147656 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294339a-74b0-4a3d-a18c-dd671f4ae3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:02.148337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294339a-74b0-4a3d-a18c-dd671f4ae3ff service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:02.148629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294339a-74b0-4a3d-a18c-dd671f4ae3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:02.148911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294339a-74b0-4a3d-a18c-dd671f4ae3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:02.158569 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294339a-74b0-4a3d-a18c-dd671f4ae3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:02.160027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294339a-74b0-4a3d-a18c-dd671f4ae3ff service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:02.169772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1098/2249] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:02.821886 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96526fed-b49a-4653-a161-a82b409b42d4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:02.824540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-96526fed-b49a-4653-a161-a82b409b42d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:02.840370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96526fed-b49a-4653-a161-a82b409b42d4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:02.859056 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e1651-f461-4097-ac63-05f16df5ca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:02.860455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e1651-f461-4097-ac63-05f16df5ca30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:02.860884 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e1651-f461-4097-ac63-05f16df5ca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:02.861164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e1651-f461-4097-ac63-05f16df5ca30 admin admin] PATH_INFO: `/v3/projects/5fc05693b0a54b8585ff14f45829b6ac` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:02.862916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e1651-f461-4097-ac63-05f16df5ca30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc05693b0a54b8585ff14f45829b6ac)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:02.865160 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e1651-f461-4097-ac63-05f16df5ca30 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:03.002726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-975e1651-f461-4097-ac63-05f16df5ca30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc05693b0a54b8585ff14f45829b6ac', 'request_id': 'req-975e1651-f461-4097-ac63-05f16df5ca30'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:03.116980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-975e1651-f461-4097-ac63-05f16df5ca30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc05693b0a54b8585ff14f45829b6ac', 'request_id': 'req-975e1651-f461-4097-ac63-05f16df5ca30'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:03.128875 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-975e1651-f461-4097-ac63-05f16df5ca30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc05693b0a54b8585ff14f45829b6ac', 'request_id': 'req-975e1651-f461-4097-ac63-05f16df5ca30'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:03.137827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-975e1651-f461-4097-ac63-05f16df5ca30 admin admin] The token cache is being invalidate because project 5fc05693b0a54b8585ff14f45829b6ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:03.138268 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-975e1651-f461-4097-ac63-05f16df5ca30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:03.140021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-975e1651-f461-4097-ac63-05f16df5ca30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:03.141161 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1152/2250] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:02 2022] DELETE /identity/v3/projects/5fc05693b0a54b8585ff14f45829b6ac => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:03.146190 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294339a-74b0-4a3d-a18c-dd671f4ae3ff service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:03.159195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294339a-74b0-4a3d-a18c-dd671f4ae3ff service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:03.217512 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595e9b5-d223-45d6-aa4e-4eef7dd3b924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:03.218389 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595e9b5-d223-45d6-aa4e-4eef7dd3b924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:03.218704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595e9b5-d223-45d6-aa4e-4eef7dd3b924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:03.218990 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595e9b5-d223-45d6-aa4e-4eef7dd3b924 admin admin] PATH_INFO: `/v3/users/bc1cd096f34b4b9e87b01eeb1ce663fc` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:03.220867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595e9b5-d223-45d6-aa4e-4eef7dd3b924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc1cd096f34b4b9e87b01eeb1ce663fc)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:03.223294 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595e9b5-d223-45d6-aa4e-4eef7dd3b924 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:03.512896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b595e9b5-d223-45d6-aa4e-4eef7dd3b924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc1cd096f34b4b9e87b01eeb1ce663fc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:03.527767 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b595e9b5-d223-45d6-aa4e-4eef7dd3b924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc1cd096f34b4b9e87b01eeb1ce663fc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:03.529716 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b595e9b5-d223-45d6-aa4e-4eef7dd3b924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc1cd096f34b4b9e87b01eeb1ce663fc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:03.538337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b595e9b5-d223-45d6-aa4e-4eef7dd3b924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc1cd096f34b4b9e87b01eeb1ce663fc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:03.539148 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b595e9b5-d223-45d6-aa4e-4eef7dd3b924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc1cd096f34b4b9e87b01eeb1ce663fc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:03.634362 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1099/2251] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:03 2022] DELETE /identity/v3/users/bc1cd096f34b4b9e87b01eeb1ce663fc => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:04.266233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e1651-f461-4097-ac63-05f16df5ca30 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:04.268539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-975e1651-f461-4097-ac63-05f16df5ca30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:04.287004 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e1651-f461-4097-ac63-05f16df5ca30 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:04.347273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007067ac-9ca2-447f-92fe-1dd9254bce73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:04.348187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007067ac-9ca2-447f-92fe-1dd9254bce73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:04.348478 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007067ac-9ca2-447f-92fe-1dd9254bce73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:04.348759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007067ac-9ca2-447f-92fe-1dd9254bce73 admin admin] PATH_INFO: `/v3/projects/3235b2a100874ca4a2a8188da5f0e035` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:04.355060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007067ac-9ca2-447f-92fe-1dd9254bce73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3235b2a100874ca4a2a8188da5f0e035)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:04.355060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007067ac-9ca2-447f-92fe-1dd9254bce73 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:04.484634 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-007067ac-9ca2-447f-92fe-1dd9254bce73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3235b2a100874ca4a2a8188da5f0e035', 'request_id': 'req-007067ac-9ca2-447f-92fe-1dd9254bce73'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:04.528885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:04.554995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-007067ac-9ca2-447f-92fe-1dd9254bce73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3235b2a100874ca4a2a8188da5f0e035', 'request_id': 'req-007067ac-9ca2-447f-92fe-1dd9254bce73'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:04.562126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-007067ac-9ca2-447f-92fe-1dd9254bce73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3235b2a100874ca4a2a8188da5f0e035', 'request_id': 'req-007067ac-9ca2-447f-92fe-1dd9254bce73'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:04.573915 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-007067ac-9ca2-447f-92fe-1dd9254bce73 admin admin] The token cache is being invalidate because project 3235b2a100874ca4a2a8188da5f0e035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:04.574216 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-007067ac-9ca2-447f-92fe-1dd9254bce73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:04.574965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-007067ac-9ca2-447f-92fe-1dd9254bce73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:04.576755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1153/2252] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:04 2022] DELETE /identity/v3/projects/3235b2a100874ca4a2a8188da5f0e035 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:04.582454 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa96145-11e4-4204-bc27-78836c131463 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:04.582950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa96145-11e4-4204-bc27-78836c131463 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:04.583059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa96145-11e4-4204-bc27-78836c131463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:04.612183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6fa96145-11e4-4204-bc27-78836c131463 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:04.613408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6fa96145-11e4-4204-bc27-78836c131463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:04.678195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1100/2253] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:04.686186 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1f3ea-ac6f-458c-8047-bd341c202421 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:04.686502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1f3ea-ac6f-458c-8047-bd341c202421 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:04.686880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1f3ea-ac6f-458c-8047-bd341c202421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:04.706166 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-96b1f3ea-ac6f-458c-8047-bd341c202421 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:04.707490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-96b1f3ea-ac6f-458c-8047-bd341c202421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:04.715267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:04.722693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1154/2254] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:04.727033 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa96145-11e4-4204-bc27-78836c131463 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:04.738366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa96145-11e4-4204-bc27-78836c131463 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:04.743370 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0b738-9fdb-464d-a7e1-93e6da927d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:04.744189 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b738-9fdb-464d-a7e1-93e6da927d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:04.744478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b738-9fdb-464d-a7e1-93e6da927d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:04.744755 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0b738-9fdb-464d-a7e1-93e6da927d30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:04.745483 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0b738-9fdb-464d-a7e1-93e6da927d30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:04.745798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0b738-9fdb-464d-a7e1-93e6da927d30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:04.747722 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0b738-9fdb-464d-a7e1-93e6da927d30 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:04.769192 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1101/2255] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:08:04.773221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1f3ea-ac6f-458c-8047-bd341c202421 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:04.783648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1f3ea-ac6f-458c-8047-bd341c202421 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:04.789169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b976050-ecea-4ea2-9d02-d486ae77ebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:04.790651 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b976050-ecea-4ea2-9d02-d486ae77ebc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:04.791140 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b976050-ecea-4ea2-9d02-d486ae77ebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:04.791436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b976050-ecea-4ea2-9d02-d486ae77ebc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:04.792349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b976050-ecea-4ea2-9d02-d486ae77ebc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:04.794456 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b976050-ecea-4ea2-9d02-d486ae77ebc5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:04.894412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1155/2256] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:04 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:04.895483 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0b738-9fdb-464d-a7e1-93e6da927d30 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:04.907209 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0b738-9fdb-464d-a7e1-93e6da927d30 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:04.972365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4b1fb-6dd1-4b4b-b7f6-e5a3f1b8eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:04.972973 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4b1fb-6dd1-4b4b-b7f6-e5a3f1b8eb37 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:04.973268 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4b1fb-6dd1-4b4b-b7f6-e5a3f1b8eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:04.973555 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4b1fb-6dd1-4b4b-b7f6-e5a3f1b8eb37 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:04.974279 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4b1fb-6dd1-4b4b-b7f6-e5a3f1b8eb37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:04.976303 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4b1fb-6dd1-4b4b-b7f6-e5a3f1b8eb37 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:05.093494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1102/2257] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:04 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:05.098159 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b976050-ecea-4ea2-9d02-d486ae77ebc5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:05.108359 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b976050-ecea-4ea2-9d02-d486ae77ebc5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:05.113395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2990b45-ee85-4083-9b48-d6b0fc47380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:05.114062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2990b45-ee85-4083-9b48-d6b0fc47380e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:05.114509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2990b45-ee85-4083-9b48-d6b0fc47380e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:05.114615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2990b45-ee85-4083-9b48-d6b0fc47380e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:05.115345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2990b45-ee85-4083-9b48-d6b0fc47380e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:05.117010 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2990b45-ee85-4083-9b48-d6b0fc47380e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:05.129659 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1156/2258] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:05.133651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4b1fb-6dd1-4b4b-b7f6-e5a3f1b8eb37 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:05.144420 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4b1fb-6dd1-4b4b-b7f6-e5a3f1b8eb37 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:05.149235 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6a421-b6c7-4e7e-988b-dab180bbdf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:05.149899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6a421-b6c7-4e7e-988b-dab180bbdf55 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:05.150188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6a421-b6c7-4e7e-988b-dab180bbdf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:05.150469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6a421-b6c7-4e7e-988b-dab180bbdf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:05.151192 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6a421-b6c7-4e7e-988b-dab180bbdf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:05.152927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6a421-b6c7-4e7e-988b-dab180bbdf55 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:05.164198 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1103/2259] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:05.167385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2990b45-ee85-4083-9b48-d6b0fc47380e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:05.177862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2990b45-ee85-4083-9b48-d6b0fc47380e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:05.182882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e4a86-9946-420e-b1ac-559cbf11ba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:05.183838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e4a86-9946-420e-b1ac-559cbf11ba11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:05.184153 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e4a86-9946-420e-b1ac-559cbf11ba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:05.184429 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e4a86-9946-420e-b1ac-559cbf11ba11 admin admin] PATH_INFO: `/v3/projects/b8a8ffbc9c7d48efad2cbcb5b6a66863/users/42c40f2564b0493f8b583cc06c757988/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:05.208779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e4a86-9946-420e-b1ac-559cbf11ba11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a8ffbc9c7d48efad2cbcb5b6a66863, user_id=42c40f2564b0493f8b583cc06c757988, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:05.211521 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e4a86-9946-420e-b1ac-559cbf11ba11 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:05.406375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1157/2260] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:05 2022] PUT /identity/v3/projects/b8a8ffbc9c7d48efad2cbcb5b6a66863/users/42c40f2564b0493f8b583cc06c757988/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:05.407373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e513209-161d-4998-b2de-d1bb0ba9c6b3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:05.407373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e513209-161d-4998-b2de-d1bb0ba9c6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:05.407373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e513209-161d-4998-b2de-d1bb0ba9c6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:05.483815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0e513209-161d-4998-b2de-d1bb0ba9c6b3 None None] MFA Rules not processed for user `42c40f2564b0493f8b583cc06c757988`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:05.484709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0e513209-161d-4998-b2de-d1bb0ba9c6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:05.589096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1104/2261] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:05.590863 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e4a86-9946-420e-b1ac-559cbf11ba11 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:05.668075 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e4a86-9946-420e-b1ac-559cbf11ba11 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:05.678201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbbcf0-e8d8-45fa-bbdf-576bf618823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:05.679039 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbbcf0-e8d8-45fa-bbdf-576bf618823b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:05.680218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbbcf0-e8d8-45fa-bbdf-576bf618823b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:05.680587 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbbcf0-e8d8-45fa-bbdf-576bf618823b admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:05.681534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbbcf0-e8d8-45fa-bbdf-576bf618823b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:05.692316 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfbbcf0-e8d8-45fa-bbdf-576bf618823b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:05.864576 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1158/2262] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:05 2022] POST /identity/v3/projects => generated 387 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:05.865370 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e513209-161d-4998-b2de-d1bb0ba9c6b3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:05.884380 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e513209-161d-4998-b2de-d1bb0ba9c6b3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:06.026450 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1285f1-1cfb-4cb8-9f3f-bddabff29792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:06.027437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1285f1-1cfb-4cb8-9f3f-bddabff29792 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:06.027901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1285f1-1cfb-4cb8-9f3f-bddabff29792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:06.033299 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1285f1-1cfb-4cb8-9f3f-bddabff29792 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:06.034522 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1285f1-1cfb-4cb8-9f3f-bddabff29792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:06.037672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1285f1-1cfb-4cb8-9f3f-bddabff29792 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:06.206918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1105/2263] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:05 2022] POST /identity/v3/users => generated 300 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:06.207850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbbcf0-e8d8-45fa-bbdf-576bf618823b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:06.224679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbbcf0-e8d8-45fa-bbdf-576bf618823b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:06.231182 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c654a7d-132e-4548-b67d-6aa7e6faf29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:06.232407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c654a7d-132e-4548-b67d-6aa7e6faf29c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:06.232880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c654a7d-132e-4548-b67d-6aa7e6faf29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:06.233346 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c654a7d-132e-4548-b67d-6aa7e6faf29c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:06.234323 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c654a7d-132e-4548-b67d-6aa7e6faf29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:06.236715 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c654a7d-132e-4548-b67d-6aa7e6faf29c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:06.264238 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1285f1-1cfb-4cb8-9f3f-bddabff29792 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:06.266619 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1159/2264] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:06.279061 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1285f1-1cfb-4cb8-9f3f-bddabff29792 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:06.285445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2850353-e813-4589-93c0-5c03705e38df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:06.286587 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850353-e813-4589-93c0-5c03705e38df admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:06.292217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850353-e813-4589-93c0-5c03705e38df admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:06.292217 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2850353-e813-4589-93c0-5c03705e38df admin admin] PATH_INFO: `/v3/projects/54816d9734eb4929b4a7ddbf34e809b7/users/247a2d35b747451caccd83e9ace8fb8a/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:06.311383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2850353-e813-4589-93c0-5c03705e38df admin admin] RBAC: Authorizing `identity:create_grant(project_id=54816d9734eb4929b4a7ddbf34e809b7, user_id=247a2d35b747451caccd83e9ace8fb8a, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:06.314239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2850353-e813-4589-93c0-5c03705e38df admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:06.414667 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33416d-a15d-4e1c-9845-127d9a736944 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:06.422852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33416d-a15d-4e1c-9845-127d9a736944 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:06.422852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33416d-a15d-4e1c-9845-127d9a736944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:06.449777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7b33416d-a15d-4e1c-9845-127d9a736944 None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:06.451981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7b33416d-a15d-4e1c-9845-127d9a736944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:06.490310 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1106/2265] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:06 2022] PUT /identity/v3/projects/54816d9734eb4929b4a7ddbf34e809b7/users/247a2d35b747451caccd83e9ace8fb8a/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:06.494939 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2850353-e813-4589-93c0-5c03705e38df admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:06.581636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1160/2266] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Jun 2 16:08:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:06.640151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2850353-e813-4589-93c0-5c03705e38df admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:06.641644 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33416d-a15d-4e1c-9845-127d9a736944 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:06.643781 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7b33416d-a15d-4e1c-9845-127d9a736944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:06.649414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd0183-05e4-478a-a1bb-04098828553d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:06.650531 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd0183-05e4-478a-a1bb-04098828553d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:06.651415 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd0183-05e4-478a-a1bb-04098828553d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:06.652131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd0183-05e4-478a-a1bb-04098828553d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:06.653538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd0183-05e4-478a-a1bb-04098828553d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:06.655508 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd0183-05e4-478a-a1bb-04098828553d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:06.675171 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1107/2267] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:06.681074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd0183-05e4-478a-a1bb-04098828553d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:06.708283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd0183-05e4-478a-a1bb-04098828553d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:06.715678 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830c99d-a077-49a7-bcf0-60419a135e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:06.716849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c99d-a077-49a7-bcf0-60419a135e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:06.717334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c99d-a077-49a7-bcf0-60419a135e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:06.717783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c99d-a077-49a7-bcf0-60419a135e8b admin admin] PATH_INFO: `/v3/projects/54816d9734eb4929b4a7ddbf34e809b7/users/247a2d35b747451caccd83e9ace8fb8a/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:06.721202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830c99d-a077-49a7-bcf0-60419a135e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=54816d9734eb4929b4a7ddbf34e809b7, user_id=247a2d35b747451caccd83e9ace8fb8a, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:06.724119 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830c99d-a077-49a7-bcf0-60419a135e8b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:06.742548 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1108/2268] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:06 2022] PUT /identity/v3/projects/54816d9734eb4929b4a7ddbf34e809b7/users/247a2d35b747451caccd83e9ace8fb8a/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:06.754096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25744677-12b5-4116-bcfd-63fdc0e7648e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:06.754603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25744677-12b5-4116-bcfd-63fdc0e7648e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:06.755101 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25744677-12b5-4116-bcfd-63fdc0e7648e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:06.817805 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-25744677-12b5-4116-bcfd-63fdc0e7648e None None] MFA Rules not processed for user `247a2d35b747451caccd83e9ace8fb8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:06.819391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-25744677-12b5-4116-bcfd-63fdc0e7648e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:06.821072 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33416d-a15d-4e1c-9845-127d9a736944 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:06.906327 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1109/2269] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:06.919050 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25744677-12b5-4116-bcfd-63fdc0e7648e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:06.920666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-25744677-12b5-4116-bcfd-63fdc0e7648e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:06.933223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec039417-ce9f-4981-84db-5b323def6785 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:06.934908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec039417-ce9f-4981-84db-5b323def6785 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:06.935539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec039417-ce9f-4981-84db-5b323def6785 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:06.936439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec039417-ce9f-4981-84db-5b323def6785 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:06.997005 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25744677-12b5-4116-bcfd-63fdc0e7648e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:06.999779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec039417-ce9f-4981-84db-5b323def6785 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:07.001495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec039417-ce9f-4981-84db-5b323def6785 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:07.003119 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b037c3-8ae8-47ef-846d-0af169058b03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:07.003722 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b037c3-8ae8-47ef-846d-0af169058b03 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:07.004178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b037c3-8ae8-47ef-846d-0af169058b03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:07.004474 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b037c3-8ae8-47ef-846d-0af169058b03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:07.011112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1161/2270] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 16:08:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 16:08:07.030776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b037c3-8ae8-47ef-846d-0af169058b03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:07.033109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b037c3-8ae8-47ef-846d-0af169058b03 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:07.068199 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1110/2271] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:08:08.023273 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:08.734908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:08.993747 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec039417-ce9f-4981-84db-5b323def6785 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:09.118108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec039417-ce9f-4981-84db-5b323def6785 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:09.146806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadcf36-5874-48fa-b5b4-ce377317f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:09.148895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadcf36-5874-48fa-b5b4-ce377317f18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:09.149211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadcf36-5874-48fa-b5b4-ce377317f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:09.149503 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadcf36-5874-48fa-b5b4-ce377317f18f admin admin] PATH_INFO: `/v3/users/42c40f2564b0493f8b583cc06c757988` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:09.155979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadcf36-5874-48fa-b5b4-ce377317f18f admin admin] RBAC: Authorizing `identity:delete_user(user_id=42c40f2564b0493f8b583cc06c757988)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:09.160980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadcf36-5874-48fa-b5b4-ce377317f18f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:10.109572 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7aadcf36-5874-48fa-b5b4-ce377317f18f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42c40f2564b0493f8b583cc06c757988'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:10.111852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7aadcf36-5874-48fa-b5b4-ce377317f18f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42c40f2564b0493f8b583cc06c757988'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:10.263468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7aadcf36-5874-48fa-b5b4-ce377317f18f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42c40f2564b0493f8b583cc06c757988'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:10.277541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7aadcf36-5874-48fa-b5b4-ce377317f18f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42c40f2564b0493f8b583cc06c757988'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:10.278548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7aadcf36-5874-48fa-b5b4-ce377317f18f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42c40f2564b0493f8b583cc06c757988'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:10.306580 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aa1c9-1679-4b29-bd2c-949b6d292b42 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:10.306580 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aa1c9-1679-4b29-bd2c-949b6d292b42 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:10.306580 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aa1c9-1679-4b29-bd2c-949b6d292b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:10.307553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1162/2272] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:08 2022] DELETE /identity/v3/users/42c40f2564b0493f8b583cc06c757988 => generated 0 bytes in 1308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:10.358272 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4f3aa1c9-1679-4b29-bd2c-949b6d292b42 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:10.370618 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f3aa1c9-1679-4b29-bd2c-949b6d292b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:10.508031 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1111/2273] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:10.517689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadcf36-5874-48fa-b5b4-ce377317f18f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:10.520957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7aadcf36-5874-48fa-b5b4-ce377317f18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:10.600237 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadcf36-5874-48fa-b5b4-ce377317f18f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:10.605758 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33f3d2-e845-4a17-9001-5b665ff8ef10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:10.605984 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33f3d2-e845-4a17-9001-5b665ff8ef10 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:10.606183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33f3d2-e845-4a17-9001-5b665ff8ef10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:10.606472 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33f3d2-e845-4a17-9001-5b665ff8ef10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:10.618646 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33f3d2-e845-4a17-9001-5b665ff8ef10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:10.621224 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33f3d2-e845-4a17-9001-5b665ff8ef10 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:10.640231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1163/2274] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:11.341597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aa1c9-1679-4b29-bd2c-949b6d292b42 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:11.343357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f3aa1c9-1679-4b29-bd2c-949b6d292b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:11.362075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aa1c9-1679-4b29-bd2c-949b6d292b42 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:11.367212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:11.368327 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:11.379301 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:11.379721 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a admin admin] PATH_INFO: `/v3/projects/b8a8ffbc9c7d48efad2cbcb5b6a66863` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:11.384780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a8ffbc9c7d48efad2cbcb5b6a66863)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:11.387110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:11.583742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a8ffbc9c7d48efad2cbcb5b6a66863', 'request_id': 'req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:11.593417 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a8ffbc9c7d48efad2cbcb5b6a66863', 'request_id': 'req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:11.743388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a8ffbc9c7d48efad2cbcb5b6a66863', 'request_id': 'req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:11.756566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a admin admin] The token cache is being invalidate because project b8a8ffbc9c7d48efad2cbcb5b6a66863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:11.757837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:11.758179 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:11.760307 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1112/2275] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:11 2022] DELETE /identity/v3/projects/b8a8ffbc9c7d48efad2cbcb5b6a66863 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:08:11.764629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33f3d2-e845-4a17-9001-5b665ff8ef10 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:11.781062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33f3d2-e845-4a17-9001-5b665ff8ef10 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:11.871617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2beba43-9144-4409-98ec-2614a975c97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:11.875123 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2beba43-9144-4409-98ec-2614a975c97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:11.875622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2beba43-9144-4409-98ec-2614a975c97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:11.876146 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2beba43-9144-4409-98ec-2614a975c97b admin admin] PATH_INFO: `/v3/users/247a2d35b747451caccd83e9ace8fb8a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:11.877770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2beba43-9144-4409-98ec-2614a975c97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=247a2d35b747451caccd83e9ace8fb8a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:11.880867 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2beba43-9144-4409-98ec-2614a975c97b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:12.206102 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b2beba43-9144-4409-98ec-2614a975c97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247a2d35b747451caccd83e9ace8fb8a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:12.207034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b2beba43-9144-4409-98ec-2614a975c97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247a2d35b747451caccd83e9ace8fb8a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:12.368521 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b2beba43-9144-4409-98ec-2614a975c97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247a2d35b747451caccd83e9ace8fb8a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:12.387270 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b2beba43-9144-4409-98ec-2614a975c97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247a2d35b747451caccd83e9ace8fb8a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:12.388060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b2beba43-9144-4409-98ec-2614a975c97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247a2d35b747451caccd83e9ace8fb8a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:12.428879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1164/2276] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:11 2022] DELETE /identity/v3/users/247a2d35b747451caccd83e9ace8fb8a => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:12.985359 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:13.071978 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:13.073666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:13.119123 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94f03c-c03c-4d0d-bdc7-9e739fb27f2a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:13.201245 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a136f69-359c-49fe-a509-70e08d5f7bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:13.205147 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a136f69-359c-49fe-a509-70e08d5f7bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:13.205812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a136f69-359c-49fe-a509-70e08d5f7bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:13.206261 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a136f69-359c-49fe-a509-70e08d5f7bf0 admin admin] PATH_INFO: `/v3/projects/54816d9734eb4929b4a7ddbf34e809b7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:13.207807 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a136f69-359c-49fe-a509-70e08d5f7bf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54816d9734eb4929b4a7ddbf34e809b7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:13.209887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a136f69-359c-49fe-a509-70e08d5f7bf0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:13.299021 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:13.427926 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a136f69-359c-49fe-a509-70e08d5f7bf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54816d9734eb4929b4a7ddbf34e809b7', 'request_id': 'req-3a136f69-359c-49fe-a509-70e08d5f7bf0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:13.436757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a136f69-359c-49fe-a509-70e08d5f7bf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54816d9734eb4929b4a7ddbf34e809b7', 'request_id': 'req-3a136f69-359c-49fe-a509-70e08d5f7bf0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:13.557439 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a136f69-359c-49fe-a509-70e08d5f7bf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54816d9734eb4929b4a7ddbf34e809b7', 'request_id': 'req-3a136f69-359c-49fe-a509-70e08d5f7bf0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:13.571129 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a136f69-359c-49fe-a509-70e08d5f7bf0 admin admin] The token cache is being invalidate because project 54816d9734eb4929b4a7ddbf34e809b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:13.571506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a136f69-359c-49fe-a509-70e08d5f7bf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:13.572279 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3a136f69-359c-49fe-a509-70e08d5f7bf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:13.574027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1113/2277] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:13 2022] DELETE /identity/v3/projects/54816d9734eb4929b4a7ddbf34e809b7 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:13.579705 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d8fe2-90d0-4d7f-ae73-e3662bc16c30 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:13.580021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d8fe2-90d0-4d7f-ae73-e3662bc16c30 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:13.580495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d8fe2-90d0-4d7f-ae73-e3662bc16c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:13.601719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2e2d8fe2-90d0-4d7f-ae73-e3662bc16c30 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:13.603760 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2e2d8fe2-90d0-4d7f-ae73-e3662bc16c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:13.683879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1165/2278] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:13.692533 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260654f-c04c-4dda-a582-d4335981ce78 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:13.693099 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260654f-c04c-4dda-a582-d4335981ce78 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:13.700487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260654f-c04c-4dda-a582-d4335981ce78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:13.714461 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7260654f-c04c-4dda-a582-d4335981ce78 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:13.716442 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7260654f-c04c-4dda-a582-d4335981ce78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:13.730285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1114/2279] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:13.736541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d8fe2-90d0-4d7f-ae73-e3662bc16c30 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:13.748122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d8fe2-90d0-4d7f-ae73-e3662bc16c30 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:13.754717 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b6207-6829-43f5-a685-6c1b86ab1531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:13.755439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b6207-6829-43f5-a685-6c1b86ab1531 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:13.756023 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b6207-6829-43f5-a685-6c1b86ab1531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:13.756317 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b6207-6829-43f5-a685-6c1b86ab1531 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:13.766289 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b6207-6829-43f5-a685-6c1b86ab1531 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:13.766679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b6207-6829-43f5-a685-6c1b86ab1531 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:13.768489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b6207-6829-43f5-a685-6c1b86ab1531 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:13.785035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1166/2280] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:08:13.786864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260654f-c04c-4dda-a582-d4335981ce78 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:13.797562 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260654f-c04c-4dda-a582-d4335981ce78 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:13.802653 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8217915-3ac9-4d05-a5f4-64587a4e4dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:13.803431 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8217915-3ac9-4d05-a5f4-64587a4e4dbb admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:13.803773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8217915-3ac9-4d05-a5f4-64587a4e4dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:13.804283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8217915-3ac9-4d05-a5f4-64587a4e4dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:13.805530 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8217915-3ac9-4d05-a5f4-64587a4e4dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:13.808637 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8217915-3ac9-4d05-a5f4-64587a4e4dbb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:13.940911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1115/2281] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:13 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:13.944737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b6207-6829-43f5-a685-6c1b86ab1531 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:13.980049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b6207-6829-43f5-a685-6c1b86ab1531 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:14.199454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f7719-6546-40d1-9205-9fa9dc706738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:14.201066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f7719-6546-40d1-9205-9fa9dc706738 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:14.202548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f7719-6546-40d1-9205-9fa9dc706738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:14.203628 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f7719-6546-40d1-9205-9fa9dc706738 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:14.205103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f7719-6546-40d1-9205-9fa9dc706738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:14.209329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f7719-6546-40d1-9205-9fa9dc706738 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:14.339092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1167/2282] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:13 2022] POST /identity/v3/users => generated 293 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:08:14.352051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8217915-3ac9-4d05-a5f4-64587a4e4dbb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:14.369102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8217915-3ac9-4d05-a5f4-64587a4e4dbb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:14.375441 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0125de-2bcc-4f4a-b5d9-c2fae47c7bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:14.376710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0125de-2bcc-4f4a-b5d9-c2fae47c7bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:14.377274 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0125de-2bcc-4f4a-b5d9-c2fae47c7bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:14.377675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0125de-2bcc-4f4a-b5d9-c2fae47c7bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:14.378575 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0125de-2bcc-4f4a-b5d9-c2fae47c7bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:14.380520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0125de-2bcc-4f4a-b5d9-c2fae47c7bd3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:14.397077 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1116/2283] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:14.400847 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f7719-6546-40d1-9205-9fa9dc706738 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:14.413894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f7719-6546-40d1-9205-9fa9dc706738 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:14.430824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5236aa4-fc96-4880-9684-fbfb1f9bedd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:14.431732 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5236aa4-fc96-4880-9684-fbfb1f9bedd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:14.432220 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5236aa4-fc96-4880-9684-fbfb1f9bedd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:14.432504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5236aa4-fc96-4880-9684-fbfb1f9bedd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:14.433311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5236aa4-fc96-4880-9684-fbfb1f9bedd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:14.434949 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5236aa4-fc96-4880-9684-fbfb1f9bedd6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:14.460302 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1168/2284] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:14.464323 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0125de-2bcc-4f4a-b5d9-c2fae47c7bd3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:14.478437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0125de-2bcc-4f4a-b5d9-c2fae47c7bd3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:14.496773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472be19b-617e-451d-96e6-27f4cd29aebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:14.498092 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be19b-617e-451d-96e6-27f4cd29aebb admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:14.498554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be19b-617e-451d-96e6-27f4cd29aebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:14.499014 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be19b-617e-451d-96e6-27f4cd29aebb admin admin] PATH_INFO: `/v3/projects/ec7993ea4a0045048d3139ce080a5acb/users/9846be1861c743b58217352e0002cd5a/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:14.521878 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472be19b-617e-451d-96e6-27f4cd29aebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec7993ea4a0045048d3139ce080a5acb, user_id=9846be1861c743b58217352e0002cd5a, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:14.525740 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472be19b-617e-451d-96e6-27f4cd29aebb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:14.943579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1117/2285] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:14 2022] PUT /identity/v3/projects/ec7993ea4a0045048d3139ce080a5acb/users/9846be1861c743b58217352e0002cd5a/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:14.962984 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b39a1f-09cc-4f68-9281-d3f1433cfedb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:14.963281 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b39a1f-09cc-4f68-9281-d3f1433cfedb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:14.963597 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b39a1f-09cc-4f68-9281-d3f1433cfedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:14.991483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-78b39a1f-09cc-4f68-9281-d3f1433cfedb None None] MFA Rules not processed for user `9846be1861c743b58217352e0002cd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:14.992813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-78b39a1f-09cc-4f68-9281-d3f1433cfedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:15.073607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1169/2286] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:15.078666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472be19b-617e-451d-96e6-27f4cd29aebb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:15.151076 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472be19b-617e-451d-96e6-27f4cd29aebb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:15.155751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ea8e6-0bf6-45cf-bafb-12ad584bbecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:15.156471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ea8e6-0bf6-45cf-bafb-12ad584bbecf admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:15.156765 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ea8e6-0bf6-45cf-bafb-12ad584bbecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:15.157050 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ea8e6-0bf6-45cf-bafb-12ad584bbecf admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:15.157750 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ea8e6-0bf6-45cf-bafb-12ad584bbecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:15.159675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ea8e6-0bf6-45cf-bafb-12ad584bbecf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:15.329242 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1118/2287] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:15 2022] POST /identity/v3/projects => generated 385 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:15.330542 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b39a1f-09cc-4f68-9281-d3f1433cfedb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:15.360366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b39a1f-09cc-4f68-9281-d3f1433cfedb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:15.465050 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a6f93-ca5e-4e5f-8c47-0ed7731bf0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:15.465755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a6f93-ca5e-4e5f-8c47-0ed7731bf0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:15.466048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a6f93-ca5e-4e5f-8c47-0ed7731bf0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:15.466326 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a6f93-ca5e-4e5f-8c47-0ed7731bf0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:15.467104 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a6f93-ca5e-4e5f-8c47-0ed7731bf0c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:15.469190 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a6f93-ca5e-4e5f-8c47-0ed7731bf0c3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:15.597304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1170/2288] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:15 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:15.600391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ea8e6-0bf6-45cf-bafb-12ad584bbecf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:15.616511 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ea8e6-0bf6-45cf-bafb-12ad584bbecf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:15.636772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99586b-e3d9-4a04-bf3e-ab89f968771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:15.637936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99586b-e3d9-4a04-bf3e-ab89f968771e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:15.643496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99586b-e3d9-4a04-bf3e-ab89f968771e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:15.644146 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99586b-e3d9-4a04-bf3e-ab89f968771e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:15.645126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99586b-e3d9-4a04-bf3e-ab89f968771e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:15.646958 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99586b-e3d9-4a04-bf3e-ab89f968771e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:15.670696 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1119/2289] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:08:15.672394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a6f93-ca5e-4e5f-8c47-0ed7731bf0c3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:15.689282 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a6f93-ca5e-4e5f-8c47-0ed7731bf0c3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:15.699650 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceefb27-5972-4c48-9407-bf78c21c9464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:15.700784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceefb27-5972-4c48-9407-bf78c21c9464 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:15.701252 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceefb27-5972-4c48-9407-bf78c21c9464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:15.701724 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceefb27-5972-4c48-9407-bf78c21c9464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:15.703650 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceefb27-5972-4c48-9407-bf78c21c9464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:15.705692 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceefb27-5972-4c48-9407-bf78c21c9464 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:15.721008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1171/2290] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:15.728164 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99586b-e3d9-4a04-bf3e-ab89f968771e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:15.750603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99586b-e3d9-4a04-bf3e-ab89f968771e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:15.756543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8bd53-896e-4ca7-89ec-cac4bc0a1dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:15.757509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8bd53-896e-4ca7-89ec-cac4bc0a1dea admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:15.757889 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8bd53-896e-4ca7-89ec-cac4bc0a1dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:15.758283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8bd53-896e-4ca7-89ec-cac4bc0a1dea admin admin] PATH_INFO: `/v3/projects/a925e1768cda4b6b81ec49c8b7941c1e/users/903c0a71fd5e41578244e9b52bad05a2/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:15.788963 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8bd53-896e-4ca7-89ec-cac4bc0a1dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a925e1768cda4b6b81ec49c8b7941c1e, user_id=903c0a71fd5e41578244e9b52bad05a2, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:15.792127 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8bd53-896e-4ca7-89ec-cac4bc0a1dea admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:15.884658 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1120/2291] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:15 2022] PUT /identity/v3/projects/a925e1768cda4b6b81ec49c8b7941c1e/users/903c0a71fd5e41578244e9b52bad05a2/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:15.894797 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa136d6-7b27-4df0-9572-61a1ae2c5868 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:15.902622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa136d6-7b27-4df0-9572-61a1ae2c5868 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:15.902622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa136d6-7b27-4df0-9572-61a1ae2c5868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:15.954956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-daa136d6-7b27-4df0-9572-61a1ae2c5868 None None] MFA Rules not processed for user `903c0a71fd5e41578244e9b52bad05a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:15.960323 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-daa136d6-7b27-4df0-9572-61a1ae2c5868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:16.050473 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1172/2292] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:16.054326 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8bd53-896e-4ca7-89ec-cac4bc0a1dea admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:16.228193 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8bd53-896e-4ca7-89ec-cac4bc0a1dea admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:16.230782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873086e4-136f-45d7-85cd-fa439276c24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:16.231479 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873086e4-136f-45d7-85cd-fa439276c24e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:16.231767 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873086e4-136f-45d7-85cd-fa439276c24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:16.232090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873086e4-136f-45d7-85cd-fa439276c24e admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:16.232990 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873086e4-136f-45d7-85cd-fa439276c24e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:16.236428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873086e4-136f-45d7-85cd-fa439276c24e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:16.502219 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1121/2293] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:16 2022] POST /identity/v3/projects => generated 383 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:08:16.506121 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa136d6-7b27-4df0-9572-61a1ae2c5868 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:16.524412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa136d6-7b27-4df0-9572-61a1ae2c5868 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:16.620371 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b19ea1-280b-4c64-9849-19b4a0de0aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:16.626995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19ea1-280b-4c64-9849-19b4a0de0aba admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:16.626995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19ea1-280b-4c64-9849-19b4a0de0aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:16.626995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b19ea1-280b-4c64-9849-19b4a0de0aba admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:16.626995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b19ea1-280b-4c64-9849-19b4a0de0aba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:16.626995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b19ea1-280b-4c64-9849-19b4a0de0aba admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:16.728140 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1173/2294] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:16 2022] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:16.729404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873086e4-136f-45d7-85cd-fa439276c24e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:16.758566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873086e4-136f-45d7-85cd-fa439276c24e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:16.770156 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91220fc-dc34-4b7b-afdb-134181261067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:16.772377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91220fc-dc34-4b7b-afdb-134181261067 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:16.772377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91220fc-dc34-4b7b-afdb-134181261067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:16.773038 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91220fc-dc34-4b7b-afdb-134181261067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:16.774023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91220fc-dc34-4b7b-afdb-134181261067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:16.776346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91220fc-dc34-4b7b-afdb-134181261067 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:16.802776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1122/2295] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:16.803956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b19ea1-280b-4c64-9849-19b4a0de0aba admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:16.814720 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b19ea1-280b-4c64-9849-19b4a0de0aba admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:16.819569 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0c10e-1c7b-429d-86a9-b3fc91a5b705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:16.820349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0c10e-1c7b-429d-86a9-b3fc91a5b705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:16.824028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0c10e-1c7b-429d-86a9-b3fc91a5b705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:16.824028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0c10e-1c7b-429d-86a9-b3fc91a5b705 admin admin] PATH_INFO: `/v3/projects/c65d35d7cfaa4d29b15d8050370765f1/users/085304f7845a4c68b2b5215c9b8cc736/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:16.853652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0c10e-1c7b-429d-86a9-b3fc91a5b705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65d35d7cfaa4d29b15d8050370765f1, user_id=085304f7845a4c68b2b5215c9b8cc736, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:16.856539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0c10e-1c7b-429d-86a9-b3fc91a5b705 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:16.895182 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:16.990211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1174/2296] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:16 2022] PUT /identity/v3/projects/c65d35d7cfaa4d29b15d8050370765f1/users/085304f7845a4c68b2b5215c9b8cc736/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:16.993875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91220fc-dc34-4b7b-afdb-134181261067 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:17.005772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91220fc-dc34-4b7b-afdb-134181261067 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:17.102860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35c5ce-939c-49a3-b6e9-7b7805600648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:17.103653 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35c5ce-939c-49a3-b6e9-7b7805600648 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:17.103949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35c5ce-939c-49a3-b6e9-7b7805600648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:17.104313 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35c5ce-939c-49a3-b6e9-7b7805600648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:17.107329 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35c5ce-939c-49a3-b6e9-7b7805600648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:17.107329 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35c5ce-939c-49a3-b6e9-7b7805600648 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:17.121074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1123/2297] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:17.125516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0c10e-1c7b-429d-86a9-b3fc91a5b705 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:17.139930 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0c10e-1c7b-429d-86a9-b3fc91a5b705 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:17.152351 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222e998-f65b-4535-80d6-9fe0e46ebbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:17.153895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222e998-f65b-4535-80d6-9fe0e46ebbd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:17.160690 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:17.172663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222e998-f65b-4535-80d6-9fe0e46ebbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:17.173318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222e998-f65b-4535-80d6-9fe0e46ebbd8 admin admin] PATH_INFO: `/v3/projects/c65d35d7cfaa4d29b15d8050370765f1/users/085304f7845a4c68b2b5215c9b8cc736/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:17.176037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222e998-f65b-4535-80d6-9fe0e46ebbd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c65d35d7cfaa4d29b15d8050370765f1, user_id=085304f7845a4c68b2b5215c9b8cc736, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:17.192007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222e998-f65b-4535-80d6-9fe0e46ebbd8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:17.223302 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1175/2298] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:17 2022] PUT /identity/v3/projects/c65d35d7cfaa4d29b15d8050370765f1/users/085304f7845a4c68b2b5215c9b8cc736/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:17.235015 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4346d-2c2c-4471-b127-876451efd130 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:17.235312 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4346d-2c2c-4471-b127-876451efd130 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:17.235598 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4346d-2c2c-4471-b127-876451efd130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:17.276557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-90a4346d-2c2c-4471-b127-876451efd130 None None] MFA Rules not processed for user `085304f7845a4c68b2b5215c9b8cc736`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:17.279016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-90a4346d-2c2c-4471-b127-876451efd130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:17.403216 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1124/2299] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:17.421192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222e998-f65b-4535-80d6-9fe0e46ebbd8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:17.428031 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2222e998-f65b-4535-80d6-9fe0e46ebbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:17.529898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222e998-f65b-4535-80d6-9fe0e46ebbd8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:17.533769 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eea1be-0e34-43a0-9587-1a45bfb8c8ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:17.534596 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eea1be-0e34-43a0-9587-1a45bfb8c8ac service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:17.534897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eea1be-0e34-43a0-9587-1a45bfb8c8ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:17.535178 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eea1be-0e34-43a0-9587-1a45bfb8c8ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:17.660994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eea1be-0e34-43a0-9587-1a45bfb8c8ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:17.665583 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eea1be-0e34-43a0-9587-1a45bfb8c8ac service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:17.704666 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1176/2300] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:18.550004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f66eba-e210-4602-ae54-771356294e25 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:18.553393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f66eba-e210-4602-ae54-771356294e25 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:18.553393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f66eba-e210-4602-ae54-771356294e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:18.586061 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-90f66eba-e210-4602-ae54-771356294e25 None None] MFA Rules not processed for user `c129d5516af2481081596ffa775d3ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:18.588337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-90f66eba-e210-4602-ae54-771356294e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:18.690558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1125/2301] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:19.985767 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:20.174028 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:20.910670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eea1be-0e34-43a0-9587-1a45bfb8c8ac service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:20.928674 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eea1be-0e34-43a0-9587-1a45bfb8c8ac service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:20.932666 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273ce10-8759-4cd7-a386-be64d9e18430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:20.933383 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273ce10-8759-4cd7-a386-be64d9e18430 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:20.933674 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273ce10-8759-4cd7-a386-be64d9e18430 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:20.933959 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273ce10-8759-4cd7-a386-be64d9e18430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:20.996494 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273ce10-8759-4cd7-a386-be64d9e18430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:20.998052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273ce10-8759-4cd7-a386-be64d9e18430 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:21.008256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1177/2302] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:21.236912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:22.145266 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:22.558827 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f66eba-e210-4602-ae54-771356294e25 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:22.569181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f66eba-e210-4602-ae54-771356294e25 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:22.573272 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded00792-3c58-4a93-b9c4-5c7bb86847f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:22.573937 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded00792-3c58-4a93-b9c4-5c7bb86847f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:22.574222 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded00792-3c58-4a93-b9c4-5c7bb86847f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:22.578203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded00792-3c58-4a93-b9c4-5c7bb86847f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:22.585818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded00792-3c58-4a93-b9c4-5c7bb86847f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:22.587268 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded00792-3c58-4a93-b9c4-5c7bb86847f6 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:22.596995 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1126/2303] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:22.601159 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:23.305358 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:23.682210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:23.914434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:24.054164 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:26.608668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:26.751280 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:27.349596 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386516be-a8d0-456b-85f1-c646ae9b1bec None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:27.350102 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386516be-a8d0-456b-85f1-c646ae9b1bec None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:27.350493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386516be-a8d0-456b-85f1-c646ae9b1bec None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:27.352027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1178/2304] 10.222.0.50 () {54 vars in 921 bytes} [Thu Jun 2 16:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:08:27.362063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671360ba-d8c6-4070-b3ad-e69041a03516 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:27.362361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671360ba-d8c6-4070-b3ad-e69041a03516 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:27.362824 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671360ba-d8c6-4070-b3ad-e69041a03516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:27.429273 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-671360ba-d8c6-4070-b3ad-e69041a03516 None None] MFA Rules not processed for user `2e53683ae2b34947a1550de269b74d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:27.430783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-671360ba-d8c6-4070-b3ad-e69041a03516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:27.525951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1127/2305] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Jun 2 16:08:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:27.538766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386516be-a8d0-456b-85f1-c646ae9b1bec None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:27.540569 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-386516be-a8d0-456b-85f1-c646ae9b1bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:27.604711 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386516be-a8d0-456b-85f1-c646ae9b1bec None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:27.611864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fe56a-521d-4dc8-8862-7c8e611e2721 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5157588644972a6a4554b3a9f1d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:27.612640 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fe56a-521d-4dc8-8862-7c8e611e2721 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:27.612951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fe56a-521d-4dc8-8862-7c8e611e2721 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:27.613879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fe56a-521d-4dc8-8862-7c8e611e2721 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:27.627835 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fe56a-521d-4dc8-8862-7c8e611e2721 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:27.629855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fe56a-521d-4dc8-8862-7c8e611e2721 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:27.641450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1179/2306] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:27.853391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e14006-9024-42a7-a0ed-f7f1781a1473 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:27.853934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e14006-9024-42a7-a0ed-f7f1781a1473 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:27.854057 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e14006-9024-42a7-a0ed-f7f1781a1473 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:27.855344 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1128/2307] 10.222.0.50 () {54 vars in 921 bytes} [Thu Jun 2 16:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 16:08:27.862289 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906a71c-fc02-458e-8e9f-68962399b3c1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:27.862658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906a71c-fc02-458e-8e9f-68962399b3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:27.863026 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906a71c-fc02-458e-8e9f-68962399b3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:27.881084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9906a71c-fc02-458e-8e9f-68962399b3c1 None None] MFA Rules not processed for user `c3ec010ab4c5414a8782cecf202fbcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:27.882298 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9906a71c-fc02-458e-8e9f-68962399b3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:27.935290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1180/2308] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Jun 2 16:08:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:27.947301 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e14006-9024-42a7-a0ed-f7f1781a1473 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:27.949129 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-19e14006-9024-42a7-a0ed-f7f1781a1473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:27.973235 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e14006-9024-42a7-a0ed-f7f1781a1473 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:27.982065 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb75925-8c3c-4852-8767-10eaa83121a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:27.982731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb75925-8c3c-4852-8767-10eaa83121a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:27.983021 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb75925-8c3c-4852-8767-10eaa83121a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:27.986395 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb75925-8c3c-4852-8767-10eaa83121a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:27.995632 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb75925-8c3c-4852-8767-10eaa83121a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:28.044489 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb75925-8c3c-4852-8767-10eaa83121a8 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:28.044489 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1129/2309] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:28.070864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906a71c-fc02-458e-8e9f-68962399b3c1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:28.097639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adef4d-cfc0-4a71-a40b-956cdb22e02d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:28.098305 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adef4d-cfc0-4a71-a40b-956cdb22e02d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:28.098596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adef4d-cfc0-4a71-a40b-956cdb22e02d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:28.100005 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1130/2310] 10.222.0.50 () {54 vars in 921 bytes} [Thu Jun 2 16:08:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 16:08:28.106857 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dba0b-2eb3-40d2-a7e6-8c96692ac28c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:28.107165 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dba0b-2eb3-40d2-a7e6-8c96692ac28c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:28.107435 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dba0b-2eb3-40d2-a7e6-8c96692ac28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:28.127955 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-137dba0b-2eb3-40d2-a7e6-8c96692ac28c None None] MFA Rules not processed for user `2e53683ae2b34947a1550de269b74d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:28.129209 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-137dba0b-2eb3-40d2-a7e6-8c96692ac28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:28.139392 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1131/2311] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Jun 2 16:08:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:28.147941 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906a71c-fc02-458e-8e9f-68962399b3c1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:28.149502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75949190-db4f-45ee-87df-27804ae57533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:28.150335 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dba0b-2eb3-40d2-a7e6-8c96692ac28c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:28.150478 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75949190-db4f-45ee-87df-27804ae57533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:28.150659 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75949190-db4f-45ee-87df-27804ae57533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:28.150940 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75949190-db4f-45ee-87df-27804ae57533 admin admin] PATH_INFO: `/v3/users/9846be1861c743b58217352e0002cd5a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:28.152188 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75949190-db4f-45ee-87df-27804ae57533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9846be1861c743b58217352e0002cd5a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:28.154188 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75949190-db4f-45ee-87df-27804ae57533 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:28.161103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dba0b-2eb3-40d2-a7e6-8c96692ac28c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:28.164746 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff183c-eb79-4626-b18f-88b6a1bfe745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:28.165438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff183c-eb79-4626-b18f-88b6a1bfe745 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:28.165725 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff183c-eb79-4626-b18f-88b6a1bfe745 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:28.166002 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff183c-eb79-4626-b18f-88b6a1bfe745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:28.177530 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff183c-eb79-4626-b18f-88b6a1bfe745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:28.179426 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff183c-eb79-4626-b18f-88b6a1bfe745 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:28.191332 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1132/2312] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:08:28.456592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-75949190-db4f-45ee-87df-27804ae57533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9846be1861c743b58217352e0002cd5a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:28.457383 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-75949190-db4f-45ee-87df-27804ae57533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9846be1861c743b58217352e0002cd5a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:28.588938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-75949190-db4f-45ee-87df-27804ae57533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9846be1861c743b58217352e0002cd5a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:28.596421 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-75949190-db4f-45ee-87df-27804ae57533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9846be1861c743b58217352e0002cd5a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:28.597080 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-75949190-db4f-45ee-87df-27804ae57533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9846be1861c743b58217352e0002cd5a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:28.614906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1181/2313] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:28 2022] DELETE /identity/v3/users/9846be1861c743b58217352e0002cd5a => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:28.619222 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614ab3-2d27-4549-a6ce-901a8487f669 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:28.619520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614ab3-2d27-4549-a6ce-901a8487f669 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:28.619806 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614ab3-2d27-4549-a6ce-901a8487f669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:28.638922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-69614ab3-2d27-4549-a6ce-901a8487f669 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:28.640194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-69614ab3-2d27-4549-a6ce-901a8487f669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:28.713655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1133/2314] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:28.723161 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75949190-db4f-45ee-87df-27804ae57533 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:28.724641 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-75949190-db4f-45ee-87df-27804ae57533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:28.784832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75949190-db4f-45ee-87df-27804ae57533 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:28.788358 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1bc8e-b312-48f6-a28d-da0132ff5509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:28.789005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1bc8e-b312-48f6-a28d-da0132ff5509 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:28.789289 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1bc8e-b312-48f6-a28d-da0132ff5509 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:28.789568 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1bc8e-b312-48f6-a28d-da0132ff5509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:28.798400 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1bc8e-b312-48f6-a28d-da0132ff5509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:28.799894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1bc8e-b312-48f6-a28d-da0132ff5509 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:28.809560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1182/2315] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:29.301449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69614ab3-2d27-4549-a6ce-901a8487f669 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:29.303063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-69614ab3-2d27-4549-a6ce-901a8487f669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:29.317698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69614ab3-2d27-4549-a6ce-901a8487f669 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:29.323686 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2271531-92c5-47d1-b10a-7a237d7ec037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:29.324897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2271531-92c5-47d1-b10a-7a237d7ec037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:29.325069 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2271531-92c5-47d1-b10a-7a237d7ec037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:29.325348 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2271531-92c5-47d1-b10a-7a237d7ec037 admin admin] PATH_INFO: `/v3/projects/ec7993ea4a0045048d3139ce080a5acb` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:29.326550 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2271531-92c5-47d1-b10a-7a237d7ec037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec7993ea4a0045048d3139ce080a5acb)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:29.328693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2271531-92c5-47d1-b10a-7a237d7ec037 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:29.499115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b2271531-92c5-47d1-b10a-7a237d7ec037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec7993ea4a0045048d3139ce080a5acb', 'request_id': 'req-b2271531-92c5-47d1-b10a-7a237d7ec037'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:29.505410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b2271531-92c5-47d1-b10a-7a237d7ec037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec7993ea4a0045048d3139ce080a5acb', 'request_id': 'req-b2271531-92c5-47d1-b10a-7a237d7ec037'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:29.633197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b2271531-92c5-47d1-b10a-7a237d7ec037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec7993ea4a0045048d3139ce080a5acb', 'request_id': 'req-b2271531-92c5-47d1-b10a-7a237d7ec037'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:29.640885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b2271531-92c5-47d1-b10a-7a237d7ec037 admin admin] The token cache is being invalidate because project ec7993ea4a0045048d3139ce080a5acb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:29.641182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b2271531-92c5-47d1-b10a-7a237d7ec037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:29.642001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b2271531-92c5-47d1-b10a-7a237d7ec037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:29.643567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1134/2316] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:29 2022] DELETE /identity/v3/projects/ec7993ea4a0045048d3139ce080a5acb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:29.647618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1bc8e-b312-48f6-a28d-da0132ff5509 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:29.659269 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1bc8e-b312-48f6-a28d-da0132ff5509 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:29.732735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efd5ee-99d6-445c-b985-8d7c65413655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:29.733445 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efd5ee-99d6-445c-b985-8d7c65413655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:29.733722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efd5ee-99d6-445c-b985-8d7c65413655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:29.734007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efd5ee-99d6-445c-b985-8d7c65413655 admin admin] PATH_INFO: `/v3/users/903c0a71fd5e41578244e9b52bad05a2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:29.735272 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efd5ee-99d6-445c-b985-8d7c65413655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=903c0a71fd5e41578244e9b52bad05a2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:29.737369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efd5ee-99d6-445c-b985-8d7c65413655 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:29.753932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:29.905308 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:29.976384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-12efd5ee-99d6-445c-b985-8d7c65413655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '903c0a71fd5e41578244e9b52bad05a2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:29.977047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-12efd5ee-99d6-445c-b985-8d7c65413655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '903c0a71fd5e41578244e9b52bad05a2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.100102 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-12efd5ee-99d6-445c-b985-8d7c65413655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '903c0a71fd5e41578244e9b52bad05a2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.107847 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-12efd5ee-99d6-445c-b985-8d7c65413655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '903c0a71fd5e41578244e9b52bad05a2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.108598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-12efd5ee-99d6-445c-b985-8d7c65413655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '903c0a71fd5e41578244e9b52bad05a2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.125937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1183/2317] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:29 2022] DELETE /identity/v3/users/903c0a71fd5e41578244e9b52bad05a2 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:08:30.580749 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2271531-92c5-47d1-b10a-7a237d7ec037 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:30.582219 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b2271531-92c5-47d1-b10a-7a237d7ec037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:30.596978 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2271531-92c5-47d1-b10a-7a237d7ec037 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:30.655490 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e9f65-bf18-43f3-8e5a-9a616233f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:30.656425 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e9f65-bf18-43f3-8e5a-9a616233f6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:30.656717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e9f65-bf18-43f3-8e5a-9a616233f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:30.657003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e9f65-bf18-43f3-8e5a-9a616233f6cd admin admin] PATH_INFO: `/v3/projects/a925e1768cda4b6b81ec49c8b7941c1e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:30.658199 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e9f65-bf18-43f3-8e5a-9a616233f6cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a925e1768cda4b6b81ec49c8b7941c1e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:30.660157 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e9f65-bf18-43f3-8e5a-9a616233f6cd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:30.799104 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-619e9f65-bf18-43f3-8e5a-9a616233f6cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a925e1768cda4b6b81ec49c8b7941c1e', 'request_id': 'req-619e9f65-bf18-43f3-8e5a-9a616233f6cd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.805512 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-619e9f65-bf18-43f3-8e5a-9a616233f6cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a925e1768cda4b6b81ec49c8b7941c1e', 'request_id': 'req-619e9f65-bf18-43f3-8e5a-9a616233f6cd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.899198 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-619e9f65-bf18-43f3-8e5a-9a616233f6cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a925e1768cda4b6b81ec49c8b7941c1e', 'request_id': 'req-619e9f65-bf18-43f3-8e5a-9a616233f6cd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.911341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-619e9f65-bf18-43f3-8e5a-9a616233f6cd admin admin] The token cache is being invalidate because project a925e1768cda4b6b81ec49c8b7941c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:30.911625 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-619e9f65-bf18-43f3-8e5a-9a616233f6cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.918774 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-619e9f65-bf18-43f3-8e5a-9a616233f6cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:30.918774 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1135/2318] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:30 2022] DELETE /identity/v3/projects/a925e1768cda4b6b81ec49c8b7941c1e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:30.918958 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efd5ee-99d6-445c-b985-8d7c65413655 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:30.920427 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-12efd5ee-99d6-445c-b985-8d7c65413655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:30.934223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efd5ee-99d6-445c-b985-8d7c65413655 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:30.995876 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26804b5f-7dcd-4358-85c7-9715c9904773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:30.996802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804b5f-7dcd-4358-85c7-9715c9904773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:30.998059 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804b5f-7dcd-4358-85c7-9715c9904773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:30.998346 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804b5f-7dcd-4358-85c7-9715c9904773 admin admin] PATH_INFO: `/v3/users/085304f7845a4c68b2b5215c9b8cc736` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:30.999535 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26804b5f-7dcd-4358-85c7-9715c9904773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=085304f7845a4c68b2b5215c9b8cc736)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:31.002019 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26804b5f-7dcd-4358-85c7-9715c9904773 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:31.273405 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-26804b5f-7dcd-4358-85c7-9715c9904773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '085304f7845a4c68b2b5215c9b8cc736'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:31.274062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-26804b5f-7dcd-4358-85c7-9715c9904773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '085304f7845a4c68b2b5215c9b8cc736'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:31.285102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e9f65-bf18-43f3-8e5a-9a616233f6cd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:31.286669 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-619e9f65-bf18-43f3-8e5a-9a616233f6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:31.299778 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e9f65-bf18-43f3-8e5a-9a616233f6cd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:31.304362 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124ba72-263a-4afd-9e2d-3ecb803421de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:31.305225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124ba72-263a-4afd-9e2d-3ecb803421de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:31.305518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124ba72-263a-4afd-9e2d-3ecb803421de admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:31.305803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124ba72-263a-4afd-9e2d-3ecb803421de admin admin] PATH_INFO: `/v3/users/ca672b5fa5b0463d9c7c005ce24e9039` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:31.306992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124ba72-263a-4afd-9e2d-3ecb803421de admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca672b5fa5b0463d9c7c005ce24e9039)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:31.308943 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124ba72-263a-4afd-9e2d-3ecb803421de admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:31.361958 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-26804b5f-7dcd-4358-85c7-9715c9904773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '085304f7845a4c68b2b5215c9b8cc736'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:31.369618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-26804b5f-7dcd-4358-85c7-9715c9904773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '085304f7845a4c68b2b5215c9b8cc736'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:31.370266 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-26804b5f-7dcd-4358-85c7-9715c9904773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '085304f7845a4c68b2b5215c9b8cc736'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:31.387726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1184/2319] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:30 2022] DELETE /identity/v3/users/085304f7845a4c68b2b5215c9b8cc736 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:08:31.617075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3124ba72-263a-4afd-9e2d-3ecb803421de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca672b5fa5b0463d9c7c005ce24e9039'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:31.632920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3124ba72-263a-4afd-9e2d-3ecb803421de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca672b5fa5b0463d9c7c005ce24e9039'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:31.633689 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3124ba72-263a-4afd-9e2d-3ecb803421de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca672b5fa5b0463d9c7c005ce24e9039'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:31.643249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3124ba72-263a-4afd-9e2d-3ecb803421de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca672b5fa5b0463d9c7c005ce24e9039'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:31.644546 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3124ba72-263a-4afd-9e2d-3ecb803421de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca672b5fa5b0463d9c7c005ce24e9039'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:31.762896 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1136/2320] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:31 2022] DELETE /identity/v3/users/ca672b5fa5b0463d9c7c005ce24e9039 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:08:31.768534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4457-c810-447e-af69-c7b68c44dc5b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:31.768832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4457-c810-447e-af69-c7b68c44dc5b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:31.769119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d4457-c810-447e-af69-c7b68c44dc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:31.787799 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-212d4457-c810-447e-af69-c7b68c44dc5b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:31.789054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-212d4457-c810-447e-af69-c7b68c44dc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:31.848789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1185/2321] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:31.861438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124ba72-263a-4afd-9e2d-3ecb803421de admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:31.864190 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3124ba72-263a-4afd-9e2d-3ecb803421de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:31.927578 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124ba72-263a-4afd-9e2d-3ecb803421de admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:31.931234 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e14a47-fb66-486d-97ac-1bc66e3f5b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:31.931887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e14a47-fb66-486d-97ac-1bc66e3f5b0f service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:31.932238 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e14a47-fb66-486d-97ac-1bc66e3f5b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:31.937194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e14a47-fb66-486d-97ac-1bc66e3f5b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:31.944605 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e14a47-fb66-486d-97ac-1bc66e3f5b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:31.946060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e14a47-fb66-486d-97ac-1bc66e3f5b0f service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:31.956709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1137/2322] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:32.028987 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:32.339900 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:32.413579 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d4457-c810-447e-af69-c7b68c44dc5b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:32.415815 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-212d4457-c810-447e-af69-c7b68c44dc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:32.430518 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d4457-c810-447e-af69-c7b68c44dc5b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:32.435937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb23f46-3932-42c4-add8-56975a316e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:32.437930 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb23f46-3932-42c4-add8-56975a316e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:32.438495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb23f46-3932-42c4-add8-56975a316e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:32.439455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb23f46-3932-42c4-add8-56975a316e85 admin admin] PATH_INFO: `/v3/projects/c65d35d7cfaa4d29b15d8050370765f1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:32.443278 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb23f46-3932-42c4-add8-56975a316e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c65d35d7cfaa4d29b15d8050370765f1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:32.446187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb23f46-3932-42c4-add8-56975a316e85 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:32.563933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bb23f46-3932-42c4-add8-56975a316e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c65d35d7cfaa4d29b15d8050370765f1', 'request_id': 'req-0bb23f46-3932-42c4-add8-56975a316e85'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.638126 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e14a47-fb66-486d-97ac-1bc66e3f5b0f service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:32.639879 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a3e14a47-fb66-486d-97ac-1bc66e3f5b0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:32.642380 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bb23f46-3932-42c4-add8-56975a316e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c65d35d7cfaa4d29b15d8050370765f1', 'request_id': 'req-0bb23f46-3932-42c4-add8-56975a316e85'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.658363 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bb23f46-3932-42c4-add8-56975a316e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c65d35d7cfaa4d29b15d8050370765f1', 'request_id': 'req-0bb23f46-3932-42c4-add8-56975a316e85'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.670795 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bb23f46-3932-42c4-add8-56975a316e85 admin admin] The token cache is being invalidate because project c65d35d7cfaa4d29b15d8050370765f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:32.671635 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bb23f46-3932-42c4-add8-56975a316e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.673218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0bb23f46-3932-42c4-add8-56975a316e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.675324 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1186/2323] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:32 2022] DELETE /identity/v3/projects/c65d35d7cfaa4d29b15d8050370765f1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:32.681907 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ee7e-7789-44cd-89c6-55a14200d620 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:32.682710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e14a47-fb66-486d-97ac-1bc66e3f5b0f service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:32.682957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ee7e-7789-44cd-89c6-55a14200d620 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:32.683586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2ee7e-7789-44cd-89c6-55a14200d620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:32.707785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0fc2ee7e-7789-44cd-89c6-55a14200d620 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:32.709275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0fc2ee7e-7789-44cd-89c6-55a14200d620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:32.771503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6da6d-13f2-4079-ac07-b962caecd1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:32.772429 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6da6d-13f2-4079-ac07-b962caecd1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:32.772719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6da6d-13f2-4079-ac07-b962caecd1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:32.772999 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6da6d-13f2-4079-ac07-b962caecd1f2 admin admin] PATH_INFO: `/v3/projects/4f43e96fb95940dd9d9aa647cb42909f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:32.774198 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6da6d-13f2-4079-ac07-b962caecd1f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f43e96fb95940dd9d9aa647cb42909f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:32.775379 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1187/2324] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:32.776142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6da6d-13f2-4079-ac07-b962caecd1f2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:32.777053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c54a42-3d71-4bfe-8f52-74e66c072b68 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:32.777711 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c54a42-3d71-4bfe-8f52-74e66c072b68 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:32.778021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c54a42-3d71-4bfe-8f52-74e66c072b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:32.930197 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b4c54a42-3d71-4bfe-8f52-74e66c072b68 None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:32.931343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b4c54a42-3d71-4bfe-8f52-74e66c072b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:32.968519 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3fc6da6d-13f2-4079-ac07-b962caecd1f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f43e96fb95940dd9d9aa647cb42909f', 'request_id': 'req-3fc6da6d-13f2-4079-ac07-b962caecd1f2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.974712 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3fc6da6d-13f2-4079-ac07-b962caecd1f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f43e96fb95940dd9d9aa647cb42909f', 'request_id': 'req-3fc6da6d-13f2-4079-ac07-b962caecd1f2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:32.985895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1188/2325] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Jun 2 16:08:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:32.987319 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04739384-6b77-4f22-9397-e054b1eeb6aa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:32.987612 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04739384-6b77-4f22-9397-e054b1eeb6aa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:32.987891 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04739384-6b77-4f22-9397-e054b1eeb6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.005937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-04739384-6b77-4f22-9397-e054b1eeb6aa None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:33.007129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-04739384-6b77-4f22-9397-e054b1eeb6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:33.066451 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1189/2326] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:33.070312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04739384-6b77-4f22-9397-e054b1eeb6aa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:33.070312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-04739384-6b77-4f22-9397-e054b1eeb6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:33.076982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3fc6da6d-13f2-4079-ac07-b962caecd1f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f43e96fb95940dd9d9aa647cb42909f', 'request_id': 'req-3fc6da6d-13f2-4079-ac07-b962caecd1f2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:33.090002 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3fc6da6d-13f2-4079-ac07-b962caecd1f2 admin admin] The token cache is being invalidate because project 4f43e96fb95940dd9d9aa647cb42909f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:33.090290 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3fc6da6d-13f2-4079-ac07-b962caecd1f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:33.093188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3fc6da6d-13f2-4079-ac07-b962caecd1f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:33.093188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1138/2327] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:32 2022] DELETE /identity/v3/projects/4f43e96fb95940dd9d9aa647cb42909f => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:33.093441 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6da6d-13f2-4079-ac07-b962caecd1f2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:33.094762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3fc6da6d-13f2-4079-ac07-b962caecd1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:33.106842 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6da6d-13f2-4079-ac07-b962caecd1f2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:33.111459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805baea6-7adc-48fa-993d-d4bd33bb0b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:33.112135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805baea6-7adc-48fa-993d-d4bd33bb0b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.112421 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805baea6-7adc-48fa-993d-d4bd33bb0b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.112701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805baea6-7adc-48fa-993d-d4bd33bb0b6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.113423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805baea6-7adc-48fa-993d-d4bd33bb0b6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:33.113733 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805baea6-7adc-48fa-993d-d4bd33bb0b6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:33.115383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805baea6-7adc-48fa-993d-d4bd33bb0b6c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:33.127509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1139/2328] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:08:33.128790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62a697-aacc-4462-ba6c-77919cf53bb5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.129082 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62a697-aacc-4462-ba6c-77919cf53bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.129365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62a697-aacc-4462-ba6c-77919cf53bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.138030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04739384-6b77-4f22-9397-e054b1eeb6aa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:33.144028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193710b-f305-4aa6-b77e-5e45c1930de8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:33.144684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193710b-f305-4aa6-b77e-5e45c1930de8 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.144971 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193710b-f305-4aa6-b77e-5e45c1930de8 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.145250 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193710b-f305-4aa6-b77e-5e45c1930de8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.147085 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0193710b-f305-4aa6-b77e-5e45c1930de8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:33.148576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6f62a697-aacc-4462-ba6c-77919cf53bb5 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:33.149759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6f62a697-aacc-4462-ba6c-77919cf53bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:33.157557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1140/2329] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:33.158319 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62a697-aacc-4462-ba6c-77919cf53bb5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:33.167876 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62a697-aacc-4462-ba6c-77919cf53bb5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:33.172921 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6563ad-aa65-4a3e-963e-9e5d63a54b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:33.173742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6563ad-aa65-4a3e-963e-9e5d63a54b25 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.174488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6563ad-aa65-4a3e-963e-9e5d63a54b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.174488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6563ad-aa65-4a3e-963e-9e5d63a54b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.175136 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6563ad-aa65-4a3e-963e-9e5d63a54b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:33.177085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6563ad-aa65-4a3e-963e-9e5d63a54b25 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:33.210114 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193710b-f305-4aa6-b77e-5e45c1930de8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:33.211899 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193710b-f305-4aa6-b77e-5e45c1930de8 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:33.220239 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1190/2330] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 16:08:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:08:33.221665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d5560-3f6a-4c5a-8bca-44998da8b314 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.222326 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d5560-3f6a-4c5a-8bca-44998da8b314 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.222681 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d5560-3f6a-4c5a-8bca-44998da8b314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.245370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-669d5560-3f6a-4c5a-8bca-44998da8b314 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:33.246588 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-669d5560-3f6a-4c5a-8bca-44998da8b314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:33.255538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1191/2331] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:33.259724 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d5560-3f6a-4c5a-8bca-44998da8b314 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:33.269632 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d5560-3f6a-4c5a-8bca-44998da8b314 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:33.274374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161e5e2-8a76-45fd-bad5-ea9e8ab6ecf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:33.275288 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161e5e2-8a76-45fd-bad5-ea9e8ab6ecf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.280937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161e5e2-8a76-45fd-bad5-ea9e8ab6ecf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.280937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161e5e2-8a76-45fd-bad5-ea9e8ab6ecf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.280937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161e5e2-8a76-45fd-bad5-ea9e8ab6ecf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:33.280937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161e5e2-8a76-45fd-bad5-ea9e8ab6ecf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:33.280937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161e5e2-8a76-45fd-bad5-ea9e8ab6ecf6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:33.293668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1192/2332] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 16:08:33.297843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161e5e2-8a76-45fd-bad5-ea9e8ab6ecf6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:33.307766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161e5e2-8a76-45fd-bad5-ea9e8ab6ecf6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:33.313116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1376fc9-cff7-4126-86d2-28c507a62f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:33.313774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1376fc9-cff7-4126-86d2-28c507a62f0d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.314062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1376fc9-cff7-4126-86d2-28c507a62f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.314352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1376fc9-cff7-4126-86d2-28c507a62f0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.315035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1376fc9-cff7-4126-86d2-28c507a62f0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:33.318075 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1376fc9-cff7-4126-86d2-28c507a62f0d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:33.356184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1141/2333] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:33 2022] POST /identity/v3/projects => generated 389 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:33.357555 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6563ad-aa65-4a3e-963e-9e5d63a54b25 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:33.410092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1193/2334] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:33 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:08:33.421403 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1376fc9-cff7-4126-86d2-28c507a62f0d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:33.449271 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6563ad-aa65-4a3e-963e-9e5d63a54b25 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:33.553844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1376fc9-cff7-4126-86d2-28c507a62f0d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:33.555853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d799c2-fb6f-4d9a-b902-3accbe73da23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:33.558170 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d799c2-fb6f-4d9a-b902-3accbe73da23 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.560762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d799c2-fb6f-4d9a-b902-3accbe73da23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.560762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d799c2-fb6f-4d9a-b902-3accbe73da23 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.560762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d799c2-fb6f-4d9a-b902-3accbe73da23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:33.561260 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12358b-16e8-4034-acd3-c0f9bde395b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:33.562043 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12358b-16e8-4034-acd3-c0f9bde395b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.563312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12358b-16e8-4034-acd3-c0f9bde395b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.563867 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12358b-16e8-4034-acd3-c0f9bde395b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.564845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12358b-16e8-4034-acd3-c0f9bde395b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:33.567509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12358b-16e8-4034-acd3-c0f9bde395b0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:33.573707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d799c2-fb6f-4d9a-b902-3accbe73da23 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:33.678434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1194/2335] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:33 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:33.683514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12358b-16e8-4034-acd3-c0f9bde395b0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:33.696088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12358b-16e8-4034-acd3-c0f9bde395b0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:33.706520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1142/2336] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:33 2022] POST /identity/v3/users => generated 295 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:33.711297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d799c2-fb6f-4d9a-b902-3accbe73da23 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:33.719114 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fbef1-39ab-41c5-b90e-8db2eea364b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:33.720308 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fbef1-39ab-41c5-b90e-8db2eea364b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.720708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fbef1-39ab-41c5-b90e-8db2eea364b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.722096 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fbef1-39ab-41c5-b90e-8db2eea364b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.723517 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fbef1-39ab-41c5-b90e-8db2eea364b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:33.729450 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fbef1-39ab-41c5-b90e-8db2eea364b6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:33.733863 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d799c2-fb6f-4d9a-b902-3accbe73da23 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:33.739517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21430b9f-3bdc-4092-ac4f-ecd345617354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:33.740232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21430b9f-3bdc-4092-ac4f-ecd345617354 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.740557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21430b9f-3bdc-4092-ac4f-ecd345617354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.740853 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21430b9f-3bdc-4092-ac4f-ecd345617354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.741672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21430b9f-3bdc-4092-ac4f-ecd345617354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:33.743357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21430b9f-3bdc-4092-ac4f-ecd345617354 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:33.753522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1195/2337] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:33.756027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1143/2338] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:33.760477 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fbef1-39ab-41c5-b90e-8db2eea364b6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:33.761466 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21430b9f-3bdc-4092-ac4f-ecd345617354 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:33.775027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fbef1-39ab-41c5-b90e-8db2eea364b6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:33.780679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21430b9f-3bdc-4092-ac4f-ecd345617354 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:33.782109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdefc0-0301-442e-b303-b9e80f3f6f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:33.783304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdefc0-0301-442e-b303-b9e80f3f6f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.783715 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdefc0-0301-442e-b303-b9e80f3f6f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.783864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdefc0-0301-442e-b303-b9e80f3f6f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.784740 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdefc0-0301-442e-b303-b9e80f3f6f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:33.794745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdefc0-0301-442e-b303-b9e80f3f6f34 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:33.794890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccc6ae-3f58-428c-90df-a2105bcb1d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:33.794890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccc6ae-3f58-428c-90df-a2105bcb1d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.794890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccc6ae-3f58-428c-90df-a2105bcb1d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.794890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ccc6ae-3f58-428c-90df-a2105bcb1d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.795560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccc6ae-3f58-428c-90df-a2105bcb1d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:33.795560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ccc6ae-3f58-428c-90df-a2105bcb1d64 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:33.807899 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1196/2339] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:33.812873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdefc0-0301-442e-b303-b9e80f3f6f34 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:33.817815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1144/2340] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:33.822120 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccc6ae-3f58-428c-90df-a2105bcb1d64 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:33.833148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdefc0-0301-442e-b303-b9e80f3f6f34 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:33.835616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ccc6ae-3f58-428c-90df-a2105bcb1d64 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:33.839075 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f0666-535e-41f2-b7b5-99ca8036e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:33.840309 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f0666-535e-41f2-b7b5-99ca8036e456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.840776 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f0666-535e-41f2-b7b5-99ca8036e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.841154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f0666-535e-41f2-b7b5-99ca8036e456 admin admin] PATH_INFO: `/v3/projects/525c974e9cfd41eeaa43ac145c8fcd85/users/143d88a2be404d3ea24c75b2b873996b/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.844119 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad1470-1913-4ec0-88e7-0b6a5923221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:33.845166 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad1470-1913-4ec0-88e7-0b6a5923221c admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:33.845558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad1470-1913-4ec0-88e7-0b6a5923221c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:33.845936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad1470-1913-4ec0-88e7-0b6a5923221c admin admin] PATH_INFO: `/v3/projects/08400d4c16d74264bebb41888d1360be/users/7c2cb88e4b87497291cbf9657ea12ac4/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:33.864399 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad1470-1913-4ec0-88e7-0b6a5923221c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08400d4c16d74264bebb41888d1360be, user_id=7c2cb88e4b87497291cbf9657ea12ac4, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:33.867192 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad1470-1913-4ec0-88e7-0b6a5923221c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:33.869350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f0666-535e-41f2-b7b5-99ca8036e456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=525c974e9cfd41eeaa43ac145c8fcd85, user_id=143d88a2be404d3ea24c75b2b873996b, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:33.872153 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f0666-535e-41f2-b7b5-99ca8036e456 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:34.036049 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1145/2341] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:33 2022] PUT /identity/v3/projects/08400d4c16d74264bebb41888d1360be/users/7c2cb88e4b87497291cbf9657ea12ac4/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:34.038758 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c754750-9b51-4c29-90ee-11be295f4ae2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:34.039266 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c754750-9b51-4c29-90ee-11be295f4ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:34.039768 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c754750-9b51-4c29-90ee-11be295f4ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:34.043902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1197/2342] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:33 2022] PUT /identity/v3/projects/525c974e9cfd41eeaa43ac145c8fcd85/users/143d88a2be404d3ea24c75b2b873996b/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:08:34.055301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa303-bfb4-46b4-82ad-ceb6f7c92ea3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:34.055600 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa303-bfb4-46b4-82ad-ceb6f7c92ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:34.055888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa303-bfb4-46b4-82ad-ceb6f7c92ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:34.076947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5c754750-9b51-4c29-90ee-11be295f4ae2 None None] MFA Rules not processed for user `7c2cb88e4b87497291cbf9657ea12ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:34.082446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5c754750-9b51-4c29-90ee-11be295f4ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:34.095534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-621fa303-bfb4-46b4-82ad-ceb6f7c92ea3 None None] MFA Rules not processed for user `143d88a2be404d3ea24c75b2b873996b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:34.096517 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-621fa303-bfb4-46b4-82ad-ceb6f7c92ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:34.175543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1146/2343] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:34.191205 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c754750-9b51-4c29-90ee-11be295f4ae2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:34.199570 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5c754750-9b51-4c29-90ee-11be295f4ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:34.205212 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1198/2344] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:34.217091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa303-bfb4-46b4-82ad-ceb6f7c92ea3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:34.219484 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-621fa303-bfb4-46b4-82ad-ceb6f7c92ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:34.313126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa303-bfb4-46b4-82ad-ceb6f7c92ea3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:34.318315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60e8b1-ea5c-45cf-b140-a685b72bc904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:34.319091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60e8b1-ea5c-45cf-b140-a685b72bc904 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:34.319486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60e8b1-ea5c-45cf-b140-a685b72bc904 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:34.319897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60e8b1-ea5c-45cf-b140-a685b72bc904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:34.331440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60e8b1-ea5c-45cf-b140-a685b72bc904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:34.333321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60e8b1-ea5c-45cf-b140-a685b72bc904 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:34.352323 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c754750-9b51-4c29-90ee-11be295f4ae2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:34.356201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1199/2345] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:34.360669 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f474fe7-3543-4dec-b6a0-a5d992d3687e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:34.361440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f474fe7-3543-4dec-b6a0-a5d992d3687e service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:34.361741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f474fe7-3543-4dec-b6a0-a5d992d3687e service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:34.362025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f474fe7-3543-4dec-b6a0-a5d992d3687e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:34.383809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f474fe7-3543-4dec-b6a0-a5d992d3687e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:34.385356 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f474fe7-3543-4dec-b6a0-a5d992d3687e service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:34.396981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1147/2346] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:34.416956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60e8b1-ea5c-45cf-b140-a685b72bc904 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:34.553777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:34.561230 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60e8b1-ea5c-45cf-b140-a685b72bc904 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:34.574395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af0998-6c8b-460d-86bb-04851ee2d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:34.575305 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af0998-6c8b-460d-86bb-04851ee2d4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:34.575584 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af0998-6c8b-460d-86bb-04851ee2d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:34.575867 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af0998-6c8b-460d-86bb-04851ee2d4fe admin admin] PATH_INFO: `/v3/users/143d88a2be404d3ea24c75b2b873996b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:34.580847 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af0998-6c8b-460d-86bb-04851ee2d4fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=143d88a2be404d3ea24c75b2b873996b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:34.582804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af0998-6c8b-460d-86bb-04851ee2d4fe admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:34.856432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-26af0998-6c8b-460d-86bb-04851ee2d4fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143d88a2be404d3ea24c75b2b873996b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.857254 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-26af0998-6c8b-460d-86bb-04851ee2d4fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143d88a2be404d3ea24c75b2b873996b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.871506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:34.933846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-26af0998-6c8b-460d-86bb-04851ee2d4fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143d88a2be404d3ea24c75b2b873996b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.946168 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-26af0998-6c8b-460d-86bb-04851ee2d4fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143d88a2be404d3ea24c75b2b873996b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.948464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-26af0998-6c8b-460d-86bb-04851ee2d4fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143d88a2be404d3ea24c75b2b873996b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:34.969556 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1200/2347] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:34 2022] DELETE /identity/v3/users/143d88a2be404d3ea24c75b2b873996b => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:34.973833 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bcc61-4ecb-46b9-b43d-53e4df49e007 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:34.974135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bcc61-4ecb-46b9-b43d-53e4df49e007 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:34.978137 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bcc61-4ecb-46b9-b43d-53e4df49e007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:34.993463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-316bcc61-4ecb-46b9-b43d-53e4df49e007 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:34.994685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-316bcc61-4ecb-46b9-b43d-53e4df49e007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:35.080092 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1148/2348] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:08:35.087840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af0998-6c8b-460d-86bb-04851ee2d4fe admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:35.089555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-26af0998-6c8b-460d-86bb-04851ee2d4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:35.211833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af0998-6c8b-460d-86bb-04851ee2d4fe admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:35.215960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561afa0-8de7-42e8-8b6c-79e7830a5c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:35.216721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561afa0-8de7-42e8-8b6c-79e7830a5c45 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:35.217081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561afa0-8de7-42e8-8b6c-79e7830a5c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:35.217464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561afa0-8de7-42e8-8b6c-79e7830a5c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:35.241924 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561afa0-8de7-42e8-8b6c-79e7830a5c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:35.244187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561afa0-8de7-42e8-8b6c-79e7830a5c45 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:35.257093 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1201/2349] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:36.159283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bcc61-4ecb-46b9-b43d-53e4df49e007 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:36.161392 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-316bcc61-4ecb-46b9-b43d-53e4df49e007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:36.176583 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bcc61-4ecb-46b9-b43d-53e4df49e007 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:36.182359 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee066b-07a7-4a13-aee9-fb82cd9f1e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:36.188303 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee066b-07a7-4a13-aee9-fb82cd9f1e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:36.188303 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee066b-07a7-4a13-aee9-fb82cd9f1e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:36.188303 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee066b-07a7-4a13-aee9-fb82cd9f1e36 admin admin] PATH_INFO: `/v3/projects/525c974e9cfd41eeaa43ac145c8fcd85` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:36.188303 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee066b-07a7-4a13-aee9-fb82cd9f1e36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=525c974e9cfd41eeaa43ac145c8fcd85)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:36.188303 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee066b-07a7-4a13-aee9-fb82cd9f1e36 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:36.680763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-77ee066b-07a7-4a13-aee9-fb82cd9f1e36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '525c974e9cfd41eeaa43ac145c8fcd85', 'request_id': 'req-77ee066b-07a7-4a13-aee9-fb82cd9f1e36'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:36.734967 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-77ee066b-07a7-4a13-aee9-fb82cd9f1e36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '525c974e9cfd41eeaa43ac145c8fcd85', 'request_id': 'req-77ee066b-07a7-4a13-aee9-fb82cd9f1e36'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:37.167801 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-77ee066b-07a7-4a13-aee9-fb82cd9f1e36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '525c974e9cfd41eeaa43ac145c8fcd85', 'request_id': 'req-77ee066b-07a7-4a13-aee9-fb82cd9f1e36'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:37.181335 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-77ee066b-07a7-4a13-aee9-fb82cd9f1e36 admin admin] The token cache is being invalidate because project 525c974e9cfd41eeaa43ac145c8fcd85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:37.181997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-77ee066b-07a7-4a13-aee9-fb82cd9f1e36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:37.183023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-77ee066b-07a7-4a13-aee9-fb82cd9f1e36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:37.185367 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1149/2350] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:36 2022] DELETE /identity/v3/projects/525c974e9cfd41eeaa43ac145c8fcd85 => generated 0 bytes in 1026 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:37.190342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe983d-592b-4634-8321-da8493501364 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.190900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe983d-592b-4634-8321-da8493501364 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.190900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe983d-592b-4634-8321-da8493501364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.215706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-18fe983d-592b-4634-8321-da8493501364 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:37.221751 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-18fe983d-592b-4634-8321-da8493501364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:37.297898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1202/2351] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:37.306604 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71dc4f-b408-4b15-b8af-9e88ffbb8ef9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.307027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71dc4f-b408-4b15-b8af-9e88ffbb8ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.307330 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71dc4f-b408-4b15-b8af-9e88ffbb8ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.328341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4a71dc4f-b408-4b15-b8af-9e88ffbb8ef9 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:37.330263 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4a71dc4f-b408-4b15-b8af-9e88ffbb8ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:37.337875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1150/2352] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:37.342416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe983d-592b-4634-8321-da8493501364 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:37.353467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe983d-592b-4634-8321-da8493501364 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:37.358414 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa4f34-e959-496d-82a7-3208fa3ca301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:37.359640 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa4f34-e959-496d-82a7-3208fa3ca301 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.359929 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa4f34-e959-496d-82a7-3208fa3ca301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.360276 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa4f34-e959-496d-82a7-3208fa3ca301 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.361061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa4f34-e959-496d-82a7-3208fa3ca301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:08:37.361380 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa4f34-e959-496d-82a7-3208fa3ca301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:37.363045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa4f34-e959-496d-82a7-3208fa3ca301 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:37.386536 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1203/2353] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:08:37.403653 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71dc4f-b408-4b15-b8af-9e88ffbb8ef9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:37.403653 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71dc4f-b408-4b15-b8af-9e88ffbb8ef9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:37.408319 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcad37f-4b30-4f3f-b5e7-bed8c336956a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:37.409003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcad37f-4b30-4f3f-b5e7-bed8c336956a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.409296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcad37f-4b30-4f3f-b5e7-bed8c336956a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.409583 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcad37f-4b30-4f3f-b5e7-bed8c336956a admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.410311 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcad37f-4b30-4f3f-b5e7-bed8c336956a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:37.420184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcad37f-4b30-4f3f-b5e7-bed8c336956a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:37.538762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1151/2354] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:08:37 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:37.540117 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa4f34-e959-496d-82a7-3208fa3ca301 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:37.551217 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa4f34-e959-496d-82a7-3208fa3ca301 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:37.623690 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83be39b-356e-40db-846a-32cdda6e147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:37.624405 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83be39b-356e-40db-846a-32cdda6e147c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.624733 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83be39b-356e-40db-846a-32cdda6e147c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.625023 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83be39b-356e-40db-846a-32cdda6e147c admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.625712 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83be39b-356e-40db-846a-32cdda6e147c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:37.627701 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83be39b-356e-40db-846a-32cdda6e147c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:37.659864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:37.812763 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1204/2355] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:08:37 2022] POST /identity/v3/users => generated 287 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:08:37.814931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcad37f-4b30-4f3f-b5e7-bed8c336956a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:37.827815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcad37f-4b30-4f3f-b5e7-bed8c336956a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:37.833746 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5c7c3-acf2-4862-b220-b70b336ae8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:37.834780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5c7c3-acf2-4862-b220-b70b336ae8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.835230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5c7c3-acf2-4862-b220-b70b336ae8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.835723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5c7c3-acf2-4862-b220-b70b336ae8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.836631 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5c7c3-acf2-4862-b220-b70b336ae8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:37.838407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5c7c3-acf2-4862-b220-b70b336ae8aa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:37.864095 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1152/2356] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:37.868260 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83be39b-356e-40db-846a-32cdda6e147c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:37.878750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83be39b-356e-40db-846a-32cdda6e147c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:37.887252 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ea3a2-0047-4aed-a113-642e28200303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:37.887948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ea3a2-0047-4aed-a113-642e28200303 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.888273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ea3a2-0047-4aed-a113-642e28200303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.888521 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ea3a2-0047-4aed-a113-642e28200303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.889516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ea3a2-0047-4aed-a113-642e28200303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:37.891189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ea3a2-0047-4aed-a113-642e28200303 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:37.902342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1205/2357] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:08:37.906991 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5c7c3-acf2-4862-b220-b70b336ae8aa admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:37.917551 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5c7c3-acf2-4862-b220-b70b336ae8aa admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:37.923326 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e7730-d2c6-439d-9c4a-9dc4a18d3b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:37.924283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e7730-d2c6-439d-9c4a-9dc4a18d3b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:37.924627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e7730-d2c6-439d-9c4a-9dc4a18d3b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:37.924943 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e7730-d2c6-439d-9c4a-9dc4a18d3b59 admin admin] PATH_INFO: `/v3/projects/81596de1ce3046bcafdee513da4e5c6e/users/6f732d9b58b9411c9dec64115b25ab2a/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:37.942430 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e7730-d2c6-439d-9c4a-9dc4a18d3b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81596de1ce3046bcafdee513da4e5c6e, user_id=6f732d9b58b9411c9dec64115b25ab2a, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:37.945698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e7730-d2c6-439d-9c4a-9dc4a18d3b59 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:38.134732 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603bbc0-07e1-4a9e-b6ac-61172b73504a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:38.134972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603bbc0-07e1-4a9e-b6ac-61172b73504a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:38.135233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603bbc0-07e1-4a9e-b6ac-61172b73504a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:38.137932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1153/2358] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:08:37 2022] PUT /identity/v3/projects/81596de1ce3046bcafdee513da4e5c6e/users/6f732d9b58b9411c9dec64115b25ab2a/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:38.173502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7603bbc0-07e1-4a9e-b6ac-61172b73504a None None] MFA Rules not processed for user `6f732d9b58b9411c9dec64115b25ab2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:38.174841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7603bbc0-07e1-4a9e-b6ac-61172b73504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:38.257597 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1206/2359] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:38.268775 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e7730-d2c6-439d-9c4a-9dc4a18d3b59 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:38.270632 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-806e7730-d2c6-439d-9c4a-9dc4a18d3b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:38.341899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e7730-d2c6-439d-9c4a-9dc4a18d3b59 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:38.351929 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3858c-8d2c-42e6-8e9e-44ffd1625af2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:38.351929 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3858c-8d2c-42e6-8e9e-44ffd1625af2 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:38.351929 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3858c-8d2c-42e6-8e9e-44ffd1625af2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:38.351929 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3858c-8d2c-42e6-8e9e-44ffd1625af2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:38.358992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3858c-8d2c-42e6-8e9e-44ffd1625af2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:38.361360 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3858c-8d2c-42e6-8e9e-44ffd1625af2 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:38.372988 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1154/2360] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:39.711962 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:40.654931 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:41.746642 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12820e08-3af8-4c4f-b518-37f9fb367314 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:41.747349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12820e08-3af8-4c4f-b518-37f9fb367314 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:41.747349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12820e08-3af8-4c4f-b518-37f9fb367314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:41.773983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-12820e08-3af8-4c4f-b518-37f9fb367314 None None] MFA Rules not processed for user `6f732d9b58b9411c9dec64115b25ab2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:41.779236 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-12820e08-3af8-4c4f-b518-37f9fb367314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:41.790937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1207/2361] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:42.105302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:42.551159 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:43.845571 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:44.116040 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:45.174023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:45.457394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:45.836329 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:47.633955 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:47.802146 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:48.656002 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3858c-8d2c-42e6-8e9e-44ffd1625af2 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:48.657463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e7b3858c-8d2c-42e6-8e9e-44ffd1625af2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:48.724010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3858c-8d2c-42e6-8e9e-44ffd1625af2 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:48.728726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588be1fc-ebff-439c-ae1d-26fcd36a7dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:48.729605 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588be1fc-ebff-439c-ae1d-26fcd36a7dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:48.729888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588be1fc-ebff-439c-ae1d-26fcd36a7dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:48.730170 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588be1fc-ebff-439c-ae1d-26fcd36a7dbc admin admin] PATH_INFO: `/v3/users/7c2cb88e4b87497291cbf9657ea12ac4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:48.731481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588be1fc-ebff-439c-ae1d-26fcd36a7dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2cb88e4b87497291cbf9657ea12ac4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:48.734032 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588be1fc-ebff-439c-ae1d-26fcd36a7dbc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:48.983338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-588be1fc-ebff-439c-ae1d-26fcd36a7dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2cb88e4b87497291cbf9657ea12ac4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:49.004903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-588be1fc-ebff-439c-ae1d-26fcd36a7dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2cb88e4b87497291cbf9657ea12ac4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:49.006018 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-588be1fc-ebff-439c-ae1d-26fcd36a7dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2cb88e4b87497291cbf9657ea12ac4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:49.017034 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-588be1fc-ebff-439c-ae1d-26fcd36a7dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2cb88e4b87497291cbf9657ea12ac4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:49.018114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-588be1fc-ebff-439c-ae1d-26fcd36a7dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2cb88e4b87497291cbf9657ea12ac4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:49.048002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:49.128079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1155/2362] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:08:48 2022] DELETE /identity/v3/users/7c2cb88e4b87497291cbf9657ea12ac4 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:49.132530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6646464-8068-41f3-aaea-534ede594dd7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:49.132822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6646464-8068-41f3-aaea-534ede594dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:49.133102 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6646464-8068-41f3-aaea-534ede594dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:49.154169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a6646464-8068-41f3-aaea-534ede594dd7 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:49.155980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a6646464-8068-41f3-aaea-534ede594dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:49.228271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1208/2363] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:49.245670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588be1fc-ebff-439c-ae1d-26fcd36a7dbc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:49.248379 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-588be1fc-ebff-439c-ae1d-26fcd36a7dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:49.277480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:49.322007 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588be1fc-ebff-439c-ae1d-26fcd36a7dbc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:49.327725 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90d7c5-6ae4-4548-a9f8-d74ae9a9d36f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:49.332318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90d7c5-6ae4-4548-a9f8-d74ae9a9d36f service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:49.332318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90d7c5-6ae4-4548-a9f8-d74ae9a9d36f service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:49.332318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90d7c5-6ae4-4548-a9f8-d74ae9a9d36f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:49.345411 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90d7c5-6ae4-4548-a9f8-d74ae9a9d36f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:49.347239 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90d7c5-6ae4-4548-a9f8-d74ae9a9d36f service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:49.359651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1156/2364] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:49.888868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6646464-8068-41f3-aaea-534ede594dd7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:49.890410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a6646464-8068-41f3-aaea-534ede594dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:49.904632 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6646464-8068-41f3-aaea-534ede594dd7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:49.910010 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4a6ff-563d-4c73-a118-250ed382e870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:49.910606 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4a6ff-563d-4c73-a118-250ed382e870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:49.911010 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4a6ff-563d-4c73-a118-250ed382e870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:49.911276 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4a6ff-563d-4c73-a118-250ed382e870 admin admin] PATH_INFO: `/v3/projects/08400d4c16d74264bebb41888d1360be` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:49.919145 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4a6ff-563d-4c73-a118-250ed382e870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08400d4c16d74264bebb41888d1360be)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:49.919145 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4a6ff-563d-4c73-a118-250ed382e870 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:50.024457 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6dd4a6ff-563d-4c73-a118-250ed382e870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08400d4c16d74264bebb41888d1360be', 'request_id': 'req-6dd4a6ff-563d-4c73-a118-250ed382e870'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:50.098226 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6dd4a6ff-563d-4c73-a118-250ed382e870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08400d4c16d74264bebb41888d1360be', 'request_id': 'req-6dd4a6ff-563d-4c73-a118-250ed382e870'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:50.104958 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6dd4a6ff-563d-4c73-a118-250ed382e870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08400d4c16d74264bebb41888d1360be', 'request_id': 'req-6dd4a6ff-563d-4c73-a118-250ed382e870'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:50.115233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6dd4a6ff-563d-4c73-a118-250ed382e870 admin admin] The token cache is being invalidate because project 08400d4c16d74264bebb41888d1360be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:08:50.115525 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6dd4a6ff-563d-4c73-a118-250ed382e870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:50.116220 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6dd4a6ff-563d-4c73-a118-250ed382e870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:08:50.117760 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1209/2365] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:08:49 2022] DELETE /identity/v3/projects/08400d4c16d74264bebb41888d1360be => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:08:50.450626 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:50.873539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:51.510936 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:51.619062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:52.017415 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3817a9-c141-44c4-9a9d-de5e22a9b945 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:52.017707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3817a9-c141-44c4-9a9d-de5e22a9b945 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:52.017992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3817a9-c141-44c4-9a9d-de5e22a9b945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:52.077441 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ed3817a9-c141-44c4-9a9d-de5e22a9b945 None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:52.078804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ed3817a9-c141-44c4-9a9d-de5e22a9b945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:52.162721 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1157/2366] 10.222.0.50 () {58 vars in 967 bytes} [Thu Jun 2 16:08:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:52.175688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4a6ff-563d-4c73-a118-250ed382e870 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:52.177867 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6dd4a6ff-563d-4c73-a118-250ed382e870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:52.306785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4a6ff-563d-4c73-a118-250ed382e870 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:52.311942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d577b37-ff61-4018-b3eb-4129104e406d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:52.312630 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d577b37-ff61-4018-b3eb-4129104e406d service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:52.312918 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d577b37-ff61-4018-b3eb-4129104e406d service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:52.313201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d577b37-ff61-4018-b3eb-4129104e406d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:52.321750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d577b37-ff61-4018-b3eb-4129104e406d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:52.323349 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d577b37-ff61-4018-b3eb-4129104e406d service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:52.333319 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1210/2367] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 16:08:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:08:52.770863 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:52.937070 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:54.030999 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:54.587664 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:55.154323 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:55.773825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:56.283543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:57.305112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:57.374729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3817a9-c141-44c4-9a9d-de5e22a9b945 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:57.378767 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ed3817a9-c141-44c4-9a9d-de5e22a9b945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:57.490503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3817a9-c141-44c4-9a9d-de5e22a9b945 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:57.497748 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828de09b-cf97-41a5-8880-2f2532cb6346 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60a2abffc04ba59b65d5fca5e318a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:57.499219 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828de09b-cf97-41a5-8880-2f2532cb6346 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:57.499669 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828de09b-cf97-41a5-8880-2f2532cb6346 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:57.499951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828de09b-cf97-41a5-8880-2f2532cb6346 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:57.502449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-828de09b-cf97-41a5-8880-2f2532cb6346 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:57.515557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828de09b-cf97-41a5-8880-2f2532cb6346 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:57.517203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828de09b-cf97-41a5-8880-2f2532cb6346 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:57.529252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1158/2368] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:08:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:08:57.778781 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:57.970919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56223e-465f-49d6-9ccf-9fb56512be83 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:57.971210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56223e-465f-49d6-9ccf-9fb56512be83 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:57.971492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56223e-465f-49d6-9ccf-9fb56512be83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:57.989539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-be56223e-465f-49d6-9ccf-9fb56512be83 None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:08:57.990721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-be56223e-465f-49d6-9ccf-9fb56512be83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:08:58.001118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1211/2369] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Jun 2 16:08:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:08:58.016335 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828de09b-cf97-41a5-8880-2f2532cb6346 service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:08:58.030646 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828de09b-cf97-41a5-8880-2f2532cb6346 service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:08:58.036488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f319b2-6a2c-4e0d-9e8f-ed57de047784 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:08:58.039841 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f319b2-6a2c-4e0d-9e8f-ed57de047784 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:08:58.039841 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f319b2-6a2c-4e0d-9e8f-ed57de047784 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:08:58.039841 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f319b2-6a2c-4e0d-9e8f-ed57de047784 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:08:58.049628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f319b2-6a2c-4e0d-9e8f-ed57de047784 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:08:58.051408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f319b2-6a2c-4e0d-9e8f-ed57de047784 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:08:58.068122 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1159/2370] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 16:08:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:08:58.566740 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:58.870276 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:59.244865 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:59.652000 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:08:59.863614 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:00.481951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:00.514801 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:00.548108 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:00.705408 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:00.773624 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:01.139684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:01.253414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:02.202350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:02.573024 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:02.658722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:03.247750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:03.302179 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:03.499580 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:03.578812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:03.754680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:03.790866 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:03.879648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:03.985498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:04.098944 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:04.130751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:04.470040 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:04.516414 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:04.719172 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:04.748616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:04.885049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:04.984680 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:05.036027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:05.458827 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:05.496778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:05.661732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:06.579820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:06.790053 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:07.367819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:07.447287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:07.721519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:08.444654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:08.617910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:09.378797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:09.416300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:09.964489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662b350-c1d9-4f56-90ce-59a8b1cda997 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:09.965040 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662b350-c1d9-4f56-90ce-59a8b1cda997 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:09.965390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662b350-c1d9-4f56-90ce-59a8b1cda997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:09.984647 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3662b350-c1d9-4f56-90ce-59a8b1cda997 None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:09.986210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3662b350-c1d9-4f56-90ce-59a8b1cda997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:10.002239 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1212/2371] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Jun 2 16:09:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:10.017477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f319b2-6a2c-4e0d-9e8f-ed57de047784 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:10.022852 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:10.030594 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f319b2-6a2c-4e0d-9e8f-ed57de047784 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:10.039674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917e38d-aaeb-4f02-b227-5e4582c999a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:10.045967 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917e38d-aaeb-4f02-b227-5e4582c999a3 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:10.045967 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917e38d-aaeb-4f02-b227-5e4582c999a3 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:10.045967 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917e38d-aaeb-4f02-b227-5e4582c999a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:10.054391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917e38d-aaeb-4f02-b227-5e4582c999a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:10.056150 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917e38d-aaeb-4f02-b227-5e4582c999a3 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:10.064043 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:10.071078 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1160/2372] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 16:09:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:09:10.744387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:11.645294 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba8d57-7ef2-47c1-9953-df66aa310855 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:11.645770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba8d57-7ef2-47c1-9953-df66aa310855 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:11.645848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba8d57-7ef2-47c1-9953-df66aa310855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:11.664775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f2ba8d57-7ef2-47c1-9953-df66aa310855 None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:11.665946 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f2ba8d57-7ef2-47c1-9953-df66aa310855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:11.674084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1213/2373] 10.222.0.50 () {58 vars in 967 bytes} [Thu Jun 2 16:09:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:11.686653 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917e38d-aaeb-4f02-b227-5e4582c999a3 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:11.708570 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917e38d-aaeb-4f02-b227-5e4582c999a3 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:11.712087 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceeb899-435d-4dc1-a521-14d6c1419c0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:11.712964 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceeb899-435d-4dc1-a521-14d6c1419c0b service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:11.713497 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceeb899-435d-4dc1-a521-14d6c1419c0b service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:11.713972 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceeb899-435d-4dc1-a521-14d6c1419c0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:11.726564 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceeb899-435d-4dc1-a521-14d6c1419c0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:11.728582 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceeb899-435d-4dc1-a521-14d6c1419c0b service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:11.738632 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1161/2374] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 16:09:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:09:12.902144 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d06fa6-efb7-4723-9963-a66cb9e35f9f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:12.903138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d06fa6-efb7-4723-9963-a66cb9e35f9f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:12.903608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d06fa6-efb7-4723-9963-a66cb9e35f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:12.924368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a3d06fa6-efb7-4723-9963-a66cb9e35f9f None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:12.926114 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a3d06fa6-efb7-4723-9963-a66cb9e35f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:12.939712 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1214/2375] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Jun 2 16:09:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:12.955874 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceeb899-435d-4dc1-a521-14d6c1419c0b service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:12.969966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceeb899-435d-4dc1-a521-14d6c1419c0b service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:12.975765 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d10598-19a8-4f29-99f2-39627806e42f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:12.979188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d10598-19a8-4f29-99f2-39627806e42f service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:12.979188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d10598-19a8-4f29-99f2-39627806e42f service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:12.979188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d10598-19a8-4f29-99f2-39627806e42f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:12.987299 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d10598-19a8-4f29-99f2-39627806e42f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:12.988968 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d10598-19a8-4f29-99f2-39627806e42f service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:12.998810 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1162/2376] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 16:09:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 16:09:13.864640 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b917a5-248e-407d-8605-4954e3864762 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:13.864940 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b917a5-248e-407d-8605-4954e3864762 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:13.865423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b917a5-248e-407d-8605-4954e3864762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:13.887519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d9b917a5-248e-407d-8605-4954e3864762 None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:13.889770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d9b917a5-248e-407d-8605-4954e3864762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:13.898962 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1215/2377] 10.222.0.50 () {58 vars in 967 bytes} [Thu Jun 2 16:09:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:13.973964 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d10598-19a8-4f29-99f2-39627806e42f service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:13.994584 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d10598-19a8-4f29-99f2-39627806e42f service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:14.000539 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef42e62-1ec8-4ca6-a314-e22bd460aced service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:14.001442 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef42e62-1ec8-4ca6-a314-e22bd460aced service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:14.001882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef42e62-1ec8-4ca6-a314-e22bd460aced service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:14.002314 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef42e62-1ec8-4ca6-a314-e22bd460aced service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:14.011974 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef42e62-1ec8-4ca6-a314-e22bd460aced service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:14.017634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef42e62-1ec8-4ca6-a314-e22bd460aced service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:14.027811 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1163/2378] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 16:09:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:09:14.930695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa573a9-4ed1-42ec-bdf8-5117c6b70506 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:14.931775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa573a9-4ed1-42ec-bdf8-5117c6b70506 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:14.932417 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa573a9-4ed1-42ec-bdf8-5117c6b70506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:14.955195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dfa573a9-4ed1-42ec-bdf8-5117c6b70506 None None] MFA Rules not processed for user `fb70aacb7cfb41cea6a65a084e705ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:14.957125 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dfa573a9-4ed1-42ec-bdf8-5117c6b70506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:15.086061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1216/2379] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:16.787727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e81a5-6360-4e71-9006-045a2f3747e6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:16.788244 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e81a5-6360-4e71-9006-045a2f3747e6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:16.788460 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e81a5-6360-4e71-9006-045a2f3747e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:16.806976 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f84e81a5-6360-4e71-9006-045a2f3747e6 None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:16.808209 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f84e81a5-6360-4e71-9006-045a2f3747e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:16.815721 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1164/2380] 10.222.0.50 () {58 vars in 967 bytes} [Thu Jun 2 16:09:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:16.827792 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa573a9-4ed1-42ec-bdf8-5117c6b70506 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:16.839677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa573a9-4ed1-42ec-bdf8-5117c6b70506 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:16.845316 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eb51d-2f91-41df-870a-69c5bac72f10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:16.845957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eb51d-2f91-41df-870a-69c5bac72f10 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:16.846266 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eb51d-2f91-41df-870a-69c5bac72f10 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:16.846544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eb51d-2f91-41df-870a-69c5bac72f10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:16.854517 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28eb51d-2f91-41df-870a-69c5bac72f10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:16.856171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28eb51d-2f91-41df-870a-69c5bac72f10 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:16.864577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1217/2381] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 16:09:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:09:17.238960 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e81a5-6360-4e71-9006-045a2f3747e6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:17.240384 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f84e81a5-6360-4e71-9006-045a2f3747e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:17.314417 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e81a5-6360-4e71-9006-045a2f3747e6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:17.319110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac80e0-b5ee-4fd4-bf84-7ff9cdb10965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:17.320013 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac80e0-b5ee-4fd4-bf84-7ff9cdb10965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:17.320295 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac80e0-b5ee-4fd4-bf84-7ff9cdb10965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:17.320606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac80e0-b5ee-4fd4-bf84-7ff9cdb10965 admin admin] PATH_INFO: `/v3/users/6f732d9b58b9411c9dec64115b25ab2a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:17.321819 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac80e0-b5ee-4fd4-bf84-7ff9cdb10965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f732d9b58b9411c9dec64115b25ab2a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:17.323740 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac80e0-b5ee-4fd4-bf84-7ff9cdb10965 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:17.580485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bbac80e0-b5ee-4fd4-bf84-7ff9cdb10965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f732d9b58b9411c9dec64115b25ab2a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:17.581833 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:17.601416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bbac80e0-b5ee-4fd4-bf84-7ff9cdb10965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f732d9b58b9411c9dec64115b25ab2a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:17.602156 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bbac80e0-b5ee-4fd4-bf84-7ff9cdb10965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f732d9b58b9411c9dec64115b25ab2a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:17.609059 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bbac80e0-b5ee-4fd4-bf84-7ff9cdb10965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f732d9b58b9411c9dec64115b25ab2a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:17.609690 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bbac80e0-b5ee-4fd4-bf84-7ff9cdb10965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f732d9b58b9411c9dec64115b25ab2a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:17.701203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1165/2382] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:09:17 2022] DELETE /identity/v3/users/6f732d9b58b9411c9dec64115b25ab2a => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:17.705793 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94d44a-03b5-463f-afc9-77c6270fd4ce None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:17.706150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94d44a-03b5-463f-afc9-77c6270fd4ce None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:17.706433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94d44a-03b5-463f-afc9-77c6270fd4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:17.728603 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ef94d44a-03b5-463f-afc9-77c6270fd4ce None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:17.728603 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ef94d44a-03b5-463f-afc9-77c6270fd4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:17.746750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:17.784446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1218/2383] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:17.793981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac80e0-b5ee-4fd4-bf84-7ff9cdb10965 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:17.795913 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bbac80e0-b5ee-4fd4-bf84-7ff9cdb10965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:17.855931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac80e0-b5ee-4fd4-bf84-7ff9cdb10965 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:17.860190 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfea02-564c-4eec-8601-e61994a4c328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:17.860841 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfea02-564c-4eec-8601-e61994a4c328 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:17.861125 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfea02-564c-4eec-8601-e61994a4c328 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:17.861406 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfea02-564c-4eec-8601-e61994a4c328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:17.870655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfea02-564c-4eec-8601-e61994a4c328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:17.872158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfea02-564c-4eec-8601-e61994a4c328 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:17.882367 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1166/2384] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:09:18.145413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94d44a-03b5-463f-afc9-77c6270fd4ce None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:18.147505 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ef94d44a-03b5-463f-afc9-77c6270fd4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:18.161919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94d44a-03b5-463f-afc9-77c6270fd4ce None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:18.167966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad94fb-bbc7-416d-93b3-b12d6f370bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:18.168857 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad94fb-bbc7-416d-93b3-b12d6f370bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:18.169141 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad94fb-bbc7-416d-93b3-b12d6f370bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:18.170079 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad94fb-bbc7-416d-93b3-b12d6f370bf4 admin admin] PATH_INFO: `/v3/projects/81596de1ce3046bcafdee513da4e5c6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:18.171490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad94fb-bbc7-416d-93b3-b12d6f370bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81596de1ce3046bcafdee513da4e5c6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:18.173462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad94fb-bbc7-416d-93b3-b12d6f370bf4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:18.310515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2bad94fb-bbc7-416d-93b3-b12d6f370bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81596de1ce3046bcafdee513da4e5c6e', 'request_id': 'req-2bad94fb-bbc7-416d-93b3-b12d6f370bf4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:18.409735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2bad94fb-bbc7-416d-93b3-b12d6f370bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81596de1ce3046bcafdee513da4e5c6e', 'request_id': 'req-2bad94fb-bbc7-416d-93b3-b12d6f370bf4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:18.417000 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2bad94fb-bbc7-416d-93b3-b12d6f370bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81596de1ce3046bcafdee513da4e5c6e', 'request_id': 'req-2bad94fb-bbc7-416d-93b3-b12d6f370bf4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:18.428502 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2bad94fb-bbc7-416d-93b3-b12d6f370bf4 admin admin] The token cache is being invalidate because project 81596de1ce3046bcafdee513da4e5c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:09:18.428917 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2bad94fb-bbc7-416d-93b3-b12d6f370bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:18.429704 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2bad94fb-bbc7-416d-93b3-b12d6f370bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:18.431444 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1219/2385] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:09:18 2022] DELETE /identity/v3/projects/81596de1ce3046bcafdee513da4e5c6e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:18.436503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75be651-e805-4218-be6f-5f144b36d452 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:18.436905 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75be651-e805-4218-be6f-5f144b36d452 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:18.437299 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75be651-e805-4218-be6f-5f144b36d452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:18.459356 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d75be651-e805-4218-be6f-5f144b36d452 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:18.461048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d75be651-e805-4218-be6f-5f144b36d452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:18.527852 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1167/2386] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:18.536416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa665b-c32b-4350-8f92-e1b1ff0c5c48 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:18.536714 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa665b-c32b-4350-8f92-e1b1ff0c5c48 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:18.537005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa665b-c32b-4350-8f92-e1b1ff0c5c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:18.555702 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b8fa665b-c32b-4350-8f92-e1b1ff0c5c48 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:18.557000 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b8fa665b-c32b-4350-8f92-e1b1ff0c5c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:18.565858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1220/2387] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:18.573971 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75be651-e805-4218-be6f-5f144b36d452 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:18.584544 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75be651-e805-4218-be6f-5f144b36d452 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:18.589586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7faea-a1a8-4889-865f-a085e8cfe1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:18.590556 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7faea-a1a8-4889-865f-a085e8cfe1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:18.590848 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7faea-a1a8-4889-865f-a085e8cfe1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:18.591718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7faea-a1a8-4889-865f-a085e8cfe1c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:18.592490 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7faea-a1a8-4889-865f-a085e8cfe1c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:09:18.592808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7faea-a1a8-4889-865f-a085e8cfe1c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:18.597223 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7faea-a1a8-4889-865f-a085e8cfe1c2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:18.616163 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1168/2388] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:09:18.619510 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa665b-c32b-4350-8f92-e1b1ff0c5c48 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:18.630325 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa665b-c32b-4350-8f92-e1b1ff0c5c48 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:18.635174 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddfb42-d73d-43f8-b529-1030d8883d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:18.639964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddfb42-d73d-43f8-b529-1030d8883d43 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:18.639964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddfb42-d73d-43f8-b529-1030d8883d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:18.639964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddfb42-d73d-43f8-b529-1030d8883d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:18.639964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddfb42-d73d-43f8-b529-1030d8883d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:18.640850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddfb42-d73d-43f8-b529-1030d8883d43 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:18.754651 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1221/2389] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:09:18 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:09:18.761265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7faea-a1a8-4889-865f-a085e8cfe1c2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:18.776390 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7faea-a1a8-4889-865f-a085e8cfe1c2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:18.828969 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:18.837581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebafbc-36b4-4a8e-a97c-390698821866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:18.839709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebafbc-36b4-4a8e-a97c-390698821866 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:18.839709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebafbc-36b4-4a8e-a97c-390698821866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:18.839709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebafbc-36b4-4a8e-a97c-390698821866 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:18.839709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebafbc-36b4-4a8e-a97c-390698821866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:18.842446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebafbc-36b4-4a8e-a97c-390698821866 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:18.929711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1169/2390] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:09:18 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:09:18.930825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddfb42-d73d-43f8-b529-1030d8883d43 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:18.941615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddfb42-d73d-43f8-b529-1030d8883d43 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:18.946282 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdb939-5172-4c15-914a-7dd657eb5701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:18.946950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdb939-5172-4c15-914a-7dd657eb5701 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:18.947243 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdb939-5172-4c15-914a-7dd657eb5701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:18.947615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdb939-5172-4c15-914a-7dd657eb5701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:18.948382 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdb939-5172-4c15-914a-7dd657eb5701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:18.950090 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdb939-5172-4c15-914a-7dd657eb5701 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:18.961111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1222/2391] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:09:18.965076 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebafbc-36b4-4a8e-a97c-390698821866 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:18.975455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebafbc-36b4-4a8e-a97c-390698821866 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:18.980101 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e53cc4-dcd5-4545-aa82-17a8b5efbcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:18.980763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e53cc4-dcd5-4545-aa82-17a8b5efbcff admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:18.981054 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e53cc4-dcd5-4545-aa82-17a8b5efbcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:18.981342 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e53cc4-dcd5-4545-aa82-17a8b5efbcff admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:18.982097 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e53cc4-dcd5-4545-aa82-17a8b5efbcff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:18.983705 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e53cc4-dcd5-4545-aa82-17a8b5efbcff admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:18.994984 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1170/2392] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:09:18.999836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdb939-5172-4c15-914a-7dd657eb5701 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:19.010553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdb939-5172-4c15-914a-7dd657eb5701 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:19.016123 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a6f80-d79e-40e1-b9f9-56b028f1c3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:19.017034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a6f80-d79e-40e1-b9f9-56b028f1c3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:19.017323 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a6f80-d79e-40e1-b9f9-56b028f1c3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:19.017604 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a6f80-d79e-40e1-b9f9-56b028f1c3ca admin admin] PATH_INFO: `/v3/projects/b543e52f50c44ba395185b5f094edf71/users/5fc1c3e9e955412398e52a32236848a4/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:19.032185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a6f80-d79e-40e1-b9f9-56b028f1c3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b543e52f50c44ba395185b5f094edf71, user_id=5fc1c3e9e955412398e52a32236848a4, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:19.034829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a6f80-d79e-40e1-b9f9-56b028f1c3ca admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:19.125288 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1223/2393] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:09:18 2022] PUT /identity/v3/projects/b543e52f50c44ba395185b5f094edf71/users/5fc1c3e9e955412398e52a32236848a4/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:19.130255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba1f46-fbe7-47f1-bc54-a01d5de6f22a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:19.130546 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba1f46-fbe7-47f1-bc54-a01d5de6f22a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:19.130877 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba1f46-fbe7-47f1-bc54-a01d5de6f22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:19.151541 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ddba1f46-fbe7-47f1-bc54-a01d5de6f22a None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:19.152803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ddba1f46-fbe7-47f1-bc54-a01d5de6f22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:19.228158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1171/2394] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:19.236525 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a6f80-d79e-40e1-b9f9-56b028f1c3ca admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:19.238410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-227a6f80-d79e-40e1-b9f9-56b028f1c3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:19.297466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:19.302920 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a6f80-d79e-40e1-b9f9-56b028f1c3ca admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:19.307027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeed607-16bf-480f-a4d8-9a06a2b2c0d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:19.307754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeed607-16bf-480f-a4d8-9a06a2b2c0d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:19.308181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeed607-16bf-480f-a4d8-9a06a2b2c0d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:19.308548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeed607-16bf-480f-a4d8-9a06a2b2c0d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:19.319610 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeed607-16bf-480f-a4d8-9a06a2b2c0d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:19.321093 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeed607-16bf-480f-a4d8-9a06a2b2c0d9 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:19.331544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1224/2395] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:09:20.782531 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba1f46-fbe7-47f1-bc54-a01d5de6f22a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:20.789165 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ddba1f46-fbe7-47f1-bc54-a01d5de6f22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:20.812768 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba1f46-fbe7-47f1-bc54-a01d5de6f22a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:20.818034 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07609da-521d-4dd2-8dd9-2aeea3257084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:20.819052 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07609da-521d-4dd2-8dd9-2aeea3257084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:20.819442 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07609da-521d-4dd2-8dd9-2aeea3257084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:20.819823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07609da-521d-4dd2-8dd9-2aeea3257084 admin admin] PATH_INFO: `/v3/users/c129d5516af2481081596ffa775d3ba1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:20.821199 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07609da-521d-4dd2-8dd9-2aeea3257084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c129d5516af2481081596ffa775d3ba1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:20.824075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07609da-521d-4dd2-8dd9-2aeea3257084 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:21.065386 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c07609da-521d-4dd2-8dd9-2aeea3257084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c129d5516af2481081596ffa775d3ba1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:21.080403 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c07609da-521d-4dd2-8dd9-2aeea3257084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c129d5516af2481081596ffa775d3ba1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:21.081450 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c07609da-521d-4dd2-8dd9-2aeea3257084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c129d5516af2481081596ffa775d3ba1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:21.089054 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c07609da-521d-4dd2-8dd9-2aeea3257084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c129d5516af2481081596ffa775d3ba1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:21.090102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c07609da-521d-4dd2-8dd9-2aeea3257084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c129d5516af2481081596ffa775d3ba1'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:21.236875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1172/2396] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:09:20 2022] DELETE /identity/v3/users/c129d5516af2481081596ffa775d3ba1 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:21.556112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeed607-16bf-480f-a4d8-9a06a2b2c0d9 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:21.566908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeed607-16bf-480f-a4d8-9a06a2b2c0d9 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:21.632070 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84df21-bc4f-4aa7-bad7-082e15da1459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:21.632977 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84df21-bc4f-4aa7-bad7-082e15da1459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:21.633389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84df21-bc4f-4aa7-bad7-082e15da1459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:21.633697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84df21-bc4f-4aa7-bad7-082e15da1459 admin admin] PATH_INFO: `/v3/projects/7b217721b49c485196adab69b8dbf972` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:21.635315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84df21-bc4f-4aa7-bad7-082e15da1459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b217721b49c485196adab69b8dbf972)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:21.637532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84df21-bc4f-4aa7-bad7-082e15da1459 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:21.790087 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1d84df21-bc4f-4aa7-bad7-082e15da1459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b217721b49c485196adab69b8dbf972', 'request_id': 'req-1d84df21-bc4f-4aa7-bad7-082e15da1459'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:21.903249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1d84df21-bc4f-4aa7-bad7-082e15da1459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b217721b49c485196adab69b8dbf972', 'request_id': 'req-1d84df21-bc4f-4aa7-bad7-082e15da1459'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:21.910561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1d84df21-bc4f-4aa7-bad7-082e15da1459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b217721b49c485196adab69b8dbf972', 'request_id': 'req-1d84df21-bc4f-4aa7-bad7-082e15da1459'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:21.922513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1d84df21-bc4f-4aa7-bad7-082e15da1459 admin admin] The token cache is being invalidate because project 7b217721b49c485196adab69b8dbf972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:09:21.923015 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1d84df21-bc4f-4aa7-bad7-082e15da1459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:21.923898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1d84df21-bc4f-4aa7-bad7-082e15da1459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:21.926898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1225/2397] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:09:21 2022] DELETE /identity/v3/projects/7b217721b49c485196adab69b8dbf972 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:21.933095 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a052ab-e857-4bbc-be9a-0bd2c1385af8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:21.933624 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a052ab-e857-4bbc-be9a-0bd2c1385af8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:21.933790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a052ab-e857-4bbc-be9a-0bd2c1385af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:21.957652 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-87a052ab-e857-4bbc-be9a-0bd2c1385af8 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:21.959023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-87a052ab-e857-4bbc-be9a-0bd2c1385af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:22.048313 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:22.069822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1173/2398] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:22.078360 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba80c2-284f-451b-bd4b-38652790137f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:22.079048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba80c2-284f-451b-bd4b-38652790137f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:22.079710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba80c2-284f-451b-bd4b-38652790137f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:22.129505 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f5ba80c2-284f-451b-bd4b-38652790137f None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:22.130991 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f5ba80c2-284f-451b-bd4b-38652790137f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:22.149428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1226/2399] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:22.149944 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a052ab-e857-4bbc-be9a-0bd2c1385af8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:22.168224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a052ab-e857-4bbc-be9a-0bd2c1385af8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:22.189670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745eaf54-150d-490a-ade5-e38a47fef499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:22.190747 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745eaf54-150d-490a-ade5-e38a47fef499 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:22.191047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745eaf54-150d-490a-ade5-e38a47fef499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:22.191332 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745eaf54-150d-490a-ade5-e38a47fef499 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:22.192140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745eaf54-150d-490a-ade5-e38a47fef499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:09:22.192521 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745eaf54-150d-490a-ade5-e38a47fef499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:22.195077 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745eaf54-150d-490a-ade5-e38a47fef499 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:22.229860 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba80c2-284f-451b-bd4b-38652790137f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:22.240221 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1174/2400] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:09:22.241920 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba80c2-284f-451b-bd4b-38652790137f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:22.256477 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a505f-b98a-4fa6-b003-9d12829176a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:22.257110 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a505f-b98a-4fa6-b003-9d12829176a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:22.257403 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a505f-b98a-4fa6-b003-9d12829176a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:22.257689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a505f-b98a-4fa6-b003-9d12829176a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:22.258410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a505f-b98a-4fa6-b003-9d12829176a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:22.260539 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a505f-b98a-4fa6-b003-9d12829176a8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:22.378073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1227/2401] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:09:22 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:09:22.393724 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745eaf54-150d-490a-ade5-e38a47fef499 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:22.396024 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745eaf54-150d-490a-ade5-e38a47fef499 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:22.502354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50263d83-3953-4e33-8498-2ddf131b298f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:22.503361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50263d83-3953-4e33-8498-2ddf131b298f admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:22.504067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50263d83-3953-4e33-8498-2ddf131b298f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:22.504330 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50263d83-3953-4e33-8498-2ddf131b298f admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:22.505237 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50263d83-3953-4e33-8498-2ddf131b298f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:22.508328 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50263d83-3953-4e33-8498-2ddf131b298f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:22.592025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1175/2402] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:09:22 2022] POST /identity/v3/users => generated 284 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:09:22.596060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a505f-b98a-4fa6-b003-9d12829176a8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:22.609312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a505f-b98a-4fa6-b003-9d12829176a8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:22.614523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278b4e9-6862-46c0-a6a3-f449c5b20a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:22.615211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278b4e9-6862-46c0-a6a3-f449c5b20a63 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:22.615509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278b4e9-6862-46c0-a6a3-f449c5b20a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:22.615795 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278b4e9-6862-46c0-a6a3-f449c5b20a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:22.616563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278b4e9-6862-46c0-a6a3-f449c5b20a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:22.618557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d278b4e9-6862-46c0-a6a3-f449c5b20a63 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:22.631061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1228/2403] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:09:22.634905 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50263d83-3953-4e33-8498-2ddf131b298f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:22.645888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50263d83-3953-4e33-8498-2ddf131b298f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:22.650755 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb58b06-f768-4c52-8777-794115baba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:22.651448 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb58b06-f768-4c52-8777-794115baba1e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:22.651732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb58b06-f768-4c52-8777-794115baba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:22.652035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb58b06-f768-4c52-8777-794115baba1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:22.652776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb58b06-f768-4c52-8777-794115baba1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:22.654937 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb58b06-f768-4c52-8777-794115baba1e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:22.668773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1176/2404] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:09:22.673476 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278b4e9-6862-46c0-a6a3-f449c5b20a63 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:22.684118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278b4e9-6862-46c0-a6a3-f449c5b20a63 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:22.690622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcda1ec-16c9-4a79-9732-9dd7dfb640ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:22.692172 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcda1ec-16c9-4a79-9732-9dd7dfb640ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:22.692459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcda1ec-16c9-4a79-9732-9dd7dfb640ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:22.692741 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcda1ec-16c9-4a79-9732-9dd7dfb640ea admin admin] PATH_INFO: `/v3/projects/9d1d18d155ce4e0cad5a24469cad05aa/users/32a9033f60f5468fa7d1f8095959a275/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:22.710910 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcda1ec-16c9-4a79-9732-9dd7dfb640ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1d18d155ce4e0cad5a24469cad05aa, user_id=32a9033f60f5468fa7d1f8095959a275, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:22.714546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcda1ec-16c9-4a79-9732-9dd7dfb640ea admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:22.830304 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1229/2405] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:09:22 2022] PUT /identity/v3/projects/9d1d18d155ce4e0cad5a24469cad05aa/users/32a9033f60f5468fa7d1f8095959a275/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:22.841597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643655c-9351-4475-8bc8-70730291dc80 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:22.841897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643655c-9351-4475-8bc8-70730291dc80 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:22.842193 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643655c-9351-4475-8bc8-70730291dc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:22.871158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a643655c-9351-4475-8bc8-70730291dc80 None None] MFA Rules not processed for user `32a9033f60f5468fa7d1f8095959a275`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:22.872491 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a643655c-9351-4475-8bc8-70730291dc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:22.942124 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1177/2406] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:22.953898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcda1ec-16c9-4a79-9732-9dd7dfb640ea admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:22.955607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8bcda1ec-16c9-4a79-9732-9dd7dfb640ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:22.977933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:23.041540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcda1ec-16c9-4a79-9732-9dd7dfb640ea admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:23.046440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bd211-c556-4a0f-a6e7-9ad802c7e836 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5157588644972a6a4554b3a9f1d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:23.047104 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd211-c556-4a0f-a6e7-9ad802c7e836 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:23.047693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd211-c556-4a0f-a6e7-9ad802c7e836 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:23.047815 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd211-c556-4a0f-a6e7-9ad802c7e836 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:23.058212 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bd211-c556-4a0f-a6e7-9ad802c7e836 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:23.060961 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bd211-c556-4a0f-a6e7-9ad802c7e836 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:23.069190 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1230/2407] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:09:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:09:26.223940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90911e-36bd-4f3e-9ffb-f1a31b155faf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:26.224419 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90911e-36bd-4f3e-9ffb-f1a31b155faf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:26.224581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90911e-36bd-4f3e-9ffb-f1a31b155faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:26.272726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cfe71-a5ae-41cb-b6fa-9f3d54463d94 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:26.273247 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cfe71-a5ae-41cb-b6fa-9f3d54463d94 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:26.273247 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cfe71-a5ae-41cb-b6fa-9f3d54463d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:26.284533 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bc90911e-36bd-4f3e-9ffb-f1a31b155faf None None] MFA Rules not processed for user `5fc1c3e9e955412398e52a32236848a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:26.287866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bc90911e-36bd-4f3e-9ffb-f1a31b155faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:26.311506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-069cfe71-a5ae-41cb-b6fa-9f3d54463d94 None None] MFA Rules not processed for user `2a972defd2a841768633fac694002d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:26.313170 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-069cfe71-a5ae-41cb-b6fa-9f3d54463d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:26.332323 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:26.374350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1178/2408] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:26.379051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90911e-36bd-4f3e-9ffb-f1a31b155faf None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:26.383703 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bc90911e-36bd-4f3e-9ffb-f1a31b155faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:26.396730 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1231/2409] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:26.467706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90911e-36bd-4f3e-9ffb-f1a31b155faf None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:26.473187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d010b51-dff2-4b3b-8f1f-d8235db7a2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:26.473932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d010b51-dff2-4b3b-8f1f-d8235db7a2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:26.474291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d010b51-dff2-4b3b-8f1f-d8235db7a2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:26.474788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d010b51-dff2-4b3b-8f1f-d8235db7a2b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:26.475526 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d010b51-dff2-4b3b-8f1f-d8235db7a2b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:26.477687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d010b51-dff2-4b3b-8f1f-d8235db7a2b8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:26.600792 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1179/2410] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:09:26 2022] POST /identity/v3/projects => generated 371 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:09:26.604770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cfe71-a5ae-41cb-b6fa-9f3d54463d94 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:26.616753 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cfe71-a5ae-41cb-b6fa-9f3d54463d94 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:26.676254 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b5d2e-7a3a-400f-b886-bac35b2775d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:26.676931 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b5d2e-7a3a-400f-b886-bac35b2775d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:26.677214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b5d2e-7a3a-400f-b886-bac35b2775d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:26.677491 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b5d2e-7a3a-400f-b886-bac35b2775d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:26.678187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b5d2e-7a3a-400f-b886-bac35b2775d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:26.680141 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b5d2e-7a3a-400f-b886-bac35b2775d9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:26.794355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1232/2411] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:09:26 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:09:26.798368 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d010b51-dff2-4b3b-8f1f-d8235db7a2b8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:26.820386 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d010b51-dff2-4b3b-8f1f-d8235db7a2b8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:26.826057 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923def9-d607-4dd8-a7b4-2a2504da72b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:26.826731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923def9-d607-4dd8-a7b4-2a2504da72b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:26.827016 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923def9-d607-4dd8-a7b4-2a2504da72b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:26.827297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923def9-d607-4dd8-a7b4-2a2504da72b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:26.828079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923def9-d607-4dd8-a7b4-2a2504da72b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:26.829881 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923def9-d607-4dd8-a7b4-2a2504da72b3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:26.844005 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1180/2412] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:09:26.848142 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b5d2e-7a3a-400f-b886-bac35b2775d9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:26.858687 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b5d2e-7a3a-400f-b886-bac35b2775d9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:26.863228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff4189-a88c-473e-950c-2362ec0daf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:26.864154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff4189-a88c-473e-950c-2362ec0daf08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:26.864440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff4189-a88c-473e-950c-2362ec0daf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:26.864717 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff4189-a88c-473e-950c-2362ec0daf08 admin admin] PATH_INFO: `/v3/projects/5e9a9e7a581b42a5a1428db2cbd7bc47/users/339979971398409891a7c1e71b3d6c67/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:26.881671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff4189-a88c-473e-950c-2362ec0daf08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9a9e7a581b42a5a1428db2cbd7bc47, user_id=339979971398409891a7c1e71b3d6c67, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:26.884856 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff4189-a88c-473e-950c-2362ec0daf08 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:26.995483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1233/2413] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:09:26 2022] PUT /identity/v3/projects/5e9a9e7a581b42a5a1428db2cbd7bc47/users/339979971398409891a7c1e71b3d6c67/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:26.996660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923def9-d607-4dd8-a7b4-2a2504da72b3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:27.024932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923def9-d607-4dd8-a7b4-2a2504da72b3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:27.121467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b6678-601a-43b4-adb2-e3222f88cffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:27.122241 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6678-601a-43b4-adb2-e3222f88cffb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:27.122534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6678-601a-43b4-adb2-e3222f88cffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:27.123004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6678-601a-43b4-adb2-e3222f88cffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:27.123754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b6678-601a-43b4-adb2-e3222f88cffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:27.126006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b6678-601a-43b4-adb2-e3222f88cffb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:27.148256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff4189-a88c-473e-950c-2362ec0daf08 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:27.148542 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1181/2414] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:09:27.158666 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff4189-a88c-473e-950c-2362ec0daf08 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:27.168505 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee46dc9-1d4e-411a-aa3c-deaea0931148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:27.170418 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee46dc9-1d4e-411a-aa3c-deaea0931148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:27.170418 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee46dc9-1d4e-411a-aa3c-deaea0931148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:27.170843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee46dc9-1d4e-411a-aa3c-deaea0931148 admin admin] PATH_INFO: `/v3/projects/5e9a9e7a581b42a5a1428db2cbd7bc47/users/339979971398409891a7c1e71b3d6c67/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:27.174879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee46dc9-1d4e-411a-aa3c-deaea0931148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9a9e7a581b42a5a1428db2cbd7bc47, user_id=339979971398409891a7c1e71b3d6c67, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:27.175783 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee46dc9-1d4e-411a-aa3c-deaea0931148 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:27.182483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:27.192187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1234/2415] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:09:27 2022] PUT /identity/v3/projects/5e9a9e7a581b42a5a1428db2cbd7bc47/users/339979971398409891a7c1e71b3d6c67/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:35.734246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efd4e0-c44d-44b8-a64d-7b7534acf202 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:35.739798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efd4e0-c44d-44b8-a64d-7b7534acf202 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:35.739798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efd4e0-c44d-44b8-a64d-7b7534acf202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:35.768404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-40efd4e0-c44d-44b8-a64d-7b7534acf202 None None] MFA Rules not processed for user `339979971398409891a7c1e71b3d6c67`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:35.770177 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-40efd4e0-c44d-44b8-a64d-7b7534acf202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:35.804723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:35.849693 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1182/2416] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:35.863269 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee46dc9-1d4e-411a-aa3c-deaea0931148 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:35.865814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3ee46dc9-1d4e-411a-aa3c-deaea0931148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:35.962125 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee46dc9-1d4e-411a-aa3c-deaea0931148 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:35.969023 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96028de4-d3b4-41de-9cac-4590958de602 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:35.970062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96028de4-d3b4-41de-9cac-4590958de602 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:35.970553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96028de4-d3b4-41de-9cac-4590958de602 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:35.971456 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96028de4-d3b4-41de-9cac-4590958de602 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:36.043714 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96028de4-d3b4-41de-9cac-4590958de602 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:36.045541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96028de4-d3b4-41de-9cac-4590958de602 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:36.055876 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1235/2417] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:09:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:09:39.576470 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae33070-b781-4bdf-86c5-5725a0a67b64 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:39.576972 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae33070-b781-4bdf-86c5-5725a0a67b64 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:39.577078 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae33070-b781-4bdf-86c5-5725a0a67b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:39.597588 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7ae33070-b781-4bdf-86c5-5725a0a67b64 None None] MFA Rules not processed for user `5fc1c3e9e955412398e52a32236848a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:39.598876 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7ae33070-b781-4bdf-86c5-5725a0a67b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:39.606278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1183/2418] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:42.871018 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f4299-1b58-47d8-ae24-164c359afccb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:42.871018 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f4299-1b58-47d8-ae24-164c359afccb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:42.871018 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f4299-1b58-47d8-ae24-164c359afccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:42.881496 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d98f4299-1b58-47d8-ae24-164c359afccb None None] MFA Rules not processed for user `3913e5416fd742509fe6b431261e2620`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:42.882776 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d98f4299-1b58-47d8-ae24-164c359afccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:42.942583 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1236/2419] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:09:49.592005 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=18 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:50.124747 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae33070-b781-4bdf-86c5-5725a0a67b64 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:50.189256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae33070-b781-4bdf-86c5-5725a0a67b64 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:50.193895 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951481d6-7308-4bbc-b61f-5951fe9c636d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:50.194764 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951481d6-7308-4bbc-b61f-5951fe9c636d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:50.195051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951481d6-7308-4bbc-b61f-5951fe9c636d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:50.195359 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951481d6-7308-4bbc-b61f-5951fe9c636d admin admin] PATH_INFO: `/v3/users/32a9033f60f5468fa7d1f8095959a275` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:50.196584 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951481d6-7308-4bbc-b61f-5951fe9c636d admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a9033f60f5468fa7d1f8095959a275)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:50.198518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951481d6-7308-4bbc-b61f-5951fe9c636d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:50.488127 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-951481d6-7308-4bbc-b61f-5951fe9c636d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a9033f60f5468fa7d1f8095959a275'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:50.501085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-951481d6-7308-4bbc-b61f-5951fe9c636d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a9033f60f5468fa7d1f8095959a275'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:50.501852 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-951481d6-7308-4bbc-b61f-5951fe9c636d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a9033f60f5468fa7d1f8095959a275'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:50.510887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-951481d6-7308-4bbc-b61f-5951fe9c636d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a9033f60f5468fa7d1f8095959a275'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:50.510887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-951481d6-7308-4bbc-b61f-5951fe9c636d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a9033f60f5468fa7d1f8095959a275'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:50.645980 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1184/2420] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:09:50 2022] DELETE /identity/v3/users/32a9033f60f5468fa7d1f8095959a275 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:50.650360 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27745de9-bf6d-4d94-8cde-0aaa326f8415 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:50.662746 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27745de9-bf6d-4d94-8cde-0aaa326f8415 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:50.662746 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27745de9-bf6d-4d94-8cde-0aaa326f8415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:50.668965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-27745de9-bf6d-4d94-8cde-0aaa326f8415 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:50.670156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-27745de9-bf6d-4d94-8cde-0aaa326f8415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:50.704241 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:50.730789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1237/2421] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:50.740472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951481d6-7308-4bbc-b61f-5951fe9c636d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:50.741895 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-951481d6-7308-4bbc-b61f-5951fe9c636d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:50.803138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951481d6-7308-4bbc-b61f-5951fe9c636d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:50.806843 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3608ef-002c-4587-9122-3a5ac0caefc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:50.807576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3608ef-002c-4587-9122-3a5ac0caefc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:50.807867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3608ef-002c-4587-9122-3a5ac0caefc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:50.808175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3608ef-002c-4587-9122-3a5ac0caefc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:50.818202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3608ef-002c-4587-9122-3a5ac0caefc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:50.819851 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3608ef-002c-4587-9122-3a5ac0caefc7 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:50.830386 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1185/2422] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:09:51.338265 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27745de9-bf6d-4d94-8cde-0aaa326f8415 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:51.339683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-27745de9-bf6d-4d94-8cde-0aaa326f8415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:51.361240 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27745de9-bf6d-4d94-8cde-0aaa326f8415 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:51.367459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004b7c3-580c-4fd9-a182-f541082c8af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:51.368550 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004b7c3-580c-4fd9-a182-f541082c8af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:51.368958 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004b7c3-580c-4fd9-a182-f541082c8af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:51.369431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004b7c3-580c-4fd9-a182-f541082c8af3 admin admin] PATH_INFO: `/v3/projects/9d1d18d155ce4e0cad5a24469cad05aa` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:51.370666 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004b7c3-580c-4fd9-a182-f541082c8af3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d1d18d155ce4e0cad5a24469cad05aa)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:51.372819 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004b7c3-580c-4fd9-a182-f541082c8af3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:51.523966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0004b7c3-580c-4fd9-a182-f541082c8af3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d1d18d155ce4e0cad5a24469cad05aa', 'request_id': 'req-0004b7c3-580c-4fd9-a182-f541082c8af3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:51.610761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0004b7c3-580c-4fd9-a182-f541082c8af3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d1d18d155ce4e0cad5a24469cad05aa', 'request_id': 'req-0004b7c3-580c-4fd9-a182-f541082c8af3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:51.617248 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0004b7c3-580c-4fd9-a182-f541082c8af3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d1d18d155ce4e0cad5a24469cad05aa', 'request_id': 'req-0004b7c3-580c-4fd9-a182-f541082c8af3'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:51.628280 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0004b7c3-580c-4fd9-a182-f541082c8af3 admin admin] The token cache is being invalidate because project 9d1d18d155ce4e0cad5a24469cad05aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:09:51.628570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0004b7c3-580c-4fd9-a182-f541082c8af3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:51.629206 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0004b7c3-580c-4fd9-a182-f541082c8af3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:09:51.630736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1238/2423] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:09:51 2022] DELETE /identity/v3/projects/9d1d18d155ce4e0cad5a24469cad05aa => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:51.635584 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3a153-64fa-46b5-8bf8-400d1f8e5a32 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:51.635950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3a153-64fa-46b5-8bf8-400d1f8e5a32 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:51.638714 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3a153-64fa-46b5-8bf8-400d1f8e5a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:51.655888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-55a3a153-64fa-46b5-8bf8-400d1f8e5a32 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:51.657145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-55a3a153-64fa-46b5-8bf8-400d1f8e5a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:51.674868 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:51.715670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1186/2424] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:09:51.723615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c437f-645a-4744-9221-6d411f4396d8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:51.724144 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c437f-645a-4744-9221-6d411f4396d8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:51.724263 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c437f-645a-4744-9221-6d411f4396d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:51.742495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3d8c437f-645a-4744-9221-6d411f4396d8 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:51.743697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3d8c437f-645a-4744-9221-6d411f4396d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:51.752222 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1239/2425] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:51.756329 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3a153-64fa-46b5-8bf8-400d1f8e5a32 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:51.766149 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3a153-64fa-46b5-8bf8-400d1f8e5a32 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:51.770633 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6a6dc-9e1c-4701-bd87-8e287e115575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:51.771275 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6a6dc-9e1c-4701-bd87-8e287e115575 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:51.771559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6a6dc-9e1c-4701-bd87-8e287e115575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:51.771838 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6a6dc-9e1c-4701-bd87-8e287e115575 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:51.772617 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6a6dc-9e1c-4701-bd87-8e287e115575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:09:51.772927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6a6dc-9e1c-4701-bd87-8e287e115575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:51.774532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6a6dc-9e1c-4701-bd87-8e287e115575 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:51.786565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1187/2426] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:09:51.790792 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c437f-645a-4744-9221-6d411f4396d8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:51.800878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c437f-645a-4744-9221-6d411f4396d8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:51.805640 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace67be-89bb-4e49-9970-82fa5bc8c1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:51.806284 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace67be-89bb-4e49-9970-82fa5bc8c1fc admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:51.806569 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace67be-89bb-4e49-9970-82fa5bc8c1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:51.806846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace67be-89bb-4e49-9970-82fa5bc8c1fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:51.807593 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace67be-89bb-4e49-9970-82fa5bc8c1fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:51.809556 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace67be-89bb-4e49-9970-82fa5bc8c1fc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:51.939333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1240/2427] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:09:51 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:09:51.951903 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6a6dc-9e1c-4701-bd87-8e287e115575 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:51.962115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6a6dc-9e1c-4701-bd87-8e287e115575 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:52.020478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037238b-3336-4d13-ac26-f6868a94c6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:52.021182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037238b-3336-4d13-ac26-f6868a94c6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:52.021474 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037238b-3336-4d13-ac26-f6868a94c6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:52.021787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037238b-3336-4d13-ac26-f6868a94c6a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:52.022491 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037238b-3336-4d13-ac26-f6868a94c6a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:52.024451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037238b-3336-4d13-ac26-f6868a94c6a7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:52.128719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1188/2428] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:09:51 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:09:52.132745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace67be-89bb-4e49-9970-82fa5bc8c1fc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:52.143340 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace67be-89bb-4e49-9970-82fa5bc8c1fc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:52.147931 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f3b33-95fb-4b7b-928d-1f82b257c2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:52.148643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f3b33-95fb-4b7b-928d-1f82b257c2bb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:52.149135 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f3b33-95fb-4b7b-928d-1f82b257c2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:52.149268 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f3b33-95fb-4b7b-928d-1f82b257c2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:52.149908 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f3b33-95fb-4b7b-928d-1f82b257c2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:52.151509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f3b33-95fb-4b7b-928d-1f82b257c2bb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:52.162211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1241/2429] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:09:52.166142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037238b-3336-4d13-ac26-f6868a94c6a7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:52.178055 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037238b-3336-4d13-ac26-f6868a94c6a7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:52.182300 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362d5e2-4b5b-4db5-8122-edbaf69ade13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:52.182965 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362d5e2-4b5b-4db5-8122-edbaf69ade13 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:52.183257 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362d5e2-4b5b-4db5-8122-edbaf69ade13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:52.183549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362d5e2-4b5b-4db5-8122-edbaf69ade13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:52.184363 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362d5e2-4b5b-4db5-8122-edbaf69ade13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:52.185996 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362d5e2-4b5b-4db5-8122-edbaf69ade13 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:52.196009 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1189/2430] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:09:52.200261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f3b33-95fb-4b7b-928d-1f82b257c2bb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:52.210171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f3b33-95fb-4b7b-928d-1f82b257c2bb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:52.215485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f461806-97f1-4dc9-a203-7336f9dd4aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:52.216994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f461806-97f1-4dc9-a203-7336f9dd4aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:52.217281 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f461806-97f1-4dc9-a203-7336f9dd4aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:52.217561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f461806-97f1-4dc9-a203-7336f9dd4aeb admin admin] PATH_INFO: `/v3/projects/769df0553ff34e2a8c9c45a801463071/users/4d9785989f98450794ab8ec3c592f4f6/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:52.232705 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f461806-97f1-4dc9-a203-7336f9dd4aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=769df0553ff34e2a8c9c45a801463071, user_id=4d9785989f98450794ab8ec3c592f4f6, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:52.235308 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f461806-97f1-4dc9-a203-7336f9dd4aeb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:52.391960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1242/2431] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:09:52 2022] PUT /identity/v3/projects/769df0553ff34e2a8c9c45a801463071/users/4d9785989f98450794ab8ec3c592f4f6/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:09:52.463056 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086f344-01e4-4310-9b06-72a5cbe3757e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:52.463355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086f344-01e4-4310-9b06-72a5cbe3757e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:52.463642 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086f344-01e4-4310-9b06-72a5cbe3757e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:52.491265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f086f344-01e4-4310-9b06-72a5cbe3757e None None] MFA Rules not processed for user `4d9785989f98450794ab8ec3c592f4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:09:52.492442 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f086f344-01e4-4310-9b06-72a5cbe3757e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:52.560643 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1190/2432] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:09:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:09:52.571369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f461806-97f1-4dc9-a203-7336f9dd4aeb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:09:52.573122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1f461806-97f1-4dc9-a203-7336f9dd4aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:09:52.632667 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f461806-97f1-4dc9-a203-7336f9dd4aeb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:09:52.636279 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf04d01-6692-4ddb-aa5e-01dba2d64c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:09:52.636925 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf04d01-6692-4ddb-aa5e-01dba2d64c94 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:09:52.637216 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf04d01-6692-4ddb-aa5e-01dba2d64c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:09:52.638047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf04d01-6692-4ddb-aa5e-01dba2d64c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:09:52.646489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf04d01-6692-4ddb-aa5e-01dba2d64c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:09:52.647924 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf04d01-6692-4ddb-aa5e-01dba2d64c94 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:09:52.652515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:09:52.657639 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1243/2433] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:09:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:10:02.557685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:04.576646 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086f344-01e4-4310-9b06-72a5cbe3757e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:04.639477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086f344-01e4-4310-9b06-72a5cbe3757e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:04.644323 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f14ab-409d-4a20-8c9e-7abe103f9472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:04.645213 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f14ab-409d-4a20-8c9e-7abe103f9472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:04.645505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f14ab-409d-4a20-8c9e-7abe103f9472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:04.645791 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f14ab-409d-4a20-8c9e-7abe103f9472 admin admin] PATH_INFO: `/v3/users/4d9785989f98450794ab8ec3c592f4f6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:04.647012 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f14ab-409d-4a20-8c9e-7abe103f9472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d9785989f98450794ab8ec3c592f4f6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:04.649034 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f14ab-409d-4a20-8c9e-7abe103f9472 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:04.897194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ba8f14ab-409d-4a20-8c9e-7abe103f9472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d9785989f98450794ab8ec3c592f4f6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:04.909533 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ba8f14ab-409d-4a20-8c9e-7abe103f9472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d9785989f98450794ab8ec3c592f4f6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:04.910306 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ba8f14ab-409d-4a20-8c9e-7abe103f9472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d9785989f98450794ab8ec3c592f4f6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:04.917666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ba8f14ab-409d-4a20-8c9e-7abe103f9472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d9785989f98450794ab8ec3c592f4f6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:04.918358 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ba8f14ab-409d-4a20-8c9e-7abe103f9472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d9785989f98450794ab8ec3c592f4f6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:05.010727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1191/2434] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:10:04 2022] DELETE /identity/v3/users/4d9785989f98450794ab8ec3c592f4f6 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:05.016128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db0327-b3dc-4efb-8a44-5b57167693f6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:05.016585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db0327-b3dc-4efb-8a44-5b57167693f6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:05.016716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db0327-b3dc-4efb-8a44-5b57167693f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:05.034169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-98db0327-b3dc-4efb-8a44-5b57167693f6 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:05.035368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-98db0327-b3dc-4efb-8a44-5b57167693f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:05.093531 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1244/2435] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:05.103102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f14ab-409d-4a20-8c9e-7abe103f9472 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:05.104544 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ba8f14ab-409d-4a20-8c9e-7abe103f9472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:05.164045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f14ab-409d-4a20-8c9e-7abe103f9472 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:05.167741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4ea34-0d98-427c-a7c4-871e37492ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:05.168451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4ea34-0d98-427c-a7c4-871e37492ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:05.168742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4ea34-0d98-427c-a7c4-871e37492ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:05.169027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4ea34-0d98-427c-a7c4-871e37492ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:05.179198 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4ea34-0d98-427c-a7c4-871e37492ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:05.180670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4ea34-0d98-427c-a7c4-871e37492ac6 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:05.190208 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1192/2436] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:10:05.649953 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db0327-b3dc-4efb-8a44-5b57167693f6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:05.652571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-98db0327-b3dc-4efb-8a44-5b57167693f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:05.666710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db0327-b3dc-4efb-8a44-5b57167693f6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:05.672452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f55fa-437a-48c7-9fb8-c57e375427ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:05.673390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f55fa-437a-48c7-9fb8-c57e375427ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:05.673769 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f55fa-437a-48c7-9fb8-c57e375427ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:05.674055 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f55fa-437a-48c7-9fb8-c57e375427ef admin admin] PATH_INFO: `/v3/projects/769df0553ff34e2a8c9c45a801463071` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:05.675240 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f55fa-437a-48c7-9fb8-c57e375427ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=769df0553ff34e2a8c9c45a801463071)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:05.677233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f55fa-437a-48c7-9fb8-c57e375427ef admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:05.797169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-515f55fa-437a-48c7-9fb8-c57e375427ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769df0553ff34e2a8c9c45a801463071', 'request_id': 'req-515f55fa-437a-48c7-9fb8-c57e375427ef'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:05.902485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-515f55fa-437a-48c7-9fb8-c57e375427ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769df0553ff34e2a8c9c45a801463071', 'request_id': 'req-515f55fa-437a-48c7-9fb8-c57e375427ef'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:05.909225 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-515f55fa-437a-48c7-9fb8-c57e375427ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769df0553ff34e2a8c9c45a801463071', 'request_id': 'req-515f55fa-437a-48c7-9fb8-c57e375427ef'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:05.919414 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-515f55fa-437a-48c7-9fb8-c57e375427ef admin admin] The token cache is being invalidate because project 769df0553ff34e2a8c9c45a801463071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:10:05.919703 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-515f55fa-437a-48c7-9fb8-c57e375427ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:05.920352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-515f55fa-437a-48c7-9fb8-c57e375427ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:05.921915 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1245/2437] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:10:05 2022] DELETE /identity/v3/projects/769df0553ff34e2a8c9c45a801463071 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:05.926847 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0aa4e3-7c27-4980-8487-1e51998de523 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:05.927318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0aa4e3-7c27-4980-8487-1e51998de523 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:05.927436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0aa4e3-7c27-4980-8487-1e51998de523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:05.945301 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5d0aa4e3-7c27-4980-8487-1e51998de523 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:05.946510 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5d0aa4e3-7c27-4980-8487-1e51998de523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:05.963597 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:06.005022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1193/2438] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:06.012753 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5740d31-cb2a-4160-ba3d-0fa952c1d4b7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:06.013865 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5740d31-cb2a-4160-ba3d-0fa952c1d4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:06.014157 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5740d31-cb2a-4160-ba3d-0fa952c1d4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:06.035654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e5740d31-cb2a-4160-ba3d-0fa952c1d4b7 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:06.039320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e5740d31-cb2a-4160-ba3d-0fa952c1d4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:06.045445 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1246/2439] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:06.049620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0aa4e3-7c27-4980-8487-1e51998de523 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:06.059698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0aa4e3-7c27-4980-8487-1e51998de523 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:06.064878 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b52d2-693e-4191-8a6c-86aed864d545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:06.073908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b52d2-693e-4191-8a6c-86aed864d545 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:06.073908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b52d2-693e-4191-8a6c-86aed864d545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:06.073908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b52d2-693e-4191-8a6c-86aed864d545 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:06.073908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b52d2-693e-4191-8a6c-86aed864d545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:10:06.073908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b52d2-693e-4191-8a6c-86aed864d545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:06.073908 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b52d2-693e-4191-8a6c-86aed864d545 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:06.080558 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1194/2440] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:10:06.084797 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5740d31-cb2a-4160-ba3d-0fa952c1d4b7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:06.094016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5740d31-cb2a-4160-ba3d-0fa952c1d4b7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:06.098732 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c11161-1b0f-4aac-bba1-544bbd9d6123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:06.102446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c11161-1b0f-4aac-bba1-544bbd9d6123 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:06.102446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c11161-1b0f-4aac-bba1-544bbd9d6123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:06.102446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c11161-1b0f-4aac-bba1-544bbd9d6123 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:06.102446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c11161-1b0f-4aac-bba1-544bbd9d6123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:06.102861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c11161-1b0f-4aac-bba1-544bbd9d6123 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:06.250390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1247/2441] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:10:06 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:10:06.254680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b52d2-693e-4191-8a6c-86aed864d545 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:06.264932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b52d2-693e-4191-8a6c-86aed864d545 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:06.320820 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727896e2-0cc0-4816-8005-fa779eb1c1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:06.321489 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727896e2-0cc0-4816-8005-fa779eb1c1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:06.321787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727896e2-0cc0-4816-8005-fa779eb1c1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:06.322061 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727896e2-0cc0-4816-8005-fa779eb1c1a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:06.322753 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727896e2-0cc0-4816-8005-fa779eb1c1a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:06.324716 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727896e2-0cc0-4816-8005-fa779eb1c1a4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:06.434158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1195/2442] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:10:06 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:10:06.438348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c11161-1b0f-4aac-bba1-544bbd9d6123 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:06.448519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c11161-1b0f-4aac-bba1-544bbd9d6123 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:06.453064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ae3fc-0e1a-47b5-b978-bf26044b2498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:06.453719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ae3fc-0e1a-47b5-b978-bf26044b2498 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:06.454005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ae3fc-0e1a-47b5-b978-bf26044b2498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:06.454287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ae3fc-0e1a-47b5-b978-bf26044b2498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:06.455005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ae3fc-0e1a-47b5-b978-bf26044b2498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:06.456644 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ae3fc-0e1a-47b5-b978-bf26044b2498 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:06.468465 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1248/2443] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:06.474411 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727896e2-0cc0-4816-8005-fa779eb1c1a4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:06.486692 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727896e2-0cc0-4816-8005-fa779eb1c1a4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:06.491448 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a480be3-248c-47b1-9592-3b49926d5d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:06.492243 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a480be3-248c-47b1-9592-3b49926d5d70 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:06.492598 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a480be3-248c-47b1-9592-3b49926d5d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:06.492943 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a480be3-248c-47b1-9592-3b49926d5d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:06.493732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a480be3-248c-47b1-9592-3b49926d5d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:06.495395 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a480be3-248c-47b1-9592-3b49926d5d70 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:06.505932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1196/2444] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:06.510096 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ae3fc-0e1a-47b5-b978-bf26044b2498 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:06.520329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ae3fc-0e1a-47b5-b978-bf26044b2498 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:06.525279 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbec7cb-d138-49fb-bd3f-8ab697c557bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:06.526315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbec7cb-d138-49fb-bd3f-8ab697c557bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:06.526607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbec7cb-d138-49fb-bd3f-8ab697c557bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:06.526971 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbec7cb-d138-49fb-bd3f-8ab697c557bd admin admin] PATH_INFO: `/v3/projects/d8a529b2d7e0459484fad3c078ea1e02/users/e55a3cb62b094932bc7e3811d5da78f2/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:06.542164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbec7cb-d138-49fb-bd3f-8ab697c557bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a529b2d7e0459484fad3c078ea1e02, user_id=e55a3cb62b094932bc7e3811d5da78f2, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:06.545461 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbec7cb-d138-49fb-bd3f-8ab697c557bd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:06.687480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1249/2445] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:10:06 2022] PUT /identity/v3/projects/d8a529b2d7e0459484fad3c078ea1e02/users/e55a3cb62b094932bc7e3811d5da78f2/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:06.690813 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1a471-7659-4d67-94a6-7006123d7257 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:06.691132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1a471-7659-4d67-94a6-7006123d7257 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:06.691415 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1a471-7659-4d67-94a6-7006123d7257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:06.709526 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b0d1a471-7659-4d67-94a6-7006123d7257 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:06.710859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b0d1a471-7659-4d67-94a6-7006123d7257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:06.773462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1197/2446] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:06.784361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbec7cb-d138-49fb-bd3f-8ab697c557bd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:06.786206 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1fbec7cb-d138-49fb-bd3f-8ab697c557bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:06.813054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:06.853096 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbec7cb-d138-49fb-bd3f-8ab697c557bd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:06.857608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a78b2-e27f-41d7-9c7a-bdbfd38be0b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:06.858287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a78b2-e27f-41d7-9c7a-bdbfd38be0b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:06.858572 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a78b2-e27f-41d7-9c7a-bdbfd38be0b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:06.858850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a78b2-e27f-41d7-9c7a-bdbfd38be0b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:06.868964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a78b2-e27f-41d7-9c7a-bdbfd38be0b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:06.870584 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a78b2-e27f-41d7-9c7a-bdbfd38be0b5 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:06.881565 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1250/2447] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:10:10.810714 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1a471-7659-4d67-94a6-7006123d7257 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:10.821405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1a471-7659-4d67-94a6-7006123d7257 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:10.825196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581736f-9529-4ab4-8cb5-681ed01099fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:10.825885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581736f-9529-4ab4-8cb5-681ed01099fc service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:10.826174 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581736f-9529-4ab4-8cb5-681ed01099fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:10.826456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581736f-9529-4ab4-8cb5-681ed01099fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:10.828450 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4581736f-9529-4ab4-8cb5-681ed01099fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:10.859535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:10.898144 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581736f-9529-4ab4-8cb5-681ed01099fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:10.899697 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581736f-9529-4ab4-8cb5-681ed01099fc service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:10.911474 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1198/2448] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:10:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:10:13.177201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9682b91-967a-4ca8-8c36-8f4c0d4bc6ef None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:13.177670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9682b91-967a-4ca8-8c36-8f4c0d4bc6ef None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:13.177972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9682b91-967a-4ca8-8c36-8f4c0d4bc6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:13.219120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b9682b91-967a-4ca8-8c36-8f4c0d4bc6ef None None] MFA Rules not processed for user `e55a3cb62b094932bc7e3811d5da78f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:13.220418 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b9682b91-967a-4ca8-8c36-8f4c0d4bc6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:13.295172 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1251/2449] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:13.299542 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581736f-9529-4ab4-8cb5-681ed01099fc service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:13.313416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581736f-9529-4ab4-8cb5-681ed01099fc service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:13.322492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d4f5e-00a3-4a02-b993-fd92b7caa369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:13.323178 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d4f5e-00a3-4a02-b993-fd92b7caa369 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:13.323472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d4f5e-00a3-4a02-b993-fd92b7caa369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:13.323757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d4f5e-00a3-4a02-b993-fd92b7caa369 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:13.324516 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d4f5e-00a3-4a02-b993-fd92b7caa369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:13.327037 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d4f5e-00a3-4a02-b993-fd92b7caa369 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:13.438731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1199/2450] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:10:13 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:10:13.439970 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9682b91-967a-4ca8-8c36-8f4c0d4bc6ef None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:13.452060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9682b91-967a-4ca8-8c36-8f4c0d4bc6ef None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:13.522689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73958bc6-76b5-4b79-9b07-b5780d6f80a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:13.523370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73958bc6-76b5-4b79-9b07-b5780d6f80a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:13.523652 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73958bc6-76b5-4b79-9b07-b5780d6f80a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:13.523928 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73958bc6-76b5-4b79-9b07-b5780d6f80a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:13.524802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73958bc6-76b5-4b79-9b07-b5780d6f80a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:13.526806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73958bc6-76b5-4b79-9b07-b5780d6f80a0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:13.637985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1252/2451] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:10:13 2022] POST /identity/v3/users => generated 299 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:10:13.643357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d4f5e-00a3-4a02-b993-fd92b7caa369 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:13.654053 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d4f5e-00a3-4a02-b993-fd92b7caa369 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:13.659009 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638cd6f-dc3b-4970-8f7c-1e283dade068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:13.659759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638cd6f-dc3b-4970-8f7c-1e283dade068 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:13.660127 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638cd6f-dc3b-4970-8f7c-1e283dade068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:13.660493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638cd6f-dc3b-4970-8f7c-1e283dade068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:13.661310 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638cd6f-dc3b-4970-8f7c-1e283dade068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:13.662933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8638cd6f-dc3b-4970-8f7c-1e283dade068 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:13.681065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73958bc6-76b5-4b79-9b07-b5780d6f80a0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:13.681757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1200/2452] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:13.693317 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73958bc6-76b5-4b79-9b07-b5780d6f80a0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:13.699207 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346730e-d589-4447-a173-d5f96cacf846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:13.700171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346730e-d589-4447-a173-d5f96cacf846 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:13.700882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346730e-d589-4447-a173-d5f96cacf846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:13.700882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346730e-d589-4447-a173-d5f96cacf846 admin admin] PATH_INFO: `/v3/projects/03d3b3b5d87e440aafce921848ea84c9/users/6a2feae5771546f19a5106a5d31c367c/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:13.716827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346730e-d589-4447-a173-d5f96cacf846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d3b3b5d87e440aafce921848ea84c9, user_id=6a2feae5771546f19a5106a5d31c367c, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:13.719633 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346730e-d589-4447-a173-d5f96cacf846 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:13.833344 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1253/2453] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:10:13 2022] PUT /identity/v3/projects/03d3b3b5d87e440aafce921848ea84c9/users/6a2feae5771546f19a5106a5d31c367c/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:13.835199 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638cd6f-dc3b-4970-8f7c-1e283dade068 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:13.846515 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638cd6f-dc3b-4970-8f7c-1e283dade068 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:13.931975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011fa6a-5520-494e-af51-bd8c520f2297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:13.932736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011fa6a-5520-494e-af51-bd8c520f2297 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:13.933025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011fa6a-5520-494e-af51-bd8c520f2297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:13.933372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011fa6a-5520-494e-af51-bd8c520f2297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:13.934132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011fa6a-5520-494e-af51-bd8c520f2297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:13.936620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011fa6a-5520-494e-af51-bd8c520f2297 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:13.950893 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1201/2454] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:13.954826 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346730e-d589-4447-a173-d5f96cacf846 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:13.966082 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346730e-d589-4447-a173-d5f96cacf846 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:13.974176 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef70ea-757d-41d4-bb95-c74a1c9f0d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:13.975343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef70ea-757d-41d4-bb95-c74a1c9f0d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:13.975479 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef70ea-757d-41d4-bb95-c74a1c9f0d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:13.976044 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef70ea-757d-41d4-bb95-c74a1c9f0d3f admin admin] PATH_INFO: `/v3/projects/03d3b3b5d87e440aafce921848ea84c9/users/6a2feae5771546f19a5106a5d31c367c/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:13.978383 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef70ea-757d-41d4-bb95-c74a1c9f0d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d3b3b5d87e440aafce921848ea84c9, user_id=6a2feae5771546f19a5106a5d31c367c, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:13.981456 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef70ea-757d-41d4-bb95-c74a1c9f0d3f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:13.994671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1254/2455] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:10:13 2022] PUT /identity/v3/projects/03d3b3b5d87e440aafce921848ea84c9/users/6a2feae5771546f19a5106a5d31c367c/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:20.788704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a3b13-f27e-44aa-bb2f-8872f70b7e52 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:20.797008 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a3b13-f27e-44aa-bb2f-8872f70b7e52 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:20.797008 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a3b13-f27e-44aa-bb2f-8872f70b7e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:20.823280 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7f8a3b13-f27e-44aa-bb2f-8872f70b7e52 None None] MFA Rules not processed for user `6a2feae5771546f19a5106a5d31c367c`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:20.824584 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7f8a3b13-f27e-44aa-bb2f-8872f70b7e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:20.935344 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1202/2456] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:20.948353 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef70ea-757d-41d4-bb95-c74a1c9f0d3f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:20.950289 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-32ef70ea-757d-41d4-bb95-c74a1c9f0d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:20.957213 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:21.041307 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef70ea-757d-41d4-bb95-c74a1c9f0d3f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:21.045771 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224af374-d88e-4f44-96bb-309d868868ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5157588644972a6a4554b3a9f1d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:21.050134 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224af374-d88e-4f44-96bb-309d868868ab service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:21.050134 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224af374-d88e-4f44-96bb-309d868868ab service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:21.050134 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224af374-d88e-4f44-96bb-309d868868ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:21.146775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224af374-d88e-4f44-96bb-309d868868ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:21.148292 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224af374-d88e-4f44-96bb-309d868868ab service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:21.160946 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1255/2457] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:10:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:10:21.538756 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf691f-5036-4b3d-8851-3745b0e1de30 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:21.539072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf691f-5036-4b3d-8851-3745b0e1de30 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:21.540174 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf691f-5036-4b3d-8851-3745b0e1de30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:21.560627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-aedf691f-5036-4b3d-8851-3745b0e1de30 None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:21.562163 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-aedf691f-5036-4b3d-8851-3745b0e1de30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:21.568500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:21.631351 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1203/2458] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Jun 2 16:10:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:21.864630 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224af374-d88e-4f44-96bb-309d868868ab service glance] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:21.864630 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-224af374-d88e-4f44-96bb-309d868868ab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:21.966220 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224af374-d88e-4f44-96bb-309d868868ab service glance] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:21.972377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124ee3b-87ed-41f3-8000-ecdb158dd742 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:21.973125 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124ee3b-87ed-41f3-8000-ecdb158dd742 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:21.973683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124ee3b-87ed-41f3-8000-ecdb158dd742 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:21.973852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124ee3b-87ed-41f3-8000-ecdb158dd742 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:21.983189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124ee3b-87ed-41f3-8000-ecdb158dd742 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:21.984837 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124ee3b-87ed-41f3-8000-ecdb158dd742 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:21.993352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1256/2459] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 16:10:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:10:31.979510 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=20 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:31.989914 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=78 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:33.711107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6d2b2-2963-4dfb-9ac9-c1ff151da752 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:33.717058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6d2b2-2963-4dfb-9ac9-c1ff151da752 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:33.717058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6d2b2-2963-4dfb-9ac9-c1ff151da752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:33.729183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8ef6d2b2-2963-4dfb-9ac9-c1ff151da752 None None] MFA Rules not processed for user `e55a3cb62b094932bc7e3811d5da78f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:33.730882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8ef6d2b2-2963-4dfb-9ac9-c1ff151da752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:33.737883 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1204/2460] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:37.854525 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7b021-73d4-413e-9373-ca563c36e09d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:37.855023 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7b021-73d4-413e-9373-ca563c36e09d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:37.855110 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7b021-73d4-413e-9373-ca563c36e09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:37.876779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b7d7b021-73d4-413e-9373-ca563c36e09d None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:37.878495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b7d7b021-73d4-413e-9373-ca563c36e09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:37.907138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1257/2461] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Jun 2 16:10:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:37.921494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6d2b2-2963-4dfb-9ac9-c1ff151da752 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:37.935612 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6d2b2-2963-4dfb-9ac9-c1ff151da752 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:37.942509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a517e1-670e-4688-8a6a-d2595392542f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:37.943240 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a517e1-670e-4688-8a6a-d2595392542f service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:37.943758 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a517e1-670e-4688-8a6a-d2595392542f service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:37.944135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a517e1-670e-4688-8a6a-d2595392542f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:37.953815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a517e1-670e-4688-8a6a-d2595392542f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:37.955515 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a517e1-670e-4688-8a6a-d2595392542f service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:37.964564 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1205/2462] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 16:10:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 16:10:38.566403 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022286c1-46d4-4e73-9d47-819f1865e9d6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:38.566836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022286c1-46d4-4e73-9d47-819f1865e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:38.567221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022286c1-46d4-4e73-9d47-819f1865e9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:38.597110 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-022286c1-46d4-4e73-9d47-819f1865e9d6 None None] MFA Rules not processed for user `fb70aacb7cfb41cea6a65a084e705ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:38.603168 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-022286c1-46d4-4e73-9d47-819f1865e9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:38.724835 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1258/2463] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:43.611967 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a517e1-670e-4688-8a6a-d2595392542f service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:43.613489 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f0a517e1-670e-4688-8a6a-d2595392542f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:43.713897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a517e1-670e-4688-8a6a-d2595392542f service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:43.718502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef25d5-64c5-4d41-8af4-b4ab9e65d98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:43.719373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef25d5-64c5-4d41-8af4-b4ab9e65d98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:43.719714 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef25d5-64c5-4d41-8af4-b4ab9e65d98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:43.720034 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef25d5-64c5-4d41-8af4-b4ab9e65d98e admin admin] PATH_INFO: `/v3/users/2a972defd2a841768633fac694002d32` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:43.721253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef25d5-64c5-4d41-8af4-b4ab9e65d98e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a972defd2a841768633fac694002d32)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:43.723258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef25d5-64c5-4d41-8af4-b4ab9e65d98e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:43.957441 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-65ef25d5-64c5-4d41-8af4-b4ab9e65d98e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a972defd2a841768633fac694002d32'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:43.973084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-65ef25d5-64c5-4d41-8af4-b4ab9e65d98e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a972defd2a841768633fac694002d32'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:43.973854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-65ef25d5-64c5-4d41-8af4-b4ab9e65d98e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a972defd2a841768633fac694002d32'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:43.982534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-65ef25d5-64c5-4d41-8af4-b4ab9e65d98e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a972defd2a841768633fac694002d32'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:43.983232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-65ef25d5-64c5-4d41-8af4-b4ab9e65d98e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a972defd2a841768633fac694002d32'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:44.074328 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1206/2464] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:10:43 2022] DELETE /identity/v3/users/2a972defd2a841768633fac694002d32 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:44.551871 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022286c1-46d4-4e73-9d47-819f1865e9d6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:44.562150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022286c1-46d4-4e73-9d47-819f1865e9d6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:44.634888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3fefb-733f-4470-861d-3fbee841252a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:44.635810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3fefb-733f-4470-861d-3fbee841252a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:44.636118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3fefb-733f-4470-861d-3fbee841252a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:44.636411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3fefb-733f-4470-861d-3fbee841252a admin admin] PATH_INFO: `/v3/projects/3d34b78aa10a465bbdf15d704b57855a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:44.638178 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3fefb-733f-4470-861d-3fbee841252a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d34b78aa10a465bbdf15d704b57855a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:44.640328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3fefb-733f-4470-861d-3fbee841252a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:45.744687 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6cc3fefb-733f-4470-861d-3fbee841252a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d34b78aa10a465bbdf15d704b57855a', 'request_id': 'req-6cc3fefb-733f-4470-861d-3fbee841252a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:45.909147 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6cc3fefb-733f-4470-861d-3fbee841252a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d34b78aa10a465bbdf15d704b57855a', 'request_id': 'req-6cc3fefb-733f-4470-861d-3fbee841252a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:45.929154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6cc3fefb-733f-4470-861d-3fbee841252a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d34b78aa10a465bbdf15d704b57855a', 'request_id': 'req-6cc3fefb-733f-4470-861d-3fbee841252a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:45.951025 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6cc3fefb-733f-4470-861d-3fbee841252a admin admin] The token cache is being invalidate because project 3d34b78aa10a465bbdf15d704b57855a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:10:45.951911 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6cc3fefb-733f-4470-861d-3fbee841252a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:45.954463 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6cc3fefb-733f-4470-861d-3fbee841252a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:45.957446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1259/2465] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:10:44 2022] DELETE /identity/v3/projects/3d34b78aa10a465bbdf15d704b57855a => generated 0 bytes in 1408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:45.962554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112e29a-9825-4e55-b271-8fc7fe0d138c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:45.963102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112e29a-9825-4e55-b271-8fc7fe0d138c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:45.963102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112e29a-9825-4e55-b271-8fc7fe0d138c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:45.983086 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e112e29a-9825-4e55-b271-8fc7fe0d138c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:45.984491 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e112e29a-9825-4e55-b271-8fc7fe0d138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:46.064705 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:46.089699 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1207/2466] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:46.092595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6812a-ca33-433f-a63c-b276dd5571c0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:46.093350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6812a-ca33-433f-a63c-b276dd5571c0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:46.094181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6812a-ca33-433f-a63c-b276dd5571c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:46.134568 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8dc6812a-ca33-433f-a63c-b276dd5571c0 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:46.136137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8dc6812a-ca33-433f-a63c-b276dd5571c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:46.151009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1260/2467] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:46.152804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112e29a-9825-4e55-b271-8fc7fe0d138c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:46.164650 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112e29a-9825-4e55-b271-8fc7fe0d138c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:46.170611 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caf094-a3cd-4578-817c-739ec42193a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:46.171342 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caf094-a3cd-4578-817c-739ec42193a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:46.171655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caf094-a3cd-4578-817c-739ec42193a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:46.171943 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caf094-a3cd-4578-817c-739ec42193a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:46.173429 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0caf094-a3cd-4578-817c-739ec42193a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:10:46.173429 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0caf094-a3cd-4578-817c-739ec42193a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:46.174950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0caf094-a3cd-4578-817c-739ec42193a0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:46.202827 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1208/2468] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:10:46.208348 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6812a-ca33-433f-a63c-b276dd5571c0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:46.220958 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6812a-ca33-433f-a63c-b276dd5571c0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:46.226067 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e4933-088a-4d38-ba4d-054dfd56a1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:46.226885 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e4933-088a-4d38-ba4d-054dfd56a1ec admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:46.227198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e4933-088a-4d38-ba4d-054dfd56a1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:46.227459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e4933-088a-4d38-ba4d-054dfd56a1ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:46.228194 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e4933-088a-4d38-ba4d-054dfd56a1ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:46.230519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e4933-088a-4d38-ba4d-054dfd56a1ec admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:46.354989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:46.362173 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1261/2469] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:10:46 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:10:46.369799 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caf094-a3cd-4578-817c-739ec42193a0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:46.393725 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caf094-a3cd-4578-817c-739ec42193a0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:46.479062 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc1817-7325-4991-a114-d46b4407a2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:46.480005 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc1817-7325-4991-a114-d46b4407a2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:46.480343 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc1817-7325-4991-a114-d46b4407a2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:46.480698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc1817-7325-4991-a114-d46b4407a2b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:46.481617 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc1817-7325-4991-a114-d46b4407a2b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:46.483631 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc1817-7325-4991-a114-d46b4407a2b0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:46.857526 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1209/2470] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:10:46 2022] POST /identity/v3/users => generated 290 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:10:46.863371 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e4933-088a-4d38-ba4d-054dfd56a1ec admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:46.894722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e4933-088a-4d38-ba4d-054dfd56a1ec admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:46.902942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dede0-e47f-44cb-82b4-4fa75e0299db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:46.903659 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dede0-e47f-44cb-82b4-4fa75e0299db admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:46.903943 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dede0-e47f-44cb-82b4-4fa75e0299db admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:46.904249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dede0-e47f-44cb-82b4-4fa75e0299db admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:46.905008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dede0-e47f-44cb-82b4-4fa75e0299db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:46.906626 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dede0-e47f-44cb-82b4-4fa75e0299db admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:46.922696 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc1817-7325-4991-a114-d46b4407a2b0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:46.929491 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1262/2471] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:46.936782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc1817-7325-4991-a114-d46b4407a2b0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:46.939181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71d24d-2135-4ede-b317-eb0dd66c16d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:46.940025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71d24d-2135-4ede-b317-eb0dd66c16d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:46.940374 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71d24d-2135-4ede-b317-eb0dd66c16d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:46.940726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71d24d-2135-4ede-b317-eb0dd66c16d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:46.941520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71d24d-2135-4ede-b317-eb0dd66c16d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:46.943218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71d24d-2135-4ede-b317-eb0dd66c16d2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:46.957300 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1210/2472] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:46.961818 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dede0-e47f-44cb-82b4-4fa75e0299db admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:46.975614 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dede0-e47f-44cb-82b4-4fa75e0299db admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:46.980622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225954b9-9617-41f1-ba51-6b9ae898dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:46.982107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225954b9-9617-41f1-ba51-6b9ae898dd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:46.982395 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225954b9-9617-41f1-ba51-6b9ae898dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:46.982874 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225954b9-9617-41f1-ba51-6b9ae898dd3d admin admin] PATH_INFO: `/v3/projects/9e36141f7ff54ad18e68b177df177980/users/0155f0efc36f49fe9d7e84bbbe0c23bd/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:47.014725 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225954b9-9617-41f1-ba51-6b9ae898dd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e36141f7ff54ad18e68b177df177980, user_id=0155f0efc36f49fe9d7e84bbbe0c23bd, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:47.020817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225954b9-9617-41f1-ba51-6b9ae898dd3d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:47.137138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1263/2473] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:10:46 2022] PUT /identity/v3/projects/9e36141f7ff54ad18e68b177df177980/users/0155f0efc36f49fe9d7e84bbbe0c23bd/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:10:47.148520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35659c-951e-40c1-920f-46bbdd964ded None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:47.149047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35659c-951e-40c1-920f-46bbdd964ded None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:47.149184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35659c-951e-40c1-920f-46bbdd964ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:47.179256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0e35659c-951e-40c1-920f-46bbdd964ded None None] MFA Rules not processed for user `0155f0efc36f49fe9d7e84bbbe0c23bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:47.180504 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0e35659c-951e-40c1-920f-46bbdd964ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:47.254825 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1211/2474] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:47.259125 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225954b9-9617-41f1-ba51-6b9ae898dd3d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:47.331585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225954b9-9617-41f1-ba51-6b9ae898dd3d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:47.336916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfef2f-502a-48b4-a0c8-9464962d38ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:47.337665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfef2f-502a-48b4-a0c8-9464962d38ab admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:47.338055 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfef2f-502a-48b4-a0c8-9464962d38ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:47.338407 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfef2f-502a-48b4-a0c8-9464962d38ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:47.339209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfef2f-502a-48b4-a0c8-9464962d38ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:47.341737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfef2f-502a-48b4-a0c8-9464962d38ab admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:47.486292 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1264/2475] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:10:47 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:10:47.490283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35659c-951e-40c1-920f-46bbdd964ded None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:47.500722 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35659c-951e-40c1-920f-46bbdd964ded None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:47.562076 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38761928-5f1e-4ec1-8d3c-b4ca5c1165bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:47.562763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38761928-5f1e-4ec1-8d3c-b4ca5c1165bf admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:47.563048 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38761928-5f1e-4ec1-8d3c-b4ca5c1165bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:47.563334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38761928-5f1e-4ec1-8d3c-b4ca5c1165bf admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:47.564083 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38761928-5f1e-4ec1-8d3c-b4ca5c1165bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:47.566072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38761928-5f1e-4ec1-8d3c-b4ca5c1165bf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:47.670579 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1212/2476] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:10:47 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:10:47.672152 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfef2f-502a-48b4-a0c8-9464962d38ab admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:47.682675 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfef2f-502a-48b4-a0c8-9464962d38ab admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:47.687495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabff483-9ac8-49f7-8f93-77d357e23719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:47.688302 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabff483-9ac8-49f7-8f93-77d357e23719 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:47.688601 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabff483-9ac8-49f7-8f93-77d357e23719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:47.688889 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabff483-9ac8-49f7-8f93-77d357e23719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:47.689613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabff483-9ac8-49f7-8f93-77d357e23719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:47.691211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabff483-9ac8-49f7-8f93-77d357e23719 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:47.704855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1265/2477] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:47.712522 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38761928-5f1e-4ec1-8d3c-b4ca5c1165bf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:47.725376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38761928-5f1e-4ec1-8d3c-b4ca5c1165bf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:47.731448 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaa83c-8f9a-48b5-be1b-bdfb1c343ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:47.733676 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:47.738934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaa83c-8f9a-48b5-be1b-bdfb1c343ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:47.738934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaa83c-8f9a-48b5-be1b-bdfb1c343ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:47.738934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaa83c-8f9a-48b5-be1b-bdfb1c343ffe admin admin] PATH_INFO: `/v3/projects/5732b7a7aa7048f9bb4d4582bad5db33/users/de78f6fa6b8f42ecb4c8707fb4431aea/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:47.750100 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aaa83c-8f9a-48b5-be1b-bdfb1c343ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5732b7a7aa7048f9bb4d4582bad5db33, user_id=de78f6fa6b8f42ecb4c8707fb4431aea, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:47.752836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aaa83c-8f9a-48b5-be1b-bdfb1c343ffe admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:47.855927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1213/2478] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:10:47 2022] PUT /identity/v3/projects/5732b7a7aa7048f9bb4d4582bad5db33/users/de78f6fa6b8f42ecb4c8707fb4431aea/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:47.859895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabff483-9ac8-49f7-8f93-77d357e23719 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:47.869706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabff483-9ac8-49f7-8f93-77d357e23719 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:47.925180 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5ca6c-b2ac-4a72-871d-dee520dddc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:47.925859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5ca6c-b2ac-4a72-871d-dee520dddc83 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:47.926147 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5ca6c-b2ac-4a72-871d-dee520dddc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:47.926554 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5ca6c-b2ac-4a72-871d-dee520dddc83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:47.927285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5ca6c-b2ac-4a72-871d-dee520dddc83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:47.929028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5ca6c-b2ac-4a72-871d-dee520dddc83 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:47.939427 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1266/2479] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:47.943567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaa83c-8f9a-48b5-be1b-bdfb1c343ffe admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:47.954781 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaa83c-8f9a-48b5-be1b-bdfb1c343ffe admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:47.959718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeeec77-06f2-4c60-90ba-c3c8152a953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:47.960724 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeeec77-06f2-4c60-90ba-c3c8152a953b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:47.961008 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeeec77-06f2-4c60-90ba-c3c8152a953b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:47.961283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeeec77-06f2-4c60-90ba-c3c8152a953b admin admin] PATH_INFO: `/v3/projects/5732b7a7aa7048f9bb4d4582bad5db33/users/de78f6fa6b8f42ecb4c8707fb4431aea/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:47.963240 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeeec77-06f2-4c60-90ba-c3c8152a953b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5732b7a7aa7048f9bb4d4582bad5db33, user_id=de78f6fa6b8f42ecb4c8707fb4431aea, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:47.966587 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeeec77-06f2-4c60-90ba-c3c8152a953b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:47.977495 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1214/2480] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:10:47 2022] PUT /identity/v3/projects/5732b7a7aa7048f9bb4d4582bad5db33/users/de78f6fa6b8f42ecb4c8707fb4431aea/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:10:47.987432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828efb-b9e8-46fb-a080-9ab1b511ecfa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:47.987813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828efb-b9e8-46fb-a080-9ab1b511ecfa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:47.988211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0828efb-b9e8-46fb-a080-9ab1b511ecfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:48.016459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f0828efb-b9e8-46fb-a080-9ab1b511ecfa None None] MFA Rules not processed for user `de78f6fa6b8f42ecb4c8707fb4431aea`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:48.017794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f0828efb-b9e8-46fb-a080-9ab1b511ecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:48.042520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:48.097523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1267/2481] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:48.113823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeeec77-06f2-4c60-90ba-c3c8152a953b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:48.115629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bdeeec77-06f2-4c60-90ba-c3c8152a953b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:48.174303 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeeec77-06f2-4c60-90ba-c3c8152a953b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:48.178167 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16661b-7772-486d-b23e-28e5a0270d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:48.178800 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16661b-7772-486d-b23e-28e5a0270d2d service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:48.179087 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16661b-7772-486d-b23e-28e5a0270d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:48.179366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16661b-7772-486d-b23e-28e5a0270d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:48.234815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16661b-7772-486d-b23e-28e5a0270d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:48.236327 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16661b-7772-486d-b23e-28e5a0270d2d service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:48.245131 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1215/2482] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:10:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:10:50.021260 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828efb-b9e8-46fb-a080-9ab1b511ecfa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:50.022656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f0828efb-b9e8-46fb-a080-9ab1b511ecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:50.034299 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0828efb-b9e8-46fb-a080-9ab1b511ecfa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:50.037945 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2eb3e-2273-4e96-b55a-ec00cea7266f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:50.038586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2eb3e-2273-4e96-b55a-ec00cea7266f service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:50.038865 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2eb3e-2273-4e96-b55a-ec00cea7266f service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:50.039138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2eb3e-2273-4e96-b55a-ec00cea7266f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:50.048656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2eb3e-2273-4e96-b55a-ec00cea7266f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:50.050084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2eb3e-2273-4e96-b55a-ec00cea7266f service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:50.060257 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1268/2483] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:10:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:10:54.487271 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16661b-7772-486d-b23e-28e5a0270d2d service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:54.549919 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16661b-7772-486d-b23e-28e5a0270d2d service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:54.554308 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e5d73-c097-46e1-a938-9029b4b3de58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:54.555176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e5d73-c097-46e1-a938-9029b4b3de58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:54.555446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e5d73-c097-46e1-a938-9029b4b3de58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:54.555726 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e5d73-c097-46e1-a938-9029b4b3de58 admin admin] PATH_INFO: `/v3/users/0155f0efc36f49fe9d7e84bbbe0c23bd` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:54.556928 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e5d73-c097-46e1-a938-9029b4b3de58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0155f0efc36f49fe9d7e84bbbe0c23bd)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:54.558838 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e5d73-c097-46e1-a938-9029b4b3de58 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:54.561145 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:54.749893 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-760e5d73-c097-46e1-a938-9029b4b3de58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0155f0efc36f49fe9d7e84bbbe0c23bd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:54.768457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-760e5d73-c097-46e1-a938-9029b4b3de58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0155f0efc36f49fe9d7e84bbbe0c23bd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:54.769228 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-760e5d73-c097-46e1-a938-9029b4b3de58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0155f0efc36f49fe9d7e84bbbe0c23bd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:54.779272 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-760e5d73-c097-46e1-a938-9029b4b3de58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0155f0efc36f49fe9d7e84bbbe0c23bd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:54.780045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-760e5d73-c097-46e1-a938-9029b4b3de58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0155f0efc36f49fe9d7e84bbbe0c23bd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:54.864638 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1216/2484] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:10:54 2022] DELETE /identity/v3/users/0155f0efc36f49fe9d7e84bbbe0c23bd => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:54.869552 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b922f9-74e4-4d0b-921c-21a74f3811fd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:54.870054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b922f9-74e4-4d0b-921c-21a74f3811fd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:54.870181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b922f9-74e4-4d0b-921c-21a74f3811fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:54.889895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-04b922f9-74e4-4d0b-921c-21a74f3811fd None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:54.891183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-04b922f9-74e4-4d0b-921c-21a74f3811fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:54.958208 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1269/2485] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:54.968172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e5d73-c097-46e1-a938-9029b4b3de58 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:54.969742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-760e5d73-c097-46e1-a938-9029b4b3de58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:55.031692 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e5d73-c097-46e1-a938-9029b4b3de58 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:55.035520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb525260-7d78-4fdd-afc5-357ea3e6a8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:55.036298 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb525260-7d78-4fdd-afc5-357ea3e6a8ae service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:55.036582 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb525260-7d78-4fdd-afc5-357ea3e6a8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:55.036861 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb525260-7d78-4fdd-afc5-357ea3e6a8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:55.046414 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb525260-7d78-4fdd-afc5-357ea3e6a8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:55.047828 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb525260-7d78-4fdd-afc5-357ea3e6a8ae service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:55.058100 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1217/2486] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:10:55.695061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b922f9-74e4-4d0b-921c-21a74f3811fd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:55.696776 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-04b922f9-74e4-4d0b-921c-21a74f3811fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:55.712470 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b922f9-74e4-4d0b-921c-21a74f3811fd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:55.719893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa10216-d3cb-4999-a06b-eedbf6ad903c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:55.732235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa10216-d3cb-4999-a06b-eedbf6ad903c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:55.732235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa10216-d3cb-4999-a06b-eedbf6ad903c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:55.732235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa10216-d3cb-4999-a06b-eedbf6ad903c admin admin] PATH_INFO: `/v3/projects/9e36141f7ff54ad18e68b177df177980` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:55.732235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa10216-d3cb-4999-a06b-eedbf6ad903c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e36141f7ff54ad18e68b177df177980)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:55.732235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa10216-d3cb-4999-a06b-eedbf6ad903c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:55.856769 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4aa10216-d3cb-4999-a06b-eedbf6ad903c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e36141f7ff54ad18e68b177df177980', 'request_id': 'req-4aa10216-d3cb-4999-a06b-eedbf6ad903c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:55.995735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4aa10216-d3cb-4999-a06b-eedbf6ad903c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e36141f7ff54ad18e68b177df177980', 'request_id': 'req-4aa10216-d3cb-4999-a06b-eedbf6ad903c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:55.997128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4aa10216-d3cb-4999-a06b-eedbf6ad903c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e36141f7ff54ad18e68b177df177980', 'request_id': 'req-4aa10216-d3cb-4999-a06b-eedbf6ad903c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:56.007663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4aa10216-d3cb-4999-a06b-eedbf6ad903c admin admin] The token cache is being invalidate because project 9e36141f7ff54ad18e68b177df177980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:10:56.007953 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4aa10216-d3cb-4999-a06b-eedbf6ad903c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:56.008603 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4aa10216-d3cb-4999-a06b-eedbf6ad903c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:56.010117 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1270/2487] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:10:55 2022] DELETE /identity/v3/projects/9e36141f7ff54ad18e68b177df177980 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:56.014822 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb525260-7d78-4fdd-afc5-357ea3e6a8ae service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:56.024637 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb525260-7d78-4fdd-afc5-357ea3e6a8ae service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:56.081411 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd58a3-0eda-408e-a81b-e2d5af5f3f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:56.082416 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd58a3-0eda-408e-a81b-e2d5af5f3f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:56.082706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd58a3-0eda-408e-a81b-e2d5af5f3f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:56.082998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd58a3-0eda-408e-a81b-e2d5af5f3f5c admin admin] PATH_INFO: `/v3/users/de78f6fa6b8f42ecb4c8707fb4431aea` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:56.084210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd58a3-0eda-408e-a81b-e2d5af5f3f5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=de78f6fa6b8f42ecb4c8707fb4431aea)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:56.086161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd58a3-0eda-408e-a81b-e2d5af5f3f5c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:56.288022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:56.405148 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f2bd58a3-0eda-408e-a81b-e2d5af5f3f5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de78f6fa6b8f42ecb4c8707fb4431aea'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:56.417183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f2bd58a3-0eda-408e-a81b-e2d5af5f3f5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de78f6fa6b8f42ecb4c8707fb4431aea'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:56.417857 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f2bd58a3-0eda-408e-a81b-e2d5af5f3f5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de78f6fa6b8f42ecb4c8707fb4431aea'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:56.425194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f2bd58a3-0eda-408e-a81b-e2d5af5f3f5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de78f6fa6b8f42ecb4c8707fb4431aea'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:56.425817 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f2bd58a3-0eda-408e-a81b-e2d5af5f3f5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de78f6fa6b8f42ecb4c8707fb4431aea'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:56.498457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1218/2488] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:10:56 2022] DELETE /identity/v3/users/de78f6fa6b8f42ecb4c8707fb4431aea => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:56.986001 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa10216-d3cb-4999-a06b-eedbf6ad903c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:56.986001 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4aa10216-d3cb-4999-a06b-eedbf6ad903c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:56.999506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa10216-d3cb-4999-a06b-eedbf6ad903c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:57.047575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:57.082058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8c481-f9e8-4db3-a4e0-41c45cc58be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:57.082991 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8c481-f9e8-4db3-a4e0-41c45cc58be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:57.083282 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8c481-f9e8-4db3-a4e0-41c45cc58be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:57.083563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8c481-f9e8-4db3-a4e0-41c45cc58be2 admin admin] PATH_INFO: `/v3/projects/5732b7a7aa7048f9bb4d4582bad5db33` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:57.085646 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8c481-f9e8-4db3-a4e0-41c45cc58be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5732b7a7aa7048f9bb4d4582bad5db33)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:57.087941 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8c481-f9e8-4db3-a4e0-41c45cc58be2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:57.276246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-45b8c481-f9e8-4db3-a4e0-41c45cc58be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5732b7a7aa7048f9bb4d4582bad5db33', 'request_id': 'req-45b8c481-f9e8-4db3-a4e0-41c45cc58be2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:57.355700 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-45b8c481-f9e8-4db3-a4e0-41c45cc58be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5732b7a7aa7048f9bb4d4582bad5db33', 'request_id': 'req-45b8c481-f9e8-4db3-a4e0-41c45cc58be2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:57.363054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-45b8c481-f9e8-4db3-a4e0-41c45cc58be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5732b7a7aa7048f9bb4d4582bad5db33', 'request_id': 'req-45b8c481-f9e8-4db3-a4e0-41c45cc58be2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:57.374600 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-45b8c481-f9e8-4db3-a4e0-41c45cc58be2 admin admin] The token cache is being invalidate because project 5732b7a7aa7048f9bb4d4582bad5db33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:10:57.374966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-45b8c481-f9e8-4db3-a4e0-41c45cc58be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:57.375689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-45b8c481-f9e8-4db3-a4e0-41c45cc58be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:10:57.377282 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1271/2489] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:10:56 2022] DELETE /identity/v3/projects/5732b7a7aa7048f9bb4d4582bad5db33 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:10:57.382396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd750f83-90af-4598-b2da-2049f4d7dea5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:57.382962 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd750f83-90af-4598-b2da-2049f4d7dea5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:57.382962 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd750f83-90af-4598-b2da-2049f4d7dea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:57.405848 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bd750f83-90af-4598-b2da-2049f4d7dea5 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:57.407155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bd750f83-90af-4598-b2da-2049f4d7dea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:57.467704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1219/2490] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:57.480159 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a12fd5-d6f3-4a38-a518-4bce9ca29949 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:57.480453 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a12fd5-d6f3-4a38-a518-4bce9ca29949 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:57.480737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a12fd5-d6f3-4a38-a518-4bce9ca29949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:57.498518 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f6a12fd5-d6f3-4a38-a518-4bce9ca29949 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:57.499782 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f6a12fd5-d6f3-4a38-a518-4bce9ca29949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:57.507781 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1272/2491] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:57.511860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd750f83-90af-4598-b2da-2049f4d7dea5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:57.522264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd750f83-90af-4598-b2da-2049f4d7dea5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:57.526856 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c152512-95e4-4ef6-bd59-9506658a74a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:57.527486 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c152512-95e4-4ef6-bd59-9506658a74a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:57.527776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c152512-95e4-4ef6-bd59-9506658a74a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:57.528666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c152512-95e4-4ef6-bd59-9506658a74a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:57.529389 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c152512-95e4-4ef6-bd59-9506658a74a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:10:57.529703 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c152512-95e4-4ef6-bd59-9506658a74a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:57.531304 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c152512-95e4-4ef6-bd59-9506658a74a2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:57.542731 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1220/2492] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:10:57.547122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a12fd5-d6f3-4a38-a518-4bce9ca29949 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:57.556423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a12fd5-d6f3-4a38-a518-4bce9ca29949 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:57.561050 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048299f2-bd22-4b16-89a1-159e44a6923a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:57.561696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048299f2-bd22-4b16-89a1-159e44a6923a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:57.561981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048299f2-bd22-4b16-89a1-159e44a6923a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:57.562259 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048299f2-bd22-4b16-89a1-159e44a6923a admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:57.562945 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048299f2-bd22-4b16-89a1-159e44a6923a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:57.564946 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048299f2-bd22-4b16-89a1-159e44a6923a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:57.674049 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1273/2493] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:10:57 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:10:57.678292 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c152512-95e4-4ef6-bd59-9506658a74a2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:57.688907 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c152512-95e4-4ef6-bd59-9506658a74a2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:57.748458 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3c5be-f034-44d0-91ab-f4998948ab52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:57.749136 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3c5be-f034-44d0-91ab-f4998948ab52 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:57.749425 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3c5be-f034-44d0-91ab-f4998948ab52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:57.749704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3c5be-f034-44d0-91ab-f4998948ab52 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:57.750389 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3c5be-f034-44d0-91ab-f4998948ab52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:57.752437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3c5be-f034-44d0-91ab-f4998948ab52 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:57.877453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1221/2494] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:10:57 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:10:57.881541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048299f2-bd22-4b16-89a1-159e44a6923a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:57.899858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048299f2-bd22-4b16-89a1-159e44a6923a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:57.905288 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88175b1e-f4f1-4ef0-89ac-14e872ded49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:57.905749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88175b1e-f4f1-4ef0-89ac-14e872ded49f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:57.906797 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88175b1e-f4f1-4ef0-89ac-14e872ded49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:57.907085 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88175b1e-f4f1-4ef0-89ac-14e872ded49f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:57.907827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88175b1e-f4f1-4ef0-89ac-14e872ded49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:57.909478 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88175b1e-f4f1-4ef0-89ac-14e872ded49f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:57.920986 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1274/2495] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:57.924773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3c5be-f034-44d0-91ab-f4998948ab52 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:57.938025 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3c5be-f034-44d0-91ab-f4998948ab52 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:57.943751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e7d83-9225-4737-b68c-02ec23d698a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:57.944219 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e7d83-9225-4737-b68c-02ec23d698a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:57.944614 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e7d83-9225-4737-b68c-02ec23d698a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:57.944984 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e7d83-9225-4737-b68c-02ec23d698a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:57.945825 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e7d83-9225-4737-b68c-02ec23d698a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:57.948338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e7d83-9225-4737-b68c-02ec23d698a1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:57.963407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1222/2496] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:57.964841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88175b1e-f4f1-4ef0-89ac-14e872ded49f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:57.975290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88175b1e-f4f1-4ef0-89ac-14e872ded49f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:57.980625 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebd030-3194-4766-ba23-1052dd9893ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:57.981544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd030-3194-4766-ba23-1052dd9893ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:57.981831 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd030-3194-4766-ba23-1052dd9893ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:57.982118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebd030-3194-4766-ba23-1052dd9893ec admin admin] PATH_INFO: `/v3/projects/eac45c4a880e4984a0c1a9f45f5a6ca9/users/7fad04cd036d41dd9044b6e8cd7c5c8b/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:57.998279 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebd030-3194-4766-ba23-1052dd9893ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac45c4a880e4984a0c1a9f45f5a6ca9, user_id=7fad04cd036d41dd9044b6e8cd7c5c8b, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:58.001056 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebd030-3194-4766-ba23-1052dd9893ec admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:58.110162 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1275/2497] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:10:57 2022] PUT /identity/v3/projects/eac45c4a880e4984a0c1a9f45f5a6ca9/users/7fad04cd036d41dd9044b6e8cd7c5c8b/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:58.121453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0ba67-c2d6-4b3c-8ba9-6a8a258d0cb7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:58.121750 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0ba67-c2d6-4b3c-8ba9-6a8a258d0cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:58.122038 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c0ba67-c2d6-4b3c-8ba9-6a8a258d0cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:58.140872 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:58.149683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-44c0ba67-c2d6-4b3c-8ba9-6a8a258d0cb7 None None] MFA Rules not processed for user `7fad04cd036d41dd9044b6e8cd7c5c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:58.150922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-44c0ba67-c2d6-4b3c-8ba9-6a8a258d0cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:58.218316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1223/2498] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:10:58.222883 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebd030-3194-4766-ba23-1052dd9893ec admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:58.281543 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:58.286542 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebd030-3194-4766-ba23-1052dd9893ec admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:58.291166 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b4ad9-9368-4863-b50f-23ebb7c0d1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:58.291822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b4ad9-9368-4863-b50f-23ebb7c0d1ac admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:58.292159 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b4ad9-9368-4863-b50f-23ebb7c0d1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:58.292418 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b4ad9-9368-4863-b50f-23ebb7c0d1ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:58.293109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b4ad9-9368-4863-b50f-23ebb7c0d1ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:58.295085 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b4ad9-9368-4863-b50f-23ebb7c0d1ac admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:58.467328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1276/2499] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:10:58 2022] POST /identity/v3/projects => generated 379 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:10:58.467527 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0ba67-c2d6-4b3c-8ba9-6a8a258d0cb7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:58.482427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c0ba67-c2d6-4b3c-8ba9-6a8a258d0cb7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:58.538621 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc89c5-6b64-4d87-bb66-e92235df25d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:58.539294 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc89c5-6b64-4d87-bb66-e92235df25d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:58.540120 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc89c5-6b64-4d87-bb66-e92235df25d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:58.540120 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc89c5-6b64-4d87-bb66-e92235df25d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:58.540560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc89c5-6b64-4d87-bb66-e92235df25d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:58.542488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc89c5-6b64-4d87-bb66-e92235df25d6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:58.655529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1224/2500] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:10:58 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:10:58.659617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b4ad9-9368-4863-b50f-23ebb7c0d1ac admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:58.669836 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b4ad9-9368-4863-b50f-23ebb7c0d1ac admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:58.674446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7da83-edd3-4d15-b30d-16e4aad05010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:58.675099 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7da83-edd3-4d15-b30d-16e4aad05010 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:58.675389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7da83-edd3-4d15-b30d-16e4aad05010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:58.675672 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7da83-edd3-4d15-b30d-16e4aad05010 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:58.676428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7da83-edd3-4d15-b30d-16e4aad05010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:58.678109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7da83-edd3-4d15-b30d-16e4aad05010 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:58.691002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1277/2501] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:58.695133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc89c5-6b64-4d87-bb66-e92235df25d6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:58.705875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc89c5-6b64-4d87-bb66-e92235df25d6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:58.710461 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a565412-3e63-4361-94ba-41e93f2e537b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:58.711940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a565412-3e63-4361-94ba-41e93f2e537b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:58.711940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a565412-3e63-4361-94ba-41e93f2e537b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:58.711940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a565412-3e63-4361-94ba-41e93f2e537b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:58.712405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a565412-3e63-4361-94ba-41e93f2e537b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:58.714010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a565412-3e63-4361-94ba-41e93f2e537b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:58.723959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1225/2502] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:58.727922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7da83-edd3-4d15-b30d-16e4aad05010 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:58.737822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7da83-edd3-4d15-b30d-16e4aad05010 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:58.745431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bd2b6-00a1-4f41-88fe-e10684806cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:58.745431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bd2b6-00a1-4f41-88fe-e10684806cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:58.745431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bd2b6-00a1-4f41-88fe-e10684806cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:58.745431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bd2b6-00a1-4f41-88fe-e10684806cf3 admin admin] PATH_INFO: `/v3/projects/fb9de4d7b7e54c1ebc51d441601768ae/users/8348cbf0804248afb8ab3b8e1d326e73/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:58.759160 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bd2b6-00a1-4f41-88fe-e10684806cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb9de4d7b7e54c1ebc51d441601768ae, user_id=8348cbf0804248afb8ab3b8e1d326e73, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:58.761884 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bd2b6-00a1-4f41-88fe-e10684806cf3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:58.870442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1278/2503] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:10:58 2022] PUT /identity/v3/projects/fb9de4d7b7e54c1ebc51d441601768ae/users/8348cbf0804248afb8ab3b8e1d326e73/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:58.881187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7aed9-b1f8-47f7-b294-48f74dc93e62 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:58.881482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7aed9-b1f8-47f7-b294-48f74dc93e62 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:58.881768 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7aed9-b1f8-47f7-b294-48f74dc93e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:58.911265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-05e7aed9-b1f8-47f7-b294-48f74dc93e62 None None] MFA Rules not processed for user `8348cbf0804248afb8ab3b8e1d326e73`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:58.912538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-05e7aed9-b1f8-47f7-b294-48f74dc93e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:58.977365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1226/2504] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:58.982513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bd2b6-00a1-4f41-88fe-e10684806cf3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:59.055745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bd2b6-00a1-4f41-88fe-e10684806cf3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:59.061886 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3df90-9bb8-48ed-9769-f4421c3ba88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:59.062673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3df90-9bb8-48ed-9769-f4421c3ba88f admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:59.063033 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3df90-9bb8-48ed-9769-f4421c3ba88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:59.063406 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3df90-9bb8-48ed-9769-f4421c3ba88f admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:59.072452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3df90-9bb8-48ed-9769-f4421c3ba88f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:59.074544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3df90-9bb8-48ed-9769-f4421c3ba88f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:59.165050 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1279/2505] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:10:58 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:10:59.170373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7aed9-b1f8-47f7-b294-48f74dc93e62 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:59.182375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7aed9-b1f8-47f7-b294-48f74dc93e62 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:59.186457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:59.260700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a00fc-f8b2-4189-a0ee-30c51d739b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:59.261829 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a00fc-f8b2-4189-a0ee-30c51d739b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:59.263354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a00fc-f8b2-4189-a0ee-30c51d739b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:59.264030 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a00fc-f8b2-4189-a0ee-30c51d739b0a admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:59.264857 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a00fc-f8b2-4189-a0ee-30c51d739b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:59.267132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a00fc-f8b2-4189-a0ee-30c51d739b0a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:59.347346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1227/2506] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:10:59 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:10:59.348884 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3df90-9bb8-48ed-9769-f4421c3ba88f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:59.366385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3df90-9bb8-48ed-9769-f4421c3ba88f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:59.372383 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b5387-03bd-4ead-a690-9919d598fe26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:59.373082 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b5387-03bd-4ead-a690-9919d598fe26 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:59.373364 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b5387-03bd-4ead-a690-9919d598fe26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:59.373639 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b5387-03bd-4ead-a690-9919d598fe26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:59.374358 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b5387-03bd-4ead-a690-9919d598fe26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:59.375963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b5387-03bd-4ead-a690-9919d598fe26 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:59.388673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1280/2507] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:59.393085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a00fc-f8b2-4189-a0ee-30c51d739b0a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:59.404391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a00fc-f8b2-4189-a0ee-30c51d739b0a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:59.409094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9514b13-4685-42bc-bb00-481f6a493814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:59.409985 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9514b13-4685-42bc-bb00-481f6a493814 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:59.410277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9514b13-4685-42bc-bb00-481f6a493814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:59.410559 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9514b13-4685-42bc-bb00-481f6a493814 admin admin] PATH_INFO: `/v3/projects/9042344a77054a398caf6e330b57e102/users/9320f31a20a84fdc833c528d62faad32/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:59.426172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9514b13-4685-42bc-bb00-481f6a493814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9042344a77054a398caf6e330b57e102, user_id=9320f31a20a84fdc833c528d62faad32, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:59.432841 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9514b13-4685-42bc-bb00-481f6a493814 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:59.505580 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1228/2508] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:10:59 2022] PUT /identity/v3/projects/9042344a77054a398caf6e330b57e102/users/9320f31a20a84fdc833c528d62faad32/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:59.509637 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b5387-03bd-4ead-a690-9919d598fe26 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:59.520690 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b5387-03bd-4ead-a690-9919d598fe26 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:59.590250 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d1b5d-b75d-4ede-a43d-5997b3fc1233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:59.591024 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d1b5d-b75d-4ede-a43d-5997b3fc1233 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:59.591382 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d1b5d-b75d-4ede-a43d-5997b3fc1233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:59.591733 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d1b5d-b75d-4ede-a43d-5997b3fc1233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:59.592570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d1b5d-b75d-4ede-a43d-5997b3fc1233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:59.594509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d1b5d-b75d-4ede-a43d-5997b3fc1233 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:59.609303 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1281/2509] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:10:59.610634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9514b13-4685-42bc-bb00-481f6a493814 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:59.630284 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9514b13-4685-42bc-bb00-481f6a493814 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:59.635634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baeb66-adef-4098-b71e-f56aaa6f7f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:59.636715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baeb66-adef-4098-b71e-f56aaa6f7f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:59.639325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baeb66-adef-4098-b71e-f56aaa6f7f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:59.639325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baeb66-adef-4098-b71e-f56aaa6f7f25 admin admin] PATH_INFO: `/v3/projects/9042344a77054a398caf6e330b57e102/users/9320f31a20a84fdc833c528d62faad32/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:59.640331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2baeb66-adef-4098-b71e-f56aaa6f7f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9042344a77054a398caf6e330b57e102, user_id=9320f31a20a84fdc833c528d62faad32, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:59.643008 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2baeb66-adef-4098-b71e-f56aaa6f7f25 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:59.655233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1229/2510] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:10:59 2022] PUT /identity/v3/projects/9042344a77054a398caf6e330b57e102/users/9320f31a20a84fdc833c528d62faad32/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:10:59.665131 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e074b-300b-4b0c-9d4f-cc277a2525f4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:59.665501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e074b-300b-4b0c-9d4f-cc277a2525f4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:59.665851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e074b-300b-4b0c-9d4f-cc277a2525f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:59.695329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-428e074b-300b-4b0c-9d4f-cc277a2525f4 None None] MFA Rules not processed for user `9320f31a20a84fdc833c528d62faad32`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:10:59.696780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-428e074b-300b-4b0c-9d4f-cc277a2525f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:59.702822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:10:59.774225 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1282/2511] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:10:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:10:59.785195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baeb66-adef-4098-b71e-f56aaa6f7f25 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:59.786880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d2baeb66-adef-4098-b71e-f56aaa6f7f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:10:59.845966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baeb66-adef-4098-b71e-f56aaa6f7f25 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:10:59.849827 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612e0d0-ff03-4dca-a6cb-a17419888e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:10:59.850471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612e0d0-ff03-4dca-a6cb-a17419888e82 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:10:59.850756 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612e0d0-ff03-4dca-a6cb-a17419888e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:10:59.851037 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612e0d0-ff03-4dca-a6cb-a17419888e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:10:59.860988 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612e0d0-ff03-4dca-a6cb-a17419888e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:10:59.862417 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612e0d0-ff03-4dca-a6cb-a17419888e82 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:10:59.872703 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1230/2512] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:10:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:10:59.991430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e074b-300b-4b0c-9d4f-cc277a2525f4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:10:59.993466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-428e074b-300b-4b0c-9d4f-cc277a2525f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:00.006241 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e074b-300b-4b0c-9d4f-cc277a2525f4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:00.009946 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d6fb9-e561-4069-be7d-3ac8ed4179f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:00.010590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d6fb9-e561-4069-be7d-3ac8ed4179f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:00.010879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d6fb9-e561-4069-be7d-3ac8ed4179f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:00.011163 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d6fb9-e561-4069-be7d-3ac8ed4179f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:00.068385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d6fb9-e561-4069-be7d-3ac8ed4179f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:00.069824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d6fb9-e561-4069-be7d-3ac8ed4179f6 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:00.079037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1283/2513] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:10:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:00.778637 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612e0d0-ff03-4dca-a6cb-a17419888e82 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:00.780136 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f612e0d0-ff03-4dca-a6cb-a17419888e82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:00.839411 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612e0d0-ff03-4dca-a6cb-a17419888e82 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:00.856840 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159cd22-8253-48c9-9d8f-7e98ef34cae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:00.858984 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159cd22-8253-48c9-9d8f-7e98ef34cae5 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:00.859374 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159cd22-8253-48c9-9d8f-7e98ef34cae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:00.859665 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159cd22-8253-48c9-9d8f-7e98ef34cae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:00.863589 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8159cd22-8253-48c9-9d8f-7e98ef34cae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:00.907362 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:01.024299 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159cd22-8253-48c9-9d8f-7e98ef34cae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:01.025942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159cd22-8253-48c9-9d8f-7e98ef34cae5 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:01.041808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1231/2514] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:02.129537 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00901c1-68e5-4117-8925-05a3f172d8a4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:02.129988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00901c1-68e5-4117-8925-05a3f172d8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:02.130103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00901c1-68e5-4117-8925-05a3f172d8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:02.148695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f00901c1-68e5-4117-8925-05a3f172d8a4 None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:02.149893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f00901c1-68e5-4117-8925-05a3f172d8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:02.206150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1284/2515] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Jun 2 16:11:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:02.219607 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159cd22-8253-48c9-9d8f-7e98ef34cae5 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:02.221799 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8159cd22-8253-48c9-9d8f-7e98ef34cae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:02.271206 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00901c1-68e5-4117-8925-05a3f172d8a4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:02.272685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f00901c1-68e5-4117-8925-05a3f172d8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:02.297998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00901c1-68e5-4117-8925-05a3f172d8a4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:02.301876 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75bad5-e01a-4381-aee8-47031a2e7472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:02.302493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75bad5-e01a-4381-aee8-47031a2e7472 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:02.302782 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75bad5-e01a-4381-aee8-47031a2e7472 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:02.303059 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75bad5-e01a-4381-aee8-47031a2e7472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:02.304938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1c75bad5-e01a-4381-aee8-47031a2e7472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:02.320892 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75bad5-e01a-4381-aee8-47031a2e7472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:02.321438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159cd22-8253-48c9-9d8f-7e98ef34cae5 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:02.322331 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75bad5-e01a-4381-aee8-47031a2e7472 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:02.327772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dd21a-cc7d-410f-ab99-47c8b1a6243f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:02.328644 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dd21a-cc7d-410f-ab99-47c8b1a6243f service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:02.328933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dd21a-cc7d-410f-ab99-47c8b1a6243f service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:02.329215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416dd21a-cc7d-410f-ab99-47c8b1a6243f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:02.337867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dd21a-cc7d-410f-ab99-47c8b1a6243f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:02.339492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416dd21a-cc7d-410f-ab99-47c8b1a6243f service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:02.342214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1285/2516] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:11:02.348991 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1232/2517] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 16:11:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:11:02.689814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75bad5-e01a-4381-aee8-47031a2e7472 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:02.698177 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75bad5-e01a-4381-aee8-47031a2e7472 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:02.702730 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be35f0-f694-40cb-a7e3-913b45d8fb9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:02.703455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be35f0-f694-40cb-a7e3-913b45d8fb9b service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:02.703809 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be35f0-f694-40cb-a7e3-913b45d8fb9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:02.704202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be35f0-f694-40cb-a7e3-913b45d8fb9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:02.706078 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b8be35f0-f694-40cb-a7e3-913b45d8fb9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:02.744768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:02.792804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be35f0-f694-40cb-a7e3-913b45d8fb9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:02.794948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be35f0-f694-40cb-a7e3-913b45d8fb9b service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:02.806778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1286/2518] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:05.400666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dd21a-cc7d-410f-ab99-47c8b1a6243f service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:05.465328 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416dd21a-cc7d-410f-ab99-47c8b1a6243f service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:05.471808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd84bb2-7781-4d2e-83bc-ec4bc5c69379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:05.473428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd84bb2-7781-4d2e-83bc-ec4bc5c69379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:05.473428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd84bb2-7781-4d2e-83bc-ec4bc5c69379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:05.473428 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd84bb2-7781-4d2e-83bc-ec4bc5c69379 admin admin] PATH_INFO: `/v3/users/7fad04cd036d41dd9044b6e8cd7c5c8b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:05.476316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd84bb2-7781-4d2e-83bc-ec4bc5c69379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fad04cd036d41dd9044b6e8cd7c5c8b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:05.478704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd84bb2-7781-4d2e-83bc-ec4bc5c69379 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:05.667098 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:05.679733 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1cd84bb2-7781-4d2e-83bc-ec4bc5c69379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fad04cd036d41dd9044b6e8cd7c5c8b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:05.696410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1cd84bb2-7781-4d2e-83bc-ec4bc5c69379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fad04cd036d41dd9044b6e8cd7c5c8b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:05.697777 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1cd84bb2-7781-4d2e-83bc-ec4bc5c69379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fad04cd036d41dd9044b6e8cd7c5c8b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:05.708894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1cd84bb2-7781-4d2e-83bc-ec4bc5c69379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fad04cd036d41dd9044b6e8cd7c5c8b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:05.711056 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1cd84bb2-7781-4d2e-83bc-ec4bc5c69379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fad04cd036d41dd9044b6e8cd7c5c8b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:05.834150 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1233/2519] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:11:05 2022] DELETE /identity/v3/users/7fad04cd036d41dd9044b6e8cd7c5c8b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:11:05.838698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb91ba3-2bd2-431d-92e8-3b682adda8f0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:05.839279 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb91ba3-2bd2-431d-92e8-3b682adda8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:05.839279 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb91ba3-2bd2-431d-92e8-3b682adda8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:05.892077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bfb91ba3-2bd2-431d-92e8-3b682adda8f0 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:05.892077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bfb91ba3-2bd2-431d-92e8-3b682adda8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:05.972226 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1287/2520] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:05.972763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd84bb2-7781-4d2e-83bc-ec4bc5c69379 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:05.974335 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1cd84bb2-7781-4d2e-83bc-ec4bc5c69379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:06.078829 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd84bb2-7781-4d2e-83bc-ec4bc5c69379 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:06.102278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7eb7-f922-49df-a73b-3db2fc28e01d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:06.102278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7eb7-f922-49df-a73b-3db2fc28e01d service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:06.102278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7eb7-f922-49df-a73b-3db2fc28e01d service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:06.102278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf7eb7-f922-49df-a73b-3db2fc28e01d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:06.122865 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7eb7-f922-49df-a73b-3db2fc28e01d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:06.126708 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf7eb7-f922-49df-a73b-3db2fc28e01d service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:06.151734 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1234/2521] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:06.803935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb91ba3-2bd2-431d-92e8-3b682adda8f0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:06.805717 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bfb91ba3-2bd2-431d-92e8-3b682adda8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:06.849479 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb91ba3-2bd2-431d-92e8-3b682adda8f0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:06.867824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738ff27-9a61-4b47-a40c-1792f5c2e38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:06.869263 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738ff27-9a61-4b47-a40c-1792f5c2e38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:06.869562 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738ff27-9a61-4b47-a40c-1792f5c2e38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:06.869669 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738ff27-9a61-4b47-a40c-1792f5c2e38b admin admin] PATH_INFO: `/v3/projects/eac45c4a880e4984a0c1a9f45f5a6ca9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:06.871806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738ff27-9a61-4b47-a40c-1792f5c2e38b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac45c4a880e4984a0c1a9f45f5a6ca9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:06.874110 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738ff27-9a61-4b47-a40c-1792f5c2e38b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:07.022661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e738ff27-9a61-4b47-a40c-1792f5c2e38b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac45c4a880e4984a0c1a9f45f5a6ca9', 'request_id': 'req-e738ff27-9a61-4b47-a40c-1792f5c2e38b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:07.128954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e738ff27-9a61-4b47-a40c-1792f5c2e38b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac45c4a880e4984a0c1a9f45f5a6ca9', 'request_id': 'req-e738ff27-9a61-4b47-a40c-1792f5c2e38b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:07.137791 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e738ff27-9a61-4b47-a40c-1792f5c2e38b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac45c4a880e4984a0c1a9f45f5a6ca9', 'request_id': 'req-e738ff27-9a61-4b47-a40c-1792f5c2e38b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:07.151329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e738ff27-9a61-4b47-a40c-1792f5c2e38b admin admin] The token cache is being invalidate because project eac45c4a880e4984a0c1a9f45f5a6ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:11:07.151648 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e738ff27-9a61-4b47-a40c-1792f5c2e38b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:07.152452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e738ff27-9a61-4b47-a40c-1792f5c2e38b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:07.154152 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1288/2522] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:11:06 2022] DELETE /identity/v3/projects/eac45c4a880e4984a0c1a9f45f5a6ca9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:07.158326 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7eb7-f922-49df-a73b-3db2fc28e01d service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:07.169858 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf7eb7-f922-49df-a73b-3db2fc28e01d service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:07.259634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563d17b-0bbd-4a7d-b535-4732c8d96603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:07.261413 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563d17b-0bbd-4a7d-b535-4732c8d96603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:07.261855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563d17b-0bbd-4a7d-b535-4732c8d96603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:07.262431 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563d17b-0bbd-4a7d-b535-4732c8d96603 admin admin] PATH_INFO: `/v3/users/8348cbf0804248afb8ab3b8e1d326e73` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:07.266567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563d17b-0bbd-4a7d-b535-4732c8d96603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8348cbf0804248afb8ab3b8e1d326e73)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:07.271708 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563d17b-0bbd-4a7d-b535-4732c8d96603 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:07.469887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0563d17b-0bbd-4a7d-b535-4732c8d96603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8348cbf0804248afb8ab3b8e1d326e73'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:07.480261 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:07.503195 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0563d17b-0bbd-4a7d-b535-4732c8d96603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8348cbf0804248afb8ab3b8e1d326e73'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:07.504775 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0563d17b-0bbd-4a7d-b535-4732c8d96603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8348cbf0804248afb8ab3b8e1d326e73'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:07.542911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0563d17b-0bbd-4a7d-b535-4732c8d96603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8348cbf0804248afb8ab3b8e1d326e73'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:07.545600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0563d17b-0bbd-4a7d-b535-4732c8d96603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8348cbf0804248afb8ab3b8e1d326e73'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:07.657941 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1235/2523] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:11:07 2022] DELETE /identity/v3/users/8348cbf0804248afb8ab3b8e1d326e73 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:08.225730 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738ff27-9a61-4b47-a40c-1792f5c2e38b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:08.227947 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e738ff27-9a61-4b47-a40c-1792f5c2e38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:08.267496 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738ff27-9a61-4b47-a40c-1792f5c2e38b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:08.362252 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:08.380876 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145c680-03c3-42b0-b581-0a7ef231a7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:08.381847 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145c680-03c3-42b0-b581-0a7ef231a7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:08.382201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145c680-03c3-42b0-b581-0a7ef231a7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:08.383889 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145c680-03c3-42b0-b581-0a7ef231a7a0 admin admin] PATH_INFO: `/v3/projects/fb9de4d7b7e54c1ebc51d441601768ae` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:08.385286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145c680-03c3-42b0-b581-0a7ef231a7a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb9de4d7b7e54c1ebc51d441601768ae)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:08.387798 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145c680-03c3-42b0-b581-0a7ef231a7a0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:08.519759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3145c680-03c3-42b0-b581-0a7ef231a7a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb9de4d7b7e54c1ebc51d441601768ae', 'request_id': 'req-3145c680-03c3-42b0-b581-0a7ef231a7a0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:09.161184 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3145c680-03c3-42b0-b581-0a7ef231a7a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb9de4d7b7e54c1ebc51d441601768ae', 'request_id': 'req-3145c680-03c3-42b0-b581-0a7ef231a7a0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:09.168511 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3145c680-03c3-42b0-b581-0a7ef231a7a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb9de4d7b7e54c1ebc51d441601768ae', 'request_id': 'req-3145c680-03c3-42b0-b581-0a7ef231a7a0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:09.178783 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3145c680-03c3-42b0-b581-0a7ef231a7a0 admin admin] The token cache is being invalidate because project fb9de4d7b7e54c1ebc51d441601768ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:11:09.179276 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3145c680-03c3-42b0-b581-0a7ef231a7a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:09.179722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3145c680-03c3-42b0-b581-0a7ef231a7a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:09.181303 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1289/2524] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:11:08 2022] DELETE /identity/v3/projects/fb9de4d7b7e54c1ebc51d441601768ae => generated 0 bytes in 956 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:09.185297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563d17b-0bbd-4a7d-b535-4732c8d96603 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:09.186705 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0563d17b-0bbd-4a7d-b535-4732c8d96603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:09.199236 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563d17b-0bbd-4a7d-b535-4732c8d96603 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:09.265221 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae89fa-7de3-4a0c-8f5c-4512b0c2008e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:09.266754 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae89fa-7de3-4a0c-8f5c-4512b0c2008e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:09.267054 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae89fa-7de3-4a0c-8f5c-4512b0c2008e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:09.267343 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae89fa-7de3-4a0c-8f5c-4512b0c2008e admin admin] PATH_INFO: `/v3/users/9320f31a20a84fdc833c528d62faad32` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:09.268800 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae89fa-7de3-4a0c-8f5c-4512b0c2008e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9320f31a20a84fdc833c528d62faad32)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:09.271409 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae89fa-7de3-4a0c-8f5c-4512b0c2008e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:09.556085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-37ae89fa-7de3-4a0c-8f5c-4512b0c2008e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9320f31a20a84fdc833c528d62faad32'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:09.577044 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-37ae89fa-7de3-4a0c-8f5c-4512b0c2008e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9320f31a20a84fdc833c528d62faad32'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:09.577861 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-37ae89fa-7de3-4a0c-8f5c-4512b0c2008e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9320f31a20a84fdc833c528d62faad32'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:09.588161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-37ae89fa-7de3-4a0c-8f5c-4512b0c2008e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9320f31a20a84fdc833c528d62faad32'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:09.589113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-37ae89fa-7de3-4a0c-8f5c-4512b0c2008e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9320f31a20a84fdc833c528d62faad32'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:09.706808 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1236/2525] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:11:09 2022] DELETE /identity/v3/users/9320f31a20a84fdc833c528d62faad32 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:10.296844 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145c680-03c3-42b0-b581-0a7ef231a7a0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:10.302018 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3145c680-03c3-42b0-b581-0a7ef231a7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:10.347843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145c680-03c3-42b0-b581-0a7ef231a7a0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:10.469052 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dea289-8b4f-471e-8e00-f5f138d691a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:10.472326 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dea289-8b4f-471e-8e00-f5f138d691a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:10.473114 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dea289-8b4f-471e-8e00-f5f138d691a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:10.473637 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dea289-8b4f-471e-8e00-f5f138d691a8 admin admin] PATH_INFO: `/v3/projects/9042344a77054a398caf6e330b57e102` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:10.475259 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dea289-8b4f-471e-8e00-f5f138d691a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9042344a77054a398caf6e330b57e102)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:10.477774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dea289-8b4f-471e-8e00-f5f138d691a8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:10.654064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3dea289-8b4f-471e-8e00-f5f138d691a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9042344a77054a398caf6e330b57e102', 'request_id': 'req-a3dea289-8b4f-471e-8e00-f5f138d691a8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:10.827903 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3dea289-8b4f-471e-8e00-f5f138d691a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9042344a77054a398caf6e330b57e102', 'request_id': 'req-a3dea289-8b4f-471e-8e00-f5f138d691a8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:10.838914 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3dea289-8b4f-471e-8e00-f5f138d691a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9042344a77054a398caf6e330b57e102', 'request_id': 'req-a3dea289-8b4f-471e-8e00-f5f138d691a8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:10.862217 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3dea289-8b4f-471e-8e00-f5f138d691a8 admin admin] The token cache is being invalidate because project 9042344a77054a398caf6e330b57e102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:11:10.862692 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3dea289-8b4f-471e-8e00-f5f138d691a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:10.863695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a3dea289-8b4f-471e-8e00-f5f138d691a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:10.873996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1290/2526] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:11:10 2022] DELETE /identity/v3/projects/9042344a77054a398caf6e330b57e102 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:10.886198 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e736b-2f36-4656-be83-d4b18fc697d0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:10.886198 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e736b-2f36-4656-be83-d4b18fc697d0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:10.886198 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e736b-2f36-4656-be83-d4b18fc697d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:10.955225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5f0e736b-2f36-4656-be83-d4b18fc697d0 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:10.957991 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5f0e736b-2f36-4656-be83-d4b18fc697d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:11.094009 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:11.120667 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1237/2527] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:11.129485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288057-fe57-47eb-b696-3ca6550e7b1f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:11.129889 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288057-fe57-47eb-b696-3ca6550e7b1f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:11.130283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288057-fe57-47eb-b696-3ca6550e7b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:11.188022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-63288057-fe57-47eb-b696-3ca6550e7b1f None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:11.189420 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-63288057-fe57-47eb-b696-3ca6550e7b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:11.211073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1291/2528] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:11.215855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e736b-2f36-4656-be83-d4b18fc697d0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:11.238508 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e736b-2f36-4656-be83-d4b18fc697d0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:11.252743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedf714-0437-49fa-8e6e-eb1926335d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:11.253661 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedf714-0437-49fa-8e6e-eb1926335d7e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:11.254112 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedf714-0437-49fa-8e6e-eb1926335d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:11.254424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedf714-0437-49fa-8e6e-eb1926335d7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:11.255455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedf714-0437-49fa-8e6e-eb1926335d7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:11:11.255888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedf714-0437-49fa-8e6e-eb1926335d7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:11.258093 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedf714-0437-49fa-8e6e-eb1926335d7e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:11.310452 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1238/2529] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:11:11.315918 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63288057-fe57-47eb-b696-3ca6550e7b1f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:11.326824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:11.334202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63288057-fe57-47eb-b696-3ca6550e7b1f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:11.342932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7191a-8408-435a-9c19-a4879d925ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:11.343771 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7191a-8408-435a-9c19-a4879d925ddf admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:11.344756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7191a-8408-435a-9c19-a4879d925ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:11.345136 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7191a-8408-435a-9c19-a4879d925ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:11.346011 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7191a-8408-435a-9c19-a4879d925ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:11.350638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7191a-8408-435a-9c19-a4879d925ddf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:11.471914 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1292/2530] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:11:11 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:11:11.481087 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedf714-0437-49fa-8e6e-eb1926335d7e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:11.505648 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedf714-0437-49fa-8e6e-eb1926335d7e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:11.641121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb329b7-8832-486d-9a32-8c9ee643115d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:11.644444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb329b7-8832-486d-9a32-8c9ee643115d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:11.644942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb329b7-8832-486d-9a32-8c9ee643115d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:11.645395 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb329b7-8832-486d-9a32-8c9ee643115d admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:11.647056 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb329b7-8832-486d-9a32-8c9ee643115d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:11.649294 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb329b7-8832-486d-9a32-8c9ee643115d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:11.775473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1239/2531] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:11:11 2022] POST /identity/v3/users => generated 292 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:11:11.779554 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7191a-8408-435a-9c19-a4879d925ddf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:11.795417 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7191a-8408-435a-9c19-a4879d925ddf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:11.813344 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f9a6b-5de7-4e95-a12b-9958f69b5717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:11.815054 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f9a6b-5de7-4e95-a12b-9958f69b5717 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:11.815440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f9a6b-5de7-4e95-a12b-9958f69b5717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:11.815822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f9a6b-5de7-4e95-a12b-9958f69b5717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:11.816852 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f9a6b-5de7-4e95-a12b-9958f69b5717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:11.820008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f9a6b-5de7-4e95-a12b-9958f69b5717 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:11.831696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1293/2532] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:11:11.836950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb329b7-8832-486d-9a32-8c9ee643115d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:11.848840 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb329b7-8832-486d-9a32-8c9ee643115d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:11.868318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693421c5-ddc9-4013-9f5c-c0cd689b2be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:11.868318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693421c5-ddc9-4013-9f5c-c0cd689b2be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:11.868318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693421c5-ddc9-4013-9f5c-c0cd689b2be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:11.868318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693421c5-ddc9-4013-9f5c-c0cd689b2be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:11.870568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693421c5-ddc9-4013-9f5c-c0cd689b2be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:11.874346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693421c5-ddc9-4013-9f5c-c0cd689b2be2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:11.891864 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1240/2533] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:11:11.895755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f9a6b-5de7-4e95-a12b-9958f69b5717 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:11.909311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f9a6b-5de7-4e95-a12b-9958f69b5717 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:11.923905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe06ddc-c95f-4f26-a303-7737d07a6d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:11.924926 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06ddc-c95f-4f26-a303-7737d07a6d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:11.925245 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06ddc-c95f-4f26-a303-7737d07a6d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:11.925518 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06ddc-c95f-4f26-a303-7737d07a6d12 admin admin] PATH_INFO: `/v3/projects/243438dc499c4c7ba760b5a9143836ef/users/20a354e8cc264fa99848c75ebe6ffda9/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:11.958512 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe06ddc-c95f-4f26-a303-7737d07a6d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=243438dc499c4c7ba760b5a9143836ef, user_id=20a354e8cc264fa99848c75ebe6ffda9, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:11.961515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe06ddc-c95f-4f26-a303-7737d07a6d12 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:12.046846 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1294/2534] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:11:11 2022] PUT /identity/v3/projects/243438dc499c4c7ba760b5a9143836ef/users/20a354e8cc264fa99848c75ebe6ffda9/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:12.062288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d7cfe-52ff-4a62-8484-ef8d25445ac4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:12.062899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d7cfe-52ff-4a62-8484-ef8d25445ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:12.063477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d7cfe-52ff-4a62-8484-ef8d25445ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:12.098207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a05d7cfe-52ff-4a62-8484-ef8d25445ac4 None None] MFA Rules not processed for user `20a354e8cc264fa99848c75ebe6ffda9`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:12.099888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a05d7cfe-52ff-4a62-8484-ef8d25445ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:12.195023 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1241/2535] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:12.205347 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe06ddc-c95f-4f26-a303-7737d07a6d12 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:12.295513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe06ddc-c95f-4f26-a303-7737d07a6d12 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:12.300321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a7a18-a0e2-4192-bb4a-97ceacf78e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:12.300985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a7a18-a0e2-4192-bb4a-97ceacf78e94 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:12.301338 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a7a18-a0e2-4192-bb4a-97ceacf78e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:12.301615 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a7a18-a0e2-4192-bb4a-97ceacf78e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:12.303550 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a7a18-a0e2-4192-bb4a-97ceacf78e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:12.305902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a7a18-a0e2-4192-bb4a-97ceacf78e94 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:12.403548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1295/2536] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:11:12 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:11:12.406285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d7cfe-52ff-4a62-8484-ef8d25445ac4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:12.420083 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d7cfe-52ff-4a62-8484-ef8d25445ac4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:12.481568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:12.496866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b0697-f4a8-46ad-a5ae-8b9c8dd40017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:12.497747 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b0697-f4a8-46ad-a5ae-8b9c8dd40017 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:12.498130 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b0697-f4a8-46ad-a5ae-8b9c8dd40017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:12.498477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b0697-f4a8-46ad-a5ae-8b9c8dd40017 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:12.499249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b0697-f4a8-46ad-a5ae-8b9c8dd40017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:12.501316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b0697-f4a8-46ad-a5ae-8b9c8dd40017 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:12.597051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1242/2537] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:11:12 2022] POST /identity/v3/users => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:11:12.604107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a7a18-a0e2-4192-bb4a-97ceacf78e94 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:12.617711 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a7a18-a0e2-4192-bb4a-97ceacf78e94 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:12.623711 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0570267-9828-4191-9745-93504d5cefda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:12.624528 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0570267-9828-4191-9745-93504d5cefda admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:12.625328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0570267-9828-4191-9745-93504d5cefda admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:12.625328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0570267-9828-4191-9745-93504d5cefda admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:12.626022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0570267-9828-4191-9745-93504d5cefda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:12.627959 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0570267-9828-4191-9745-93504d5cefda admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:12.651151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b0697-f4a8-46ad-a5ae-8b9c8dd40017 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:12.654201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1296/2538] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:11:12.669554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b0697-f4a8-46ad-a5ae-8b9c8dd40017 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:12.691750 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d36f8-218e-463d-84e4-3ee931decbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:12.691750 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d36f8-218e-463d-84e4-3ee931decbe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:12.691750 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d36f8-218e-463d-84e4-3ee931decbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:12.691750 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d36f8-218e-463d-84e4-3ee931decbe6 admin admin] PATH_INFO: `/v3/projects/5394ba46b1a54598ab599ef9f1816b60/users/457e023843c04c959965698a6f5e0833/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:12.714680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d36f8-218e-463d-84e4-3ee931decbe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5394ba46b1a54598ab599ef9f1816b60, user_id=457e023843c04c959965698a6f5e0833, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:12.721897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d36f8-218e-463d-84e4-3ee931decbe6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:13.174652 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1243/2539] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:11:12 2022] PUT /identity/v3/projects/5394ba46b1a54598ab599ef9f1816b60/users/457e023843c04c959965698a6f5e0833/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:13.179390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0570267-9828-4191-9745-93504d5cefda admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:13.189778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0570267-9828-4191-9745-93504d5cefda admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:13.247628 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e7bd2-291b-4243-a10b-e16d5041f8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:13.248777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e7bd2-291b-4243-a10b-e16d5041f8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:13.248777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e7bd2-291b-4243-a10b-e16d5041f8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:13.249017 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e7bd2-291b-4243-a10b-e16d5041f8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:13.249745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e7bd2-291b-4243-a10b-e16d5041f8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:13.251374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e7bd2-291b-4243-a10b-e16d5041f8d0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:13.265215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1297/2540] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:11:13.268757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d36f8-218e-463d-84e4-3ee931decbe6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:13.280115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d36f8-218e-463d-84e4-3ee931decbe6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:13.287467 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4527700-eb2f-4442-a4ca-0118e742ea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:13.288473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4527700-eb2f-4442-a4ca-0118e742ea26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:13.288758 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4527700-eb2f-4442-a4ca-0118e742ea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:13.289037 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4527700-eb2f-4442-a4ca-0118e742ea26 admin admin] PATH_INFO: `/v3/projects/5394ba46b1a54598ab599ef9f1816b60/users/457e023843c04c959965698a6f5e0833/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:13.291171 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4527700-eb2f-4442-a4ca-0118e742ea26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5394ba46b1a54598ab599ef9f1816b60, user_id=457e023843c04c959965698a6f5e0833, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:13.293910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4527700-eb2f-4442-a4ca-0118e742ea26 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:13.316447 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1244/2541] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:11:13 2022] PUT /identity/v3/projects/5394ba46b1a54598ab599ef9f1816b60/users/457e023843c04c959965698a6f5e0833/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:13.330995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8c112-dd00-420a-9c22-892a0ed2ebee None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:13.331402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8c112-dd00-420a-9c22-892a0ed2ebee None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:13.331755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8c112-dd00-420a-9c22-892a0ed2ebee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:13.372537 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-39f8c112-dd00-420a-9c22-892a0ed2ebee None None] MFA Rules not processed for user `457e023843c04c959965698a6f5e0833`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:13.373942 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-39f8c112-dd00-420a-9c22-892a0ed2ebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:13.379564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:13.464167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1298/2542] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:13.472743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4527700-eb2f-4442-a4ca-0118e742ea26 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:13.474478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f4527700-eb2f-4442-a4ca-0118e742ea26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:13.537508 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4527700-eb2f-4442-a4ca-0118e742ea26 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:13.542183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81285f8-a8ad-47ed-9239-926ff9ee4606 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:13.542953 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81285f8-a8ad-47ed-9239-926ff9ee4606 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:13.543163 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81285f8-a8ad-47ed-9239-926ff9ee4606 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:13.543461 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81285f8-a8ad-47ed-9239-926ff9ee4606 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:13.553498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81285f8-a8ad-47ed-9239-926ff9ee4606 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:13.555038 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81285f8-a8ad-47ed-9239-926ff9ee4606 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:13.566134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1245/2543] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:13.730516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8c112-dd00-420a-9c22-892a0ed2ebee None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:13.740599 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8c112-dd00-420a-9c22-892a0ed2ebee None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:13.744367 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8575e-951b-4c2e-af29-78aa5b730a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:13.745043 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8575e-951b-4c2e-af29-78aa5b730a02 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:13.745333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8575e-951b-4c2e-af29-78aa5b730a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:13.745618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8575e-951b-4c2e-af29-78aa5b730a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:13.806619 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8575e-951b-4c2e-af29-78aa5b730a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:13.808035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8575e-951b-4c2e-af29-78aa5b730a02 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:13.819521 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1299/2544] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:14.506434 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81285f8-a8ad-47ed-9239-926ff9ee4606 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:14.571629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81285f8-a8ad-47ed-9239-926ff9ee4606 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:14.576899 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875ce0d-3747-4804-917f-0bf44618d9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:14.577765 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875ce0d-3747-4804-917f-0bf44618d9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:14.578049 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875ce0d-3747-4804-917f-0bf44618d9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:14.578413 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875ce0d-3747-4804-917f-0bf44618d9d3 admin admin] PATH_INFO: `/v3/users/20a354e8cc264fa99848c75ebe6ffda9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:14.579610 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875ce0d-3747-4804-917f-0bf44618d9d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a354e8cc264fa99848c75ebe6ffda9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:14.581549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875ce0d-3747-4804-917f-0bf44618d9d3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:14.801377 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:14.803402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6875ce0d-3747-4804-917f-0bf44618d9d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a354e8cc264fa99848c75ebe6ffda9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:14.815699 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6875ce0d-3747-4804-917f-0bf44618d9d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a354e8cc264fa99848c75ebe6ffda9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:14.816510 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6875ce0d-3747-4804-917f-0bf44618d9d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a354e8cc264fa99848c75ebe6ffda9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:14.823539 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6875ce0d-3747-4804-917f-0bf44618d9d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a354e8cc264fa99848c75ebe6ffda9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:14.824785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6875ce0d-3747-4804-917f-0bf44618d9d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a354e8cc264fa99848c75ebe6ffda9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:14.909756 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1246/2545] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:11:14 2022] DELETE /identity/v3/users/20a354e8cc264fa99848c75ebe6ffda9 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:14.914263 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39117919-f260-4c2e-8dc9-af64b9f61ea2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:14.914765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39117919-f260-4c2e-8dc9-af64b9f61ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:14.914925 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39117919-f260-4c2e-8dc9-af64b9f61ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:14.931906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-39117919-f260-4c2e-8dc9-af64b9f61ea2 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:14.933120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-39117919-f260-4c2e-8dc9-af64b9f61ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:14.989877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1300/2546] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:14.999950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875ce0d-3747-4804-917f-0bf44618d9d3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:15.001542 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6875ce0d-3747-4804-917f-0bf44618d9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:15.064110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875ce0d-3747-4804-917f-0bf44618d9d3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:15.067904 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef301d-d94c-4a92-8d01-81035f872d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:15.068586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef301d-d94c-4a92-8d01-81035f872d70 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:15.068873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef301d-d94c-4a92-8d01-81035f872d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:15.069155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef301d-d94c-4a92-8d01-81035f872d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:15.080102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef301d-d94c-4a92-8d01-81035f872d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:15.081379 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef301d-d94c-4a92-8d01-81035f872d70 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:15.091938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1247/2547] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:15.112536 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39117919-f260-4c2e-8dc9-af64b9f61ea2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:15.123783 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39117919-f260-4c2e-8dc9-af64b9f61ea2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:15.127163 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e13a98-32ed-4947-8a40-8f128b28d25a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:15.127938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e13a98-32ed-4947-8a40-8f128b28d25a service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:15.128260 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e13a98-32ed-4947-8a40-8f128b28d25a service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:15.128546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e13a98-32ed-4947-8a40-8f128b28d25a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:15.130434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-98e13a98-32ed-4947-8a40-8f128b28d25a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:15.142331 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e13a98-32ed-4947-8a40-8f128b28d25a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:15.143879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e13a98-32ed-4947-8a40-8f128b28d25a service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:15.152398 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1301/2548] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:15.677436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef301d-d94c-4a92-8d01-81035f872d70 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:15.678990 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f0ef301d-d94c-4a92-8d01-81035f872d70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:15.694184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef301d-d94c-4a92-8d01-81035f872d70 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:15.700994 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701653b9-04e2-43ff-ae30-b31d2723bf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:15.702176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701653b9-04e2-43ff-ae30-b31d2723bf51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:15.702459 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701653b9-04e2-43ff-ae30-b31d2723bf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:15.702777 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701653b9-04e2-43ff-ae30-b31d2723bf51 admin admin] PATH_INFO: `/v3/projects/243438dc499c4c7ba760b5a9143836ef` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:15.704321 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701653b9-04e2-43ff-ae30-b31d2723bf51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=243438dc499c4c7ba760b5a9143836ef)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:15.706287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701653b9-04e2-43ff-ae30-b31d2723bf51 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:15.845395 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-701653b9-04e2-43ff-ae30-b31d2723bf51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '243438dc499c4c7ba760b5a9143836ef', 'request_id': 'req-701653b9-04e2-43ff-ae30-b31d2723bf51'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:15.850931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-701653b9-04e2-43ff-ae30-b31d2723bf51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '243438dc499c4c7ba760b5a9143836ef', 'request_id': 'req-701653b9-04e2-43ff-ae30-b31d2723bf51'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:15.923742 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-701653b9-04e2-43ff-ae30-b31d2723bf51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '243438dc499c4c7ba760b5a9143836ef', 'request_id': 'req-701653b9-04e2-43ff-ae30-b31d2723bf51'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:15.935320 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-701653b9-04e2-43ff-ae30-b31d2723bf51 admin admin] The token cache is being invalidate because project 243438dc499c4c7ba760b5a9143836ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:11:15.935613 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-701653b9-04e2-43ff-ae30-b31d2723bf51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:15.936399 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-701653b9-04e2-43ff-ae30-b31d2723bf51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:15.938289 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1248/2549] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:11:15 2022] DELETE /identity/v3/projects/243438dc499c4c7ba760b5a9143836ef => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:15.945216 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e13a98-32ed-4947-8a40-8f128b28d25a service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:15.953682 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e13a98-32ed-4947-8a40-8f128b28d25a service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:15.981389 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:16.014580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b2984-da5f-4578-ad1b-4c9c1262be70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:16.015453 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b2984-da5f-4578-ad1b-4c9c1262be70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:16.015737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b2984-da5f-4578-ad1b-4c9c1262be70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:16.016050 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b2984-da5f-4578-ad1b-4c9c1262be70 admin admin] PATH_INFO: `/v3/users/457e023843c04c959965698a6f5e0833` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:16.017656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b2984-da5f-4578-ad1b-4c9c1262be70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=457e023843c04c959965698a6f5e0833)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:16.020066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b2984-da5f-4578-ad1b-4c9c1262be70 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:16.240993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-365b2984-da5f-4578-ad1b-4c9c1262be70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '457e023843c04c959965698a6f5e0833'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:16.244357 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-365b2984-da5f-4578-ad1b-4c9c1262be70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '457e023843c04c959965698a6f5e0833'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:16.341198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-365b2984-da5f-4578-ad1b-4c9c1262be70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '457e023843c04c959965698a6f5e0833'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:16.349372 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-365b2984-da5f-4578-ad1b-4c9c1262be70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '457e023843c04c959965698a6f5e0833'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:16.350157 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-365b2984-da5f-4578-ad1b-4c9c1262be70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '457e023843c04c959965698a6f5e0833'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:16.369649 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1302/2550] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:11:15 2022] DELETE /identity/v3/users/457e023843c04c959965698a6f5e0833 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:16.828039 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701653b9-04e2-43ff-ae30-b31d2723bf51 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:16.829503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-701653b9-04e2-43ff-ae30-b31d2723bf51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:16.842651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701653b9-04e2-43ff-ae30-b31d2723bf51 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:16.892503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:16.904978 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bc001-068e-49a7-98b0-d34325d5e9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:16.905842 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bc001-068e-49a7-98b0-d34325d5e9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:16.906543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bc001-068e-49a7-98b0-d34325d5e9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:16.906543 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bc001-068e-49a7-98b0-d34325d5e9d9 admin admin] PATH_INFO: `/v3/projects/5394ba46b1a54598ab599ef9f1816b60` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:16.907641 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bc001-068e-49a7-98b0-d34325d5e9d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5394ba46b1a54598ab599ef9f1816b60)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:16.909603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bc001-068e-49a7-98b0-d34325d5e9d9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:17.061720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c34bc001-068e-49a7-98b0-d34325d5e9d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5394ba46b1a54598ab599ef9f1816b60', 'request_id': 'req-c34bc001-068e-49a7-98b0-d34325d5e9d9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:17.067024 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c34bc001-068e-49a7-98b0-d34325d5e9d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5394ba46b1a54598ab599ef9f1816b60', 'request_id': 'req-c34bc001-068e-49a7-98b0-d34325d5e9d9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:17.163869 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c34bc001-068e-49a7-98b0-d34325d5e9d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5394ba46b1a54598ab599ef9f1816b60', 'request_id': 'req-c34bc001-068e-49a7-98b0-d34325d5e9d9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:17.176283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c34bc001-068e-49a7-98b0-d34325d5e9d9 admin admin] The token cache is being invalidate because project 5394ba46b1a54598ab599ef9f1816b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:11:17.178241 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c34bc001-068e-49a7-98b0-d34325d5e9d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:17.178241 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c34bc001-068e-49a7-98b0-d34325d5e9d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:17.178812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1249/2551] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:11:16 2022] DELETE /identity/v3/projects/5394ba46b1a54598ab599ef9f1816b60 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:17.184757 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c053ff-82b8-4921-b156-3e3dad5aaf79 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:17.185246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c053ff-82b8-4921-b156-3e3dad5aaf79 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:17.185368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c053ff-82b8-4921-b156-3e3dad5aaf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:17.207116 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-14c053ff-82b8-4921-b156-3e3dad5aaf79 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:17.208745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-14c053ff-82b8-4921-b156-3e3dad5aaf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:17.278382 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1303/2552] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:17.288092 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc760913-1e0e-4959-8dc0-2ccac33dab4b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:17.288395 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc760913-1e0e-4959-8dc0-2ccac33dab4b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:17.288678 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc760913-1e0e-4959-8dc0-2ccac33dab4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:17.306932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fc760913-1e0e-4959-8dc0-2ccac33dab4b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:17.308670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fc760913-1e0e-4959-8dc0-2ccac33dab4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:17.316618 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1250/2553] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:17.320764 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c053ff-82b8-4921-b156-3e3dad5aaf79 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:17.331158 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c053ff-82b8-4921-b156-3e3dad5aaf79 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:17.335688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93ef0a-9add-407f-912f-6b5ca1ce572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:17.336372 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93ef0a-9add-407f-912f-6b5ca1ce572e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:17.336657 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93ef0a-9add-407f-912f-6b5ca1ce572e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:17.336935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93ef0a-9add-407f-912f-6b5ca1ce572e admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:17.337658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93ef0a-9add-407f-912f-6b5ca1ce572e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:11:17.337964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93ef0a-9add-407f-912f-6b5ca1ce572e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:17.339555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93ef0a-9add-407f-912f-6b5ca1ce572e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:17.360295 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1304/2554] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:11:17.364462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc760913-1e0e-4959-8dc0-2ccac33dab4b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:17.374356 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc760913-1e0e-4959-8dc0-2ccac33dab4b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:17.379222 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f912583-5b32-4dcc-aae9-232a3e10774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:17.379876 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f912583-5b32-4dcc-aae9-232a3e10774b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:17.380194 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f912583-5b32-4dcc-aae9-232a3e10774b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:17.380476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f912583-5b32-4dcc-aae9-232a3e10774b admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:17.381164 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f912583-5b32-4dcc-aae9-232a3e10774b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:17.383103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f912583-5b32-4dcc-aae9-232a3e10774b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:17.479878 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1251/2555] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:11:17 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:11:17.490089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93ef0a-9add-407f-912f-6b5ca1ce572e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:17.492076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93ef0a-9add-407f-912f-6b5ca1ce572e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:17.526467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:17.551328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2e8dc-92ee-4605-9141-84f0d4b3fbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:17.552034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2e8dc-92ee-4605-9141-84f0d4b3fbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:17.552334 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2e8dc-92ee-4605-9141-84f0d4b3fbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:17.552618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2e8dc-92ee-4605-9141-84f0d4b3fbb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:17.553315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2e8dc-92ee-4605-9141-84f0d4b3fbb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:17.555280 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2e8dc-92ee-4605-9141-84f0d4b3fbb3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:17.749064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1305/2556] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:11:17 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:11:17.753503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f912583-5b32-4dcc-aae9-232a3e10774b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:17.764029 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f912583-5b32-4dcc-aae9-232a3e10774b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:17.768692 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73b534-fe02-43a4-ba59-9b277c9ac9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:17.769354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73b534-fe02-43a4-ba59-9b277c9ac9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:17.769643 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73b534-fe02-43a4-ba59-9b277c9ac9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:17.769923 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73b534-fe02-43a4-ba59-9b277c9ac9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:17.770652 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73b534-fe02-43a4-ba59-9b277c9ac9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:17.772296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73b534-fe02-43a4-ba59-9b277c9ac9e6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:17.782935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1252/2557] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:11:17.786979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2e8dc-92ee-4605-9141-84f0d4b3fbb3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:17.798831 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2e8dc-92ee-4605-9141-84f0d4b3fbb3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:17.803617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb7e8e-d006-49f2-bf80-dcb868a654a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:17.804320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb7e8e-d006-49f2-bf80-dcb868a654a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:17.804609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb7e8e-d006-49f2-bf80-dcb868a654a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:17.804890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb7e8e-d006-49f2-bf80-dcb868a654a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:17.805618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb7e8e-d006-49f2-bf80-dcb868a654a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:17.807216 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb7e8e-d006-49f2-bf80-dcb868a654a3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:17.817884 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1306/2558] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:11:17.822104 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73b534-fe02-43a4-ba59-9b277c9ac9e6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:17.833008 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73b534-fe02-43a4-ba59-9b277c9ac9e6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:17.837626 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a0881-a377-4974-bba6-1dbb79bf45fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:17.838499 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a0881-a377-4974-bba6-1dbb79bf45fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:17.838783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a0881-a377-4974-bba6-1dbb79bf45fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:17.839063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a0881-a377-4974-bba6-1dbb79bf45fc admin admin] PATH_INFO: `/v3/projects/972237d1621449279e43b210b628319b/users/d009637dac4d4087a05a9efa4a84fbf7/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:17.855885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a0881-a377-4974-bba6-1dbb79bf45fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=972237d1621449279e43b210b628319b, user_id=d009637dac4d4087a05a9efa4a84fbf7, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:17.858644 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a0881-a377-4974-bba6-1dbb79bf45fc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:17.978483 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1253/2559] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:11:17 2022] PUT /identity/v3/projects/972237d1621449279e43b210b628319b/users/d009637dac4d4087a05a9efa4a84fbf7/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:17.988873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5199e2-730f-48cc-90c9-5b8b54790bc6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:17.989167 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5199e2-730f-48cc-90c9-5b8b54790bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:17.989446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5199e2-730f-48cc-90c9-5b8b54790bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:18.016753 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-be5199e2-730f-48cc-90c9-5b8b54790bc6 None None] MFA Rules not processed for user `d009637dac4d4087a05a9efa4a84fbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:18.017881 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-be5199e2-730f-48cc-90c9-5b8b54790bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:18.080831 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1307/2560] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:18.085734 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a0881-a377-4974-bba6-1dbb79bf45fc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:18.154318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a0881-a377-4974-bba6-1dbb79bf45fc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:18.159270 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557d814-2087-4d55-a54f-2975aedcbbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:18.159965 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557d814-2087-4d55-a54f-2975aedcbbfe admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:18.160279 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557d814-2087-4d55-a54f-2975aedcbbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:18.160589 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557d814-2087-4d55-a54f-2975aedcbbfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:18.161283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557d814-2087-4d55-a54f-2975aedcbbfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:18.163205 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557d814-2087-4d55-a54f-2975aedcbbfe admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:18.265330 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:18.275010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1254/2561] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:11:18 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:11:18.275725 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5199e2-730f-48cc-90c9-5b8b54790bc6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:18.286394 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5199e2-730f-48cc-90c9-5b8b54790bc6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:18.345029 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b61b7-483e-4b4b-b49b-3ad27741b038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:18.345696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b61b7-483e-4b4b-b49b-3ad27741b038 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:18.345978 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b61b7-483e-4b4b-b49b-3ad27741b038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:18.346255 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b61b7-483e-4b4b-b49b-3ad27741b038 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:18.346963 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b61b7-483e-4b4b-b49b-3ad27741b038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:18.349120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b61b7-483e-4b4b-b49b-3ad27741b038 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:18.475031 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1308/2562] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:11:18 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:11:18.479079 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557d814-2087-4d55-a54f-2975aedcbbfe admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:18.490097 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557d814-2087-4d55-a54f-2975aedcbbfe admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:18.494836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c2334-70c0-4d94-9081-8d74d279d435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:18.495483 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c2334-70c0-4d94-9081-8d74d279d435 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:18.496400 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c2334-70c0-4d94-9081-8d74d279d435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:18.496685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c2334-70c0-4d94-9081-8d74d279d435 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:18.497411 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c2334-70c0-4d94-9081-8d74d279d435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:18.499032 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c2334-70c0-4d94-9081-8d74d279d435 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:18.510010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1255/2563] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:11:18.514466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b61b7-483e-4b4b-b49b-3ad27741b038 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:18.525261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b61b7-483e-4b4b-b49b-3ad27741b038 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:18.529872 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cc860-49c2-4b0f-b7e9-cf98e44f5010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:18.530756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cc860-49c2-4b0f-b7e9-cf98e44f5010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:18.531063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cc860-49c2-4b0f-b7e9-cf98e44f5010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:18.531344 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47cc860-49c2-4b0f-b7e9-cf98e44f5010 admin admin] PATH_INFO: `/v3/projects/9b5e6e537867475d9c0d96f0f45c6a24/users/eb3116a0c7664dce812f3dbb23a6e587/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:18.546521 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cc860-49c2-4b0f-b7e9-cf98e44f5010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5e6e537867475d9c0d96f0f45c6a24, user_id=eb3116a0c7664dce812f3dbb23a6e587, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:18.549191 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47cc860-49c2-4b0f-b7e9-cf98e44f5010 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:18.612583 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c2334-70c0-4d94-9081-8d74d279d435 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:18.614286 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-077c2334-70c0-4d94-9081-8d74d279d435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:18.675971 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1309/2564] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:11:18 2022] PUT /identity/v3/projects/9b5e6e537867475d9c0d96f0f45c6a24/users/eb3116a0c7664dce812f3dbb23a6e587/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:18.679925 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cc860-49c2-4b0f-b7e9-cf98e44f5010 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:18.687807 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c2334-70c0-4d94-9081-8d74d279d435 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:18.690406 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:18.741286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47cc860-49c2-4b0f-b7e9-cf98e44f5010 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:18.746896 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cc0fb-9780-49ed-a8f0-c2abe2a2af49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:18.747644 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cc0fb-9780-49ed-a8f0-c2abe2a2af49 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:18.747932 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cc0fb-9780-49ed-a8f0-c2abe2a2af49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:18.748240 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2cc0fb-9780-49ed-a8f0-c2abe2a2af49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:18.749016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cc0fb-9780-49ed-a8f0-c2abe2a2af49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:18.750726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2cc0fb-9780-49ed-a8f0-c2abe2a2af49 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:18.752284 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84267c-33b5-4ab2-b82c-41044cd74670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:18.758649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84267c-33b5-4ab2-b82c-41044cd74670 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:18.758649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84267c-33b5-4ab2-b82c-41044cd74670 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:18.758649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84267c-33b5-4ab2-b82c-41044cd74670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:18.758649 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cf84267c-33b5-4ab2-b82c-41044cd74670 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:18.767324 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1310/2565] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:11:18.768366 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cc0fb-9780-49ed-a8f0-c2abe2a2af49 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:18.782151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2cc0fb-9780-49ed-a8f0-c2abe2a2af49 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:18.787177 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85bdbe-27ce-4e6d-9584-9c3ee0e47c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:18.788416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85bdbe-27ce-4e6d-9584-9c3ee0e47c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:18.789226 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85bdbe-27ce-4e6d-9584-9c3ee0e47c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:18.790402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85bdbe-27ce-4e6d-9584-9c3ee0e47c91 admin admin] PATH_INFO: `/v3/projects/9b5e6e537867475d9c0d96f0f45c6a24/users/eb3116a0c7664dce812f3dbb23a6e587/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:18.792651 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85bdbe-27ce-4e6d-9584-9c3ee0e47c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5e6e537867475d9c0d96f0f45c6a24, user_id=eb3116a0c7664dce812f3dbb23a6e587, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:18.796331 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85bdbe-27ce-4e6d-9584-9c3ee0e47c91 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:18.807084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1311/2566] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:11:18 2022] PUT /identity/v3/projects/9b5e6e537867475d9c0d96f0f45c6a24/users/eb3116a0c7664dce812f3dbb23a6e587/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:18.818387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eb6c2-0ddb-4906-8594-4427bbf5e534 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:18.818666 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eb6c2-0ddb-4906-8594-4427bbf5e534 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:18.818945 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eb6c2-0ddb-4906-8594-4427bbf5e534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:18.831615 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84267c-33b5-4ab2-b82c-41044cd74670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:18.841005 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84267c-33b5-4ab2-b82c-41044cd74670 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:18.843973 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1256/2567] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:11:18.846343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a85eb6c2-0ddb-4906-8594-4427bbf5e534 None None] MFA Rules not processed for user `eb3116a0c7664dce812f3dbb23a6e587`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:18.847561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a85eb6c2-0ddb-4906-8594-4427bbf5e534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:18.927482 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1312/2568] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:11:18.938769 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84267c-33b5-4ab2-b82c-41044cd74670 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:18.939538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cf84267c-33b5-4ab2-b82c-41044cd74670 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:18.981507 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:19.014745 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84267c-33b5-4ab2-b82c-41044cd74670 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:19.067483 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d4683d-8d5d-4852-912f-d2d3e68af573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:19.068188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4683d-8d5d-4852-912f-d2d3e68af573 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:19.068478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4683d-8d5d-4852-912f-d2d3e68af573 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:19.068759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d4683d-8d5d-4852-912f-d2d3e68af573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:19.132164 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4683d-8d5d-4852-912f-d2d3e68af573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:19.133695 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d4683d-8d5d-4852-912f-d2d3e68af573 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:19.154180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1257/2569] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:21.135507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85eb6c2-0ddb-4906-8594-4427bbf5e534 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:21.137040 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a85eb6c2-0ddb-4906-8594-4427bbf5e534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:21.194378 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85eb6c2-0ddb-4906-8594-4427bbf5e534 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:21.197952 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489df3d-7a36-4409-9d9d-76a29b63750e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:21.198623 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489df3d-7a36-4409-9d9d-76a29b63750e service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:21.199602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489df3d-7a36-4409-9d9d-76a29b63750e service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:21.199895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489df3d-7a36-4409-9d9d-76a29b63750e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:21.201810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f489df3d-7a36-4409-9d9d-76a29b63750e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:21.211313 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489df3d-7a36-4409-9d9d-76a29b63750e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:21.212712 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489df3d-7a36-4409-9d9d-76a29b63750e service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:21.220618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1313/2570] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:21.606130 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8951b-31bf-458c-9904-9aacc3e7b789 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:21.606739 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8951b-31bf-458c-9904-9aacc3e7b789 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:21.606739 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8951b-31bf-458c-9904-9aacc3e7b789 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:21.608151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1258/2571] 10.222.0.50 () {54 vars in 921 bytes} [Thu Jun 2 16:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:11:21.615027 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accda459-4832-4e43-a8ef-f5e8a323e29a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:21.618332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accda459-4832-4e43-a8ef-f5e8a323e29a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:21.618332 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accda459-4832-4e43-a8ef-f5e8a323e29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:21.638377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-accda459-4832-4e43-a8ef-f5e8a323e29a None None] MFA Rules not processed for user `2e53683ae2b34947a1550de269b74d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:21.639895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-accda459-4832-4e43-a8ef-f5e8a323e29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:21.658723 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:21.720290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1314/2572] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Jun 2 16:11:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:21.736405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8951b-31bf-458c-9904-9aacc3e7b789 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:21.739219 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-11f8951b-31bf-458c-9904-9aacc3e7b789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:21.821185 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8951b-31bf-458c-9904-9aacc3e7b789 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:21.826120 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4bf0e-9d04-4860-a465-c5011a16d3ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5157588644972a6a4554b3a9f1d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:21.826838 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4bf0e-9d04-4860-a465-c5011a16d3ff service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:21.827062 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4bf0e-9d04-4860-a465-c5011a16d3ff service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:21.827346 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4bf0e-9d04-4860-a465-c5011a16d3ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:21.838697 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4bf0e-9d04-4860-a465-c5011a16d3ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:21.840204 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4bf0e-9d04-4860-a465-c5011a16d3ff service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:21.851383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1259/2573] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:22.096679 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10714189-8fc7-451d-ac0f-37d060be1bec None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:22.096975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10714189-8fc7-451d-ac0f-37d060be1bec None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:22.097257 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10714189-8fc7-451d-ac0f-37d060be1bec None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:22.098722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1315/2574] 10.222.0.50 () {54 vars in 921 bytes} [Thu Jun 2 16:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:11:22.103683 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedfa21-5fcf-459b-ba5a-ff41bfe67a9f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:22.104056 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedfa21-5fcf-459b-ba5a-ff41bfe67a9f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:22.104391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedfa21-5fcf-459b-ba5a-ff41bfe67a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:22.122670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1eedfa21-5fcf-459b-ba5a-ff41bfe67a9f None None] MFA Rules not processed for user `c3ec010ab4c5414a8782cecf202fbcfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:22.123876 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1eedfa21-5fcf-459b-ba5a-ff41bfe67a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:22.130572 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1260/2575] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Jun 2 16:11:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:22.142673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10714189-8fc7-451d-ac0f-37d060be1bec None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:22.153602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10714189-8fc7-451d-ac0f-37d060be1bec None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:22.157120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f7f61-9f2b-479a-888c-f03d93b21b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:22.157729 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f7f61-9f2b-479a-888c-f03d93b21b73 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:22.158014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f7f61-9f2b-479a-888c-f03d93b21b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:22.158294 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f7f61-9f2b-479a-888c-f03d93b21b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:22.165552 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f7f61-9f2b-479a-888c-f03d93b21b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:22.166972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f7f61-9f2b-479a-888c-f03d93b21b73 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:22.175368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1316/2576] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:22.257177 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58108f-3d11-4468-b089-4392eae6e0ef None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:22.257473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58108f-3d11-4468-b089-4392eae6e0ef None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:22.257759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58108f-3d11-4468-b089-4392eae6e0ef None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:22.259133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1261/2577] 10.222.0.50 () {54 vars in 921 bytes} [Thu Jun 2 16:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 16:11:22.265406 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f08c4-f1e0-4e76-a52c-04a387ce3959 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:22.265705 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f08c4-f1e0-4e76-a52c-04a387ce3959 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:22.265994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f08c4-f1e0-4e76-a52c-04a387ce3959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:22.284098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d27f08c4-f1e0-4e76-a52c-04a387ce3959 None None] MFA Rules not processed for user `2e53683ae2b34947a1550de269b74d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:22.285341 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d27f08c4-f1e0-4e76-a52c-04a387ce3959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:22.295156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1317/2578] 10.222.0.50 () {58 vars in 1018 bytes} [Thu Jun 2 16:11:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:22.305408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58108f-3d11-4468-b089-4392eae6e0ef None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:22.317051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58108f-3d11-4468-b089-4392eae6e0ef None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:22.320598 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb0bd7-9973-4137-b0fc-9c8705a8272c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:22.321228 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0bd7-9973-4137-b0fc-9c8705a8272c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:22.321516 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0bd7-9973-4137-b0fc-9c8705a8272c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:22.321807 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb0bd7-9973-4137-b0fc-9c8705a8272c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:22.331784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb0bd7-9973-4137-b0fc-9c8705a8272c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:22.333261 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdb0bd7-9973-4137-b0fc-9c8705a8272c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:22.344096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1262/2579] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:22.409377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f08c4-f1e0-4e76-a52c-04a387ce3959 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:22.410790 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d27f08c4-f1e0-4e76-a52c-04a387ce3959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:22.477994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f08c4-f1e0-4e76-a52c-04a387ce3959 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:22.483540 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb125c2-0358-45d3-b7a2-a21fd38f0a4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60a2abffc04ba59b65d5fca5e318a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:22.484275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb125c2-0358-45d3-b7a2-a21fd38f0a4d service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:22.484565 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb125c2-0358-45d3-b7a2-a21fd38f0a4d service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:22.484847 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb125c2-0358-45d3-b7a2-a21fd38f0a4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:22.486622 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fcb125c2-0358-45d3-b7a2-a21fd38f0a4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:22.498597 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb125c2-0358-45d3-b7a2-a21fd38f0a4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:22.500218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb125c2-0358-45d3-b7a2-a21fd38f0a4d service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:22.509914 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1318/2580] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:24.495053 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb0bd7-9973-4137-b0fc-9c8705a8272c service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:24.505231 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb0bd7-9973-4137-b0fc-9c8705a8272c service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:24.508947 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdac8f3-0f80-425b-905c-7d4cfc99c79c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:24.509587 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdac8f3-0f80-425b-905c-7d4cfc99c79c service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:24.509876 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdac8f3-0f80-425b-905c-7d4cfc99c79c service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:24.510155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdac8f3-0f80-425b-905c-7d4cfc99c79c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:24.519967 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdac8f3-0f80-425b-905c-7d4cfc99c79c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:24.524469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdac8f3-0f80-425b-905c-7d4cfc99c79c service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:24.531104 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1263/2581] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:24.763041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165878d-5652-42be-bac7-f7da74b3eb1e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:24.763747 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165878d-5652-42be-bac7-f7da74b3eb1e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:24.763906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165878d-5652-42be-bac7-f7da74b3eb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:24.781956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1165878d-5652-42be-bac7-f7da74b3eb1e None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:24.783161 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1165878d-5652-42be-bac7-f7da74b3eb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:24.837554 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1319/2582] 10.222.0.50 () {58 vars in 1009 bytes} [Thu Jun 2 16:11:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:24.860391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdac8f3-0f80-425b-905c-7d4cfc99c79c service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:24.861895 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4cdac8f3-0f80-425b-905c-7d4cfc99c79c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:24.868724 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:24.931590 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdac8f3-0f80-425b-905c-7d4cfc99c79c service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:24.938302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125d218-cb19-455a-ac0c-8d09a7133c74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:24.939141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d218-cb19-455a-ac0c-8d09a7133c74 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:24.943177 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d218-cb19-455a-ac0c-8d09a7133c74 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:24.943177 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d218-cb19-455a-ac0c-8d09a7133c74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:24.952218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125d218-cb19-455a-ac0c-8d09a7133c74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:24.954413 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125d218-cb19-455a-ac0c-8d09a7133c74 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:24.964823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1264/2583] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 16:11:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:11:31.051243 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165878d-5652-42be-bac7-f7da74b3eb1e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:31.086178 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:31.119647 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165878d-5652-42be-bac7-f7da74b3eb1e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:31.124209 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246e8df-ec61-4146-b715-6fc686a1ad64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:31.125233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246e8df-ec61-4146-b715-6fc686a1ad64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:31.125534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246e8df-ec61-4146-b715-6fc686a1ad64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:31.125811 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246e8df-ec61-4146-b715-6fc686a1ad64 admin admin] PATH_INFO: `/v3/users/d009637dac4d4087a05a9efa4a84fbf7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:31.126994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246e8df-ec61-4146-b715-6fc686a1ad64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d009637dac4d4087a05a9efa4a84fbf7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:31.129146 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e246e8df-ec61-4146-b715-6fc686a1ad64 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:31.378446 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e246e8df-ec61-4146-b715-6fc686a1ad64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd009637dac4d4087a05a9efa4a84fbf7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:31.379201 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e246e8df-ec61-4146-b715-6fc686a1ad64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd009637dac4d4087a05a9efa4a84fbf7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:31.466208 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e246e8df-ec61-4146-b715-6fc686a1ad64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd009637dac4d4087a05a9efa4a84fbf7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:31.474004 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e246e8df-ec61-4146-b715-6fc686a1ad64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd009637dac4d4087a05a9efa4a84fbf7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:31.474745 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e246e8df-ec61-4146-b715-6fc686a1ad64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd009637dac4d4087a05a9efa4a84fbf7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:31.494183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1320/2584] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:11:31 2022] DELETE /identity/v3/users/d009637dac4d4087a05a9efa4a84fbf7 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:31.498745 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaa979-8a79-494a-ac5e-d58079ba0b49 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:31.499277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaa979-8a79-494a-ac5e-d58079ba0b49 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:31.499518 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaa979-8a79-494a-ac5e-d58079ba0b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:31.519852 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-afcaa979-8a79-494a-ac5e-d58079ba0b49 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:31.521202 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-afcaa979-8a79-494a-ac5e-d58079ba0b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:31.597214 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1265/2585] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:31.742789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246e8df-ec61-4146-b715-6fc686a1ad64 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:31.745786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e246e8df-ec61-4146-b715-6fc686a1ad64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:31.821752 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246e8df-ec61-4146-b715-6fc686a1ad64 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:31.826161 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaf67f-86e3-4b04-8aa9-3c1817ca5e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:31.826827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaf67f-86e3-4b04-8aa9-3c1817ca5e45 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:31.827118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaf67f-86e3-4b04-8aa9-3c1817ca5e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:31.827486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaf67f-86e3-4b04-8aa9-3c1817ca5e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:31.838224 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaf67f-86e3-4b04-8aa9-3c1817ca5e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:31.839937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaf67f-86e3-4b04-8aa9-3c1817ca5e45 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:31.850122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1321/2586] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:32.581548 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaa979-8a79-494a-ac5e-d58079ba0b49 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:32.583213 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-afcaa979-8a79-494a-ac5e-d58079ba0b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:32.607773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaa979-8a79-494a-ac5e-d58079ba0b49 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:32.613337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980608ba-fc46-4646-9ef7-13e0eecd0c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:32.614246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980608ba-fc46-4646-9ef7-13e0eecd0c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:32.614534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980608ba-fc46-4646-9ef7-13e0eecd0c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:32.614817 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980608ba-fc46-4646-9ef7-13e0eecd0c6b admin admin] PATH_INFO: `/v3/projects/972237d1621449279e43b210b628319b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:32.616677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980608ba-fc46-4646-9ef7-13e0eecd0c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=972237d1621449279e43b210b628319b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:32.618538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980608ba-fc46-4646-9ef7-13e0eecd0c6b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:32.915633 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-980608ba-fc46-4646-9ef7-13e0eecd0c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972237d1621449279e43b210b628319b', 'request_id': 'req-980608ba-fc46-4646-9ef7-13e0eecd0c6b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:32.923081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-980608ba-fc46-4646-9ef7-13e0eecd0c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972237d1621449279e43b210b628319b', 'request_id': 'req-980608ba-fc46-4646-9ef7-13e0eecd0c6b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:33.049327 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-980608ba-fc46-4646-9ef7-13e0eecd0c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972237d1621449279e43b210b628319b', 'request_id': 'req-980608ba-fc46-4646-9ef7-13e0eecd0c6b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:33.063323 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-980608ba-fc46-4646-9ef7-13e0eecd0c6b admin admin] The token cache is being invalidate because project 972237d1621449279e43b210b628319b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:11:33.063635 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-980608ba-fc46-4646-9ef7-13e0eecd0c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:33.064371 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-980608ba-fc46-4646-9ef7-13e0eecd0c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:33.066314 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1266/2587] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:11:32 2022] DELETE /identity/v3/projects/972237d1621449279e43b210b628319b => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:33.070187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaf67f-86e3-4b04-8aa9-3c1817ca5e45 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:33.081315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaf67f-86e3-4b04-8aa9-3c1817ca5e45 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:33.129900 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:33.142520 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d0d14-9fba-4c90-a6cd-d410c31a98b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:33.143530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d0d14-9fba-4c90-a6cd-d410c31a98b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:33.143826 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d0d14-9fba-4c90-a6cd-d410c31a98b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:33.144157 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d0d14-9fba-4c90-a6cd-d410c31a98b0 admin admin] PATH_INFO: `/v3/users/eb3116a0c7664dce812f3dbb23a6e587` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:33.145372 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d0d14-9fba-4c90-a6cd-d410c31a98b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3116a0c7664dce812f3dbb23a6e587)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:33.147380 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d0d14-9fba-4c90-a6cd-d410c31a98b0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:33.536925 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a25d0d14-9fba-4c90-a6cd-d410c31a98b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3116a0c7664dce812f3dbb23a6e587'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:33.537558 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a25d0d14-9fba-4c90-a6cd-d410c31a98b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3116a0c7664dce812f3dbb23a6e587'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:33.671838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a25d0d14-9fba-4c90-a6cd-d410c31a98b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3116a0c7664dce812f3dbb23a6e587'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:33.681371 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a25d0d14-9fba-4c90-a6cd-d410c31a98b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3116a0c7664dce812f3dbb23a6e587'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:33.685573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a25d0d14-9fba-4c90-a6cd-d410c31a98b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3116a0c7664dce812f3dbb23a6e587'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:33.701519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1322/2588] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:11:33 2022] DELETE /identity/v3/users/eb3116a0c7664dce812f3dbb23a6e587 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:34.242110 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980608ba-fc46-4646-9ef7-13e0eecd0c6b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:34.243616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-980608ba-fc46-4646-9ef7-13e0eecd0c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:34.257574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980608ba-fc46-4646-9ef7-13e0eecd0c6b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:34.271801 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:34.318967 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e7534-b729-4e7a-b74c-e06c3dca74ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:34.319826 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e7534-b729-4e7a-b74c-e06c3dca74ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:34.320148 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e7534-b729-4e7a-b74c-e06c3dca74ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:34.320432 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e7534-b729-4e7a-b74c-e06c3dca74ee admin admin] PATH_INFO: `/v3/projects/9b5e6e537867475d9c0d96f0f45c6a24` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:34.321627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e7534-b729-4e7a-b74c-e06c3dca74ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b5e6e537867475d9c0d96f0f45c6a24)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:34.323514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e7534-b729-4e7a-b74c-e06c3dca74ee admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:34.461670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c44e7534-b729-4e7a-b74c-e06c3dca74ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b5e6e537867475d9c0d96f0f45c6a24', 'request_id': 'req-c44e7534-b729-4e7a-b74c-e06c3dca74ee'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:34.467536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c44e7534-b729-4e7a-b74c-e06c3dca74ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b5e6e537867475d9c0d96f0f45c6a24', 'request_id': 'req-c44e7534-b729-4e7a-b74c-e06c3dca74ee'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:34.566151 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c44e7534-b729-4e7a-b74c-e06c3dca74ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b5e6e537867475d9c0d96f0f45c6a24', 'request_id': 'req-c44e7534-b729-4e7a-b74c-e06c3dca74ee'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:34.578080 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c44e7534-b729-4e7a-b74c-e06c3dca74ee admin admin] The token cache is being invalidate because project 9b5e6e537867475d9c0d96f0f45c6a24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:11:34.578404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c44e7534-b729-4e7a-b74c-e06c3dca74ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:34.579103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c44e7534-b729-4e7a-b74c-e06c3dca74ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:34.580715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1267/2589] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:11:34 2022] DELETE /identity/v3/projects/9b5e6e537867475d9c0d96f0f45c6a24 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:34.586586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507f1a8-5a27-433f-9dd8-7d8ebee6b1b0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:34.587124 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507f1a8-5a27-433f-9dd8-7d8ebee6b1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:34.587124 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507f1a8-5a27-433f-9dd8-7d8ebee6b1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:34.608680 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f507f1a8-5a27-433f-9dd8-7d8ebee6b1b0 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:34.614628 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f507f1a8-5a27-433f-9dd8-7d8ebee6b1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:34.669284 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1323/2590] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:34.677658 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608edcf1-1bde-4a7c-8ba7-2380fbdc6386 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:34.680351 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608edcf1-1bde-4a7c-8ba7-2380fbdc6386 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:34.680351 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608edcf1-1bde-4a7c-8ba7-2380fbdc6386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:34.697108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-608edcf1-1bde-4a7c-8ba7-2380fbdc6386 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:34.699085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-608edcf1-1bde-4a7c-8ba7-2380fbdc6386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:34.708182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1268/2591] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:34.712405 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507f1a8-5a27-433f-9dd8-7d8ebee6b1b0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:34.722098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507f1a8-5a27-433f-9dd8-7d8ebee6b1b0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:34.726731 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cbc94-0f3c-4a27-adb1-e3f63f3000bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:34.727429 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cbc94-0f3c-4a27-adb1-e3f63f3000bf admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:34.727718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cbc94-0f3c-4a27-adb1-e3f63f3000bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:34.728017 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cbc94-0f3c-4a27-adb1-e3f63f3000bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:34.728881 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cbc94-0f3c-4a27-adb1-e3f63f3000bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:11:34.729193 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cbc94-0f3c-4a27-adb1-e3f63f3000bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:34.730777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cbc94-0f3c-4a27-adb1-e3f63f3000bf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:34.742060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1324/2592] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:11:34.751666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608edcf1-1bde-4a7c-8ba7-2380fbdc6386 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:34.761481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608edcf1-1bde-4a7c-8ba7-2380fbdc6386 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:34.766570 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277455c-afb5-4c42-b6f1-0d19be21f5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:34.767218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277455c-afb5-4c42-b6f1-0d19be21f5ca admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:34.767503 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277455c-afb5-4c42-b6f1-0d19be21f5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:34.767783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277455c-afb5-4c42-b6f1-0d19be21f5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:34.768500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277455c-afb5-4c42-b6f1-0d19be21f5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:34.770453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277455c-afb5-4c42-b6f1-0d19be21f5ca admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:34.905096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1269/2593] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:11:34 2022] POST /identity/v3/projects => generated 359 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:11:34.910062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cbc94-0f3c-4a27-adb1-e3f63f3000bf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:34.920972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cbc94-0f3c-4a27-adb1-e3f63f3000bf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:34.971580 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:34.978378 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9bf91-ccda-46b9-b1a2-30668fcff0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:34.979046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9bf91-ccda-46b9-b1a2-30668fcff0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:34.979840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9bf91-ccda-46b9-b1a2-30668fcff0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:34.980154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9bf91-ccda-46b9-b1a2-30668fcff0d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:34.980845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9bf91-ccda-46b9-b1a2-30668fcff0d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:34.982828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9bf91-ccda-46b9-b1a2-30668fcff0d9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:35.125956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1325/2594] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:11:34 2022] POST /identity/v3/users => generated 280 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:11:35.130080 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277455c-afb5-4c42-b6f1-0d19be21f5ca admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:35.141104 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277455c-afb5-4c42-b6f1-0d19be21f5ca admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:35.145711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea0022-34e1-42e2-a893-bcc1332983f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:35.146555 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0022-34e1-42e2-a893-bcc1332983f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:35.146840 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0022-34e1-42e2-a893-bcc1332983f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:35.147123 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea0022-34e1-42e2-a893-bcc1332983f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:35.147843 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea0022-34e1-42e2-a893-bcc1332983f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:35.149468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea0022-34e1-42e2-a893-bcc1332983f2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:35.161858 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1270/2595] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:11:35.166031 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9bf91-ccda-46b9-b1a2-30668fcff0d9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:35.176285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9bf91-ccda-46b9-b1a2-30668fcff0d9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:35.181301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea570374-16c1-44c0-a416-cded0b99b193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:35.181962 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea570374-16c1-44c0-a416-cded0b99b193 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:35.182277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea570374-16c1-44c0-a416-cded0b99b193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:35.182568 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea570374-16c1-44c0-a416-cded0b99b193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:35.183296 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea570374-16c1-44c0-a416-cded0b99b193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:35.184956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea570374-16c1-44c0-a416-cded0b99b193 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:35.195705 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1326/2596] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:11:35.200578 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea0022-34e1-42e2-a893-bcc1332983f2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:35.210404 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea0022-34e1-42e2-a893-bcc1332983f2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:35.216525 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468edfbc-32a5-4cf8-a012-e9169ba563d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:35.217402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468edfbc-32a5-4cf8-a012-e9169ba563d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:35.217685 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468edfbc-32a5-4cf8-a012-e9169ba563d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:35.217964 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468edfbc-32a5-4cf8-a012-e9169ba563d9 admin admin] PATH_INFO: `/v3/projects/def10c786d20410196d2001419832a07/users/c042ef5d23d14198806a2fb731057e59/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:35.233338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468edfbc-32a5-4cf8-a012-e9169ba563d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def10c786d20410196d2001419832a07, user_id=c042ef5d23d14198806a2fb731057e59, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:35.236021 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468edfbc-32a5-4cf8-a012-e9169ba563d9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:35.326925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1271/2597] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:11:35 2022] PUT /identity/v3/projects/def10c786d20410196d2001419832a07/users/c042ef5d23d14198806a2fb731057e59/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:35.339289 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e3713-0dbc-4024-9657-0e0ea852a5d2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:35.340255 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e3713-0dbc-4024-9657-0e0ea852a5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:35.340255 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e3713-0dbc-4024-9657-0e0ea852a5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:35.365806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c08e3713-0dbc-4024-9657-0e0ea852a5d2 None None] MFA Rules not processed for user `c042ef5d23d14198806a2fb731057e59`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:35.367057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c08e3713-0dbc-4024-9657-0e0ea852a5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:35.433994 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1327/2598] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:35 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:35.468576 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468edfbc-32a5-4cf8-a012-e9169ba563d9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:35.470913 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-468edfbc-32a5-4cf8-a012-e9169ba563d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:35.519971 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:35.530774 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468edfbc-32a5-4cf8-a012-e9169ba563d9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:35.535085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479b899-8923-43bf-a9f1-4b1793b17dfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:35.535738 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479b899-8923-43bf-a9f1-4b1793b17dfb service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:35.536063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479b899-8923-43bf-a9f1-4b1793b17dfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:35.536347 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479b899-8923-43bf-a9f1-4b1793b17dfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:35.546052 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479b899-8923-43bf-a9f1-4b1793b17dfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:35.547509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479b899-8923-43bf-a9f1-4b1793b17dfb service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:35.557963 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1272/2599] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:35 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:35.572124 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e3713-0dbc-4024-9657-0e0ea852a5d2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:35.693744 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e3713-0dbc-4024-9657-0e0ea852a5d2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:35.701466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d1704-49f1-4007-a5f7-53aa0552760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:35.703015 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d1704-49f1-4007-a5f7-53aa0552760d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:35.703968 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d1704-49f1-4007-a5f7-53aa0552760d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:35.704124 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d1704-49f1-4007-a5f7-53aa0552760d admin admin] PATH_INFO: `/v3/users/c042ef5d23d14198806a2fb731057e59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:35.706122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d1704-49f1-4007-a5f7-53aa0552760d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c042ef5d23d14198806a2fb731057e59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:35.709899 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d1704-49f1-4007-a5f7-53aa0552760d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:35.902840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-366d1704-49f1-4007-a5f7-53aa0552760d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c042ef5d23d14198806a2fb731057e59'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:35.903418 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-366d1704-49f1-4007-a5f7-53aa0552760d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c042ef5d23d14198806a2fb731057e59'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:35.991577 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-366d1704-49f1-4007-a5f7-53aa0552760d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c042ef5d23d14198806a2fb731057e59'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:35.999879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-366d1704-49f1-4007-a5f7-53aa0552760d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c042ef5d23d14198806a2fb731057e59'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:36.000662 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-366d1704-49f1-4007-a5f7-53aa0552760d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c042ef5d23d14198806a2fb731057e59'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:36.002627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:36.021032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1328/2600] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:11:35 2022] DELETE /identity/v3/users/c042ef5d23d14198806a2fb731057e59 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:36.025494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a53f-9643-4ea5-9146-580e6f068c95 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:36.025858 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a53f-9643-4ea5-9146-580e6f068c95 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:36.026709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a53f-9643-4ea5-9146-580e6f068c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:36.046479 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-47e3a53f-9643-4ea5-9146-580e6f068c95 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:36.047823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-47e3a53f-9643-4ea5-9146-580e6f068c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:36.110437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1273/2601] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:11:36.130430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d1704-49f1-4007-a5f7-53aa0552760d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:36.130430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-366d1704-49f1-4007-a5f7-53aa0552760d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:36.178452 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d1704-49f1-4007-a5f7-53aa0552760d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:36.182173 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ba574-5da5-4311-a9df-6bfd6e04894d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:36.183429 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba574-5da5-4311-a9df-6bfd6e04894d service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:36.183715 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba574-5da5-4311-a9df-6bfd6e04894d service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:36.184107 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba574-5da5-4311-a9df-6bfd6e04894d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:36.194162 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ba574-5da5-4311-a9df-6bfd6e04894d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:36.195663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ba574-5da5-4311-a9df-6bfd6e04894d service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:36.206064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1329/2602] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:36.589785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a53f-9643-4ea5-9146-580e6f068c95 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:36.592688 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-47e3a53f-9643-4ea5-9146-580e6f068c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:36.603366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a53f-9643-4ea5-9146-580e6f068c95 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:36.608566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f610e9f-5f89-45ab-9a76-3b83f8c36536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:36.609429 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f610e9f-5f89-45ab-9a76-3b83f8c36536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:36.609814 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f610e9f-5f89-45ab-9a76-3b83f8c36536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:36.610215 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f610e9f-5f89-45ab-9a76-3b83f8c36536 admin admin] PATH_INFO: `/v3/projects/def10c786d20410196d2001419832a07` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:36.611395 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f610e9f-5f89-45ab-9a76-3b83f8c36536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=def10c786d20410196d2001419832a07)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:36.613415 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f610e9f-5f89-45ab-9a76-3b83f8c36536 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:36.719453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f610e9f-5f89-45ab-9a76-3b83f8c36536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def10c786d20410196d2001419832a07', 'request_id': 'req-6f610e9f-5f89-45ab-9a76-3b83f8c36536'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:36.724805 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f610e9f-5f89-45ab-9a76-3b83f8c36536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def10c786d20410196d2001419832a07', 'request_id': 'req-6f610e9f-5f89-45ab-9a76-3b83f8c36536'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:36.814498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f610e9f-5f89-45ab-9a76-3b83f8c36536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def10c786d20410196d2001419832a07', 'request_id': 'req-6f610e9f-5f89-45ab-9a76-3b83f8c36536'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:36.826209 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f610e9f-5f89-45ab-9a76-3b83f8c36536 admin admin] The token cache is being invalidate because project def10c786d20410196d2001419832a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:11:36.826506 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f610e9f-5f89-45ab-9a76-3b83f8c36536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:36.827143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6f610e9f-5f89-45ab-9a76-3b83f8c36536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:36.828734 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1274/2603] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:11:36 2022] DELETE /identity/v3/projects/def10c786d20410196d2001419832a07 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:36.835235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7dbbd-d62b-4637-910b-c701c5092c69 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:36.835725 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7dbbd-d62b-4637-910b-c701c5092c69 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:36.835948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7dbbd-d62b-4637-910b-c701c5092c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:36.855404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-61f7dbbd-d62b-4637-910b-c701c5092c69 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:36.856718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-61f7dbbd-d62b-4637-910b-c701c5092c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:36.919151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1330/2604] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:36.983895 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a51444-3aff-4ce7-8fea-ee9ab37d5880 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:36.984201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a51444-3aff-4ce7-8fea-ee9ab37d5880 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:36.984475 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a51444-3aff-4ce7-8fea-ee9ab37d5880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:37.004316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b5a51444-3aff-4ce7-8fea-ee9ab37d5880 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:37.005686 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b5a51444-3aff-4ce7-8fea-ee9ab37d5880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:37.016353 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1275/2605] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:37.019115 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7dbbd-d62b-4637-910b-c701c5092c69 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:37.029967 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7dbbd-d62b-4637-910b-c701c5092c69 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:37.034748 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa339e35-ae44-48f1-b775-32ef06f0501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:37.035437 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa339e35-ae44-48f1-b775-32ef06f0501d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:37.035726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa339e35-ae44-48f1-b775-32ef06f0501d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:37.036028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa339e35-ae44-48f1-b775-32ef06f0501d admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:37.036769 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa339e35-ae44-48f1-b775-32ef06f0501d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:11:37.037084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa339e35-ae44-48f1-b775-32ef06f0501d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:37.038716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa339e35-ae44-48f1-b775-32ef06f0501d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:37.052528 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1331/2606] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:11:37.057331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a51444-3aff-4ce7-8fea-ee9ab37d5880 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:37.066844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a51444-3aff-4ce7-8fea-ee9ab37d5880 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:37.072118 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6f740-a123-42e6-ae98-fea7f9b62235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:37.072890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6f740-a123-42e6-ae98-fea7f9b62235 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:37.073386 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6f740-a123-42e6-ae98-fea7f9b62235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:37.073764 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6f740-a123-42e6-ae98-fea7f9b62235 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:37.074562 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6f740-a123-42e6-ae98-fea7f9b62235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:37.076677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6f740-a123-42e6-ae98-fea7f9b62235 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:37.217494 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1276/2607] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:11:37 2022] POST /identity/v3/projects => generated 397 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:11:37.220037 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa339e35-ae44-48f1-b775-32ef06f0501d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:37.231748 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa339e35-ae44-48f1-b775-32ef06f0501d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:37.292122 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96f12d-c2ba-4ead-93bb-71c76ba2f023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:37.292901 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96f12d-c2ba-4ead-93bb-71c76ba2f023 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:37.293207 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96f12d-c2ba-4ead-93bb-71c76ba2f023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:37.293498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96f12d-c2ba-4ead-93bb-71c76ba2f023 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:37.294202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96f12d-c2ba-4ead-93bb-71c76ba2f023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:37.296150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96f12d-c2ba-4ead-93bb-71c76ba2f023 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:37.426238 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1332/2608] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:11:37 2022] POST /identity/v3/users => generated 299 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:11:37.430311 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6f740-a123-42e6-ae98-fea7f9b62235 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:37.440524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6f740-a123-42e6-ae98-fea7f9b62235 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:37.445536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0023984-acd3-464f-8e73-6a7e73d49973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:37.446282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0023984-acd3-464f-8e73-6a7e73d49973 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:37.446616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0023984-acd3-464f-8e73-6a7e73d49973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:37.446949 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0023984-acd3-464f-8e73-6a7e73d49973 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:37.447697 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0023984-acd3-464f-8e73-6a7e73d49973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:37.449809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0023984-acd3-464f-8e73-6a7e73d49973 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:37.460512 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1277/2609] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:11:37.466996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96f12d-c2ba-4ead-93bb-71c76ba2f023 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:37.472130 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:37.477324 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96f12d-c2ba-4ead-93bb-71c76ba2f023 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:37.481940 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40277760-ed4a-450f-b4c3-c1567ab1d8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:37.482602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40277760-ed4a-450f-b4c3-c1567ab1d8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:37.482894 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40277760-ed4a-450f-b4c3-c1567ab1d8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:37.483175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40277760-ed4a-450f-b4c3-c1567ab1d8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:37.483902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40277760-ed4a-450f-b4c3-c1567ab1d8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:37.485556 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40277760-ed4a-450f-b4c3-c1567ab1d8a8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:37.496935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1333/2610] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:11:37.500920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0023984-acd3-464f-8e73-6a7e73d49973 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:37.511568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0023984-acd3-464f-8e73-6a7e73d49973 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:37.520986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea43eb6-97e1-4fd0-9c32-5924303fcb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:37.520986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea43eb6-97e1-4fd0-9c32-5924303fcb36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:37.520986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea43eb6-97e1-4fd0-9c32-5924303fcb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:37.520986 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea43eb6-97e1-4fd0-9c32-5924303fcb36 admin admin] PATH_INFO: `/v3/projects/3eb5bc0be5494fe4b8c6d776e62b92c7/users/efbffacaf40144daa18b915c8f009546/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:37.535142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea43eb6-97e1-4fd0-9c32-5924303fcb36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb5bc0be5494fe4b8c6d776e62b92c7, user_id=efbffacaf40144daa18b915c8f009546, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:37.538092 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea43eb6-97e1-4fd0-9c32-5924303fcb36 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:37.634770 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1278/2611] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:11:37 2022] PUT /identity/v3/projects/3eb5bc0be5494fe4b8c6d776e62b92c7/users/efbffacaf40144daa18b915c8f009546/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:37.645950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f667e3-c127-4988-83dd-ee745cc444e2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:37.646246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f667e3-c127-4988-83dd-ee745cc444e2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:37.646526 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f667e3-c127-4988-83dd-ee745cc444e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:37.673256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-92f667e3-c127-4988-83dd-ee745cc444e2 None None] MFA Rules not processed for user `efbffacaf40144daa18b915c8f009546`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:37.675914 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-92f667e3-c127-4988-83dd-ee745cc444e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:37.737000 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1334/2612] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:37.748974 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea43eb6-97e1-4fd0-9c32-5924303fcb36 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:37.750596 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0ea43eb6-97e1-4fd0-9c32-5924303fcb36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:37.761117 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:37.807159 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea43eb6-97e1-4fd0-9c32-5924303fcb36 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:37.811405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9389f-a6e9-4c7a-b3e2-40535ef5ce1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:37.812080 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9389f-a6e9-4c7a-b3e2-40535ef5ce1f service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:37.812369 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9389f-a6e9-4c7a-b3e2-40535ef5ce1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:37.812653 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9389f-a6e9-4c7a-b3e2-40535ef5ce1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:37.821010 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9389f-a6e9-4c7a-b3e2-40535ef5ce1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:37.822440 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9389f-a6e9-4c7a-b3e2-40535ef5ce1f service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:37.832033 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1279/2613] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:38.398922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f667e3-c127-4988-83dd-ee745cc444e2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:38.400436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-92f667e3-c127-4988-83dd-ee745cc444e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:38.483257 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f667e3-c127-4988-83dd-ee745cc444e2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:38.490293 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9efbbf-85e3-4956-a904-48773118caf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:38.491033 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9efbbf-85e3-4956-a904-48773118caf9 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:38.491331 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9efbbf-85e3-4956-a904-48773118caf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:38.491618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9efbbf-85e3-4956-a904-48773118caf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:38.493421 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-aa9efbbf-85e3-4956-a904-48773118caf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:38.551470 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9efbbf-85e3-4956-a904-48773118caf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:38.554030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9efbbf-85e3-4956-a904-48773118caf9 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:38.563023 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1335/2614] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:39.164083 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9389f-a6e9-4c7a-b3e2-40535ef5ce1f service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:39.165609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b8c9389f-a6e9-4c7a-b3e2-40535ef5ce1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:39.183160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9389f-a6e9-4c7a-b3e2-40535ef5ce1f service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:39.188704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede0834-fa91-4c6c-81a9-bbe2c3d0ac15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:39.189336 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede0834-fa91-4c6c-81a9-bbe2c3d0ac15 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:39.189623 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede0834-fa91-4c6c-81a9-bbe2c3d0ac15 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:39.189957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede0834-fa91-4c6c-81a9-bbe2c3d0ac15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:39.191663 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5ede0834-fa91-4c6c-81a9-bbe2c3d0ac15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:39.213651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede0834-fa91-4c6c-81a9-bbe2c3d0ac15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:39.213651 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede0834-fa91-4c6c-81a9-bbe2c3d0ac15 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:39.220342 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1280/2615] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:41.421404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd873410-405d-46f5-9b88-33cee8c9216c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:41.422202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd873410-405d-46f5-9b88-33cee8c9216c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:41.422202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd873410-405d-46f5-9b88-33cee8c9216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:41.453499 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cd873410-405d-46f5-9b88-33cee8c9216c None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:41.454704 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cd873410-405d-46f5-9b88-33cee8c9216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:41.467784 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:41.512013 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1336/2616] 10.222.0.50 () {58 vars in 967 bytes} [Thu Jun 2 16:11:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:41.525068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede0834-fa91-4c6c-81a9-bbe2c3d0ac15 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:41.526752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5ede0834-fa91-4c6c-81a9-bbe2c3d0ac15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:41.597988 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede0834-fa91-4c6c-81a9-bbe2c3d0ac15 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:41.603262 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cb948-615c-433a-9ce0-34139dff164b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:41.621285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cb948-615c-433a-9ce0-34139dff164b service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:41.621285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cb948-615c-433a-9ce0-34139dff164b service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:41.621285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cb948-615c-433a-9ce0-34139dff164b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:41.621285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cb948-615c-433a-9ce0-34139dff164b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:41.621285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cb948-615c-433a-9ce0-34139dff164b service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:41.623091 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1281/2617] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 16:11:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:11:43.757481 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd873410-405d-46f5-9b88-33cee8c9216c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:43.820960 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd873410-405d-46f5-9b88-33cee8c9216c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:43.825460 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d7477-ddc1-4e07-89d5-ebe06973dc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:43.826326 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d7477-ddc1-4e07-89d5-ebe06973dc49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:43.826621 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d7477-ddc1-4e07-89d5-ebe06973dc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:43.826889 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d7477-ddc1-4e07-89d5-ebe06973dc49 admin admin] PATH_INFO: `/v3/users/efbffacaf40144daa18b915c8f009546` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:43.828110 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d7477-ddc1-4e07-89d5-ebe06973dc49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efbffacaf40144daa18b915c8f009546)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:43.830032 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d7477-ddc1-4e07-89d5-ebe06973dc49 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:44.024503 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-512d7477-ddc1-4e07-89d5-ebe06973dc49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efbffacaf40144daa18b915c8f009546'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:44.025179 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-512d7477-ddc1-4e07-89d5-ebe06973dc49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efbffacaf40144daa18b915c8f009546'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:44.111865 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-512d7477-ddc1-4e07-89d5-ebe06973dc49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efbffacaf40144daa18b915c8f009546'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:44.124165 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-512d7477-ddc1-4e07-89d5-ebe06973dc49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efbffacaf40144daa18b915c8f009546'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:44.125009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-512d7477-ddc1-4e07-89d5-ebe06973dc49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efbffacaf40144daa18b915c8f009546'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:44.144118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1337/2618] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:11:43 2022] DELETE /identity/v3/users/efbffacaf40144daa18b915c8f009546 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:44.148601 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97072e0c-8000-4a6a-963c-784de38daa74 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:44.149094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97072e0c-8000-4a6a-963c-784de38daa74 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:44.149249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97072e0c-8000-4a6a-963c-784de38daa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:44.166897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-97072e0c-8000-4a6a-963c-784de38daa74 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:44.168183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-97072e0c-8000-4a6a-963c-784de38daa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:44.229567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1282/2619] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:44.241997 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d7477-ddc1-4e07-89d5-ebe06973dc49 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:44.243456 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-512d7477-ddc1-4e07-89d5-ebe06973dc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:44.293912 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:44.305544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d7477-ddc1-4e07-89d5-ebe06973dc49 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:44.309719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4927b-7002-449e-957b-87b956b112af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:44.310369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4927b-7002-449e-957b-87b956b112af service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:44.310655 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4927b-7002-449e-957b-87b956b112af service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:44.310936 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4927b-7002-449e-957b-87b956b112af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:44.320157 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4927b-7002-449e-957b-87b956b112af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:44.321605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4927b-7002-449e-957b-87b956b112af service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:44.332545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1338/2620] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:44.749790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97072e0c-8000-4a6a-963c-784de38daa74 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:44.751252 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-97072e0c-8000-4a6a-963c-784de38daa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:44.767497 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97072e0c-8000-4a6a-963c-784de38daa74 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:44.773267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:44.774139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:44.774425 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:44.774737 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e admin admin] PATH_INFO: `/v3/projects/3eb5bc0be5494fe4b8c6d776e62b92c7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:44.776625 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb5bc0be5494fe4b8c6d776e62b92c7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:44.778766 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:44.802027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:44.946090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb5bc0be5494fe4b8c6d776e62b92c7', 'request_id': 'req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:44.952292 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb5bc0be5494fe4b8c6d776e62b92c7', 'request_id': 'req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:45.045837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb5bc0be5494fe4b8c6d776e62b92c7', 'request_id': 'req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:45.058969 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e admin admin] The token cache is being invalidate because project 3eb5bc0be5494fe4b8c6d776e62b92c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:11:45.059264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:45.060092 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:45.061717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1283/2621] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:11:44 2022] DELETE /identity/v3/projects/3eb5bc0be5494fe4b8c6d776e62b92c7 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:48.033618 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4927b-7002-449e-957b-87b956b112af service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:48.035373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e2f4927b-7002-449e-957b-87b956b112af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:48.136571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4927b-7002-449e-957b-87b956b112af service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:48.218557 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0613d67-752f-43b2-9dd5-8a8083c30cb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:48.219608 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613d67-752f-43b2-9dd5-8a8083c30cb8 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:48.219850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613d67-752f-43b2-9dd5-8a8083c30cb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:48.220172 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613d67-752f-43b2-9dd5-8a8083c30cb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:48.222373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e0613d67-752f-43b2-9dd5-8a8083c30cb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:48.241321 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0613d67-752f-43b2-9dd5-8a8083c30cb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:48.243048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0613d67-752f-43b2-9dd5-8a8083c30cb8 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:48.255469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1339/2622] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:55.055075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:55.181505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:55.183003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:55.240962 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1acb60-988c-4f08-ad14-51d7f2df3a9e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:55.244547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157444fe-f6e5-473e-a9b4-eb2b258e27c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:55.245198 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157444fe-f6e5-473e-a9b4-eb2b258e27c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:55.245488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157444fe-f6e5-473e-a9b4-eb2b258e27c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:55.245770 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157444fe-f6e5-473e-a9b4-eb2b258e27c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:55.247526 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-157444fe-f6e5-473e-a9b4-eb2b258e27c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:55.310722 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157444fe-f6e5-473e-a9b4-eb2b258e27c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:55.312111 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157444fe-f6e5-473e-a9b4-eb2b258e27c2 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:55.322022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1284/2623] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:11:58.251193 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=69 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:58.929146 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0613d67-752f-43b2-9dd5-8a8083c30cb8 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:58.930606 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e0613d67-752f-43b2-9dd5-8a8083c30cb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:58.944826 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0613d67-752f-43b2-9dd5-8a8083c30cb8 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:58.949649 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce20ca-d8ce-405e-adec-e89e803802e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:58.950600 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce20ca-d8ce-405e-adec-e89e803802e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:58.950898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce20ca-d8ce-405e-adec-e89e803802e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:58.951185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce20ca-d8ce-405e-adec-e89e803802e7 admin admin] PATH_INFO: `/v3/users/fb70aacb7cfb41cea6a65a084e705ecf` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:58.952405 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce20ca-d8ce-405e-adec-e89e803802e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb70aacb7cfb41cea6a65a084e705ecf)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:58.954355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce20ca-d8ce-405e-adec-e89e803802e7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:59.104582 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-63ce20ca-d8ce-405e-adec-e89e803802e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb70aacb7cfb41cea6a65a084e705ecf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:59.105233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-63ce20ca-d8ce-405e-adec-e89e803802e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb70aacb7cfb41cea6a65a084e705ecf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:59.176254 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-63ce20ca-d8ce-405e-adec-e89e803802e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb70aacb7cfb41cea6a65a084e705ecf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:59.183435 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-63ce20ca-d8ce-405e-adec-e89e803802e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb70aacb7cfb41cea6a65a084e705ecf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:59.184195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-63ce20ca-d8ce-405e-adec-e89e803802e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb70aacb7cfb41cea6a65a084e705ecf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:59.201747 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1340/2624] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:11:58 2022] DELETE /identity/v3/users/fb70aacb7cfb41cea6a65a084e705ecf => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:11:59.467446 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157444fe-f6e5-473e-a9b4-eb2b258e27c2 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:59.477967 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157444fe-f6e5-473e-a9b4-eb2b258e27c2 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:59.535004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0079b7-2d48-4db2-b379-efce98f5d9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:59.540974 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0079b7-2d48-4db2-b379-efce98f5d9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:59.540974 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0079b7-2d48-4db2-b379-efce98f5d9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:59.540974 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0079b7-2d48-4db2-b379-efce98f5d9c0 admin admin] PATH_INFO: `/v3/projects/013e943c1aea4902b5a3b8f271fdc98c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:59.540974 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0079b7-2d48-4db2-b379-efce98f5d9c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=013e943c1aea4902b5a3b8f271fdc98c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:59.540974 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0079b7-2d48-4db2-b379-efce98f5d9c0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:59.677468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0e0079b7-2d48-4db2-b379-efce98f5d9c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013e943c1aea4902b5a3b8f271fdc98c', 'request_id': 'req-0e0079b7-2d48-4db2-b379-efce98f5d9c0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:59.679524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:11:59.684240 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0e0079b7-2d48-4db2-b379-efce98f5d9c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013e943c1aea4902b5a3b8f271fdc98c', 'request_id': 'req-0e0079b7-2d48-4db2-b379-efce98f5d9c0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:59.765367 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0e0079b7-2d48-4db2-b379-efce98f5d9c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013e943c1aea4902b5a3b8f271fdc98c', 'request_id': 'req-0e0079b7-2d48-4db2-b379-efce98f5d9c0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:59.776609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0e0079b7-2d48-4db2-b379-efce98f5d9c0 admin admin] The token cache is being invalidate because project 013e943c1aea4902b5a3b8f271fdc98c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:11:59.776906 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0e0079b7-2d48-4db2-b379-efce98f5d9c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:59.777520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0e0079b7-2d48-4db2-b379-efce98f5d9c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:11:59.779055 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1285/2625] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:11:59 2022] DELETE /identity/v3/projects/013e943c1aea4902b5a3b8f271fdc98c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:11:59.783919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a979d13-5e0c-4042-88d7-df146c16faa4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:59.784431 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a979d13-5e0c-4042-88d7-df146c16faa4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:59.784576 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a979d13-5e0c-4042-88d7-df146c16faa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:59.802592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2a979d13-5e0c-4042-88d7-df146c16faa4 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:59.803854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2a979d13-5e0c-4042-88d7-df146c16faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:59.865906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1341/2626] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:59.874226 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669954f-6dc9-4291-87a2-f64c3c94a53a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:59.874526 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669954f-6dc9-4291-87a2-f64c3c94a53a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:59.874815 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669954f-6dc9-4291-87a2-f64c3c94a53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:59.893624 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5669954f-6dc9-4291-87a2-f64c3c94a53a None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:11:59.894824 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5669954f-6dc9-4291-87a2-f64c3c94a53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:11:59.903142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1286/2627] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:11:59.907275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a979d13-5e0c-4042-88d7-df146c16faa4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:59.916895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a979d13-5e0c-4042-88d7-df146c16faa4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:59.921443 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660f7d1-0a17-4921-b590-77141c963e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:59.922089 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660f7d1-0a17-4921-b590-77141c963e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:59.922373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660f7d1-0a17-4921-b590-77141c963e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:59.922654 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660f7d1-0a17-4921-b590-77141c963e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:59.923364 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660f7d1-0a17-4921-b590-77141c963e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:11:59.923675 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660f7d1-0a17-4921-b590-77141c963e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:59.925303 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660f7d1-0a17-4921-b590-77141c963e20 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:11:59.937033 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1342/2628] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:11:59.941066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669954f-6dc9-4291-87a2-f64c3c94a53a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:11:59.950842 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669954f-6dc9-4291-87a2-f64c3c94a53a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:11:59.955551 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbc200-99cd-422c-b39a-9b65cb3a9143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:11:59.956334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbc200-99cd-422c-b39a-9b65cb3a9143 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:11:59.956627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbc200-99cd-422c-b39a-9b65cb3a9143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:11:59.956909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbc200-99cd-422c-b39a-9b65cb3a9143 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:11:59.957602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbc200-99cd-422c-b39a-9b65cb3a9143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:11:59.959486 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbc200-99cd-422c-b39a-9b65cb3a9143 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:00.040113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1287/2629] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:11:59 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:00.042283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660f7d1-0a17-4921-b590-77141c963e20 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:00.052515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660f7d1-0a17-4921-b590-77141c963e20 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:00.107357 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b0d13-75d2-4c8e-8fe9-64d856c2f7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:00.108033 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b0d13-75d2-4c8e-8fe9-64d856c2f7ac admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:00.108324 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b0d13-75d2-4c8e-8fe9-64d856c2f7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:00.108604 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b0d13-75d2-4c8e-8fe9-64d856c2f7ac admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:00.109275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b0d13-75d2-4c8e-8fe9-64d856c2f7ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:00.111262 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b0d13-75d2-4c8e-8fe9-64d856c2f7ac admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:00.117847 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:00.249822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1343/2630] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:12:00 2022] POST /identity/v3/users => generated 303 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:00.254082 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbc200-99cd-422c-b39a-9b65cb3a9143 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:00.265331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbc200-99cd-422c-b39a-9b65cb3a9143 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:00.270408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34618c-349d-4836-96f4-fddb893971b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:00.271064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34618c-349d-4836-96f4-fddb893971b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:00.271354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34618c-349d-4836-96f4-fddb893971b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:00.271632 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34618c-349d-4836-96f4-fddb893971b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:00.272394 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34618c-349d-4836-96f4-fddb893971b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:00.274011 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34618c-349d-4836-96f4-fddb893971b8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:00.284922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1288/2631] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:00.289164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b0d13-75d2-4c8e-8fe9-64d856c2f7ac admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:00.301225 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b0d13-75d2-4c8e-8fe9-64d856c2f7ac admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:00.306242 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d3609-b6e2-4a73-b796-5460490ed3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:00.307632 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d3609-b6e2-4a73-b796-5460490ed3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:00.308018 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d3609-b6e2-4a73-b796-5460490ed3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:00.308370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d3609-b6e2-4a73-b796-5460490ed3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:00.309166 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d3609-b6e2-4a73-b796-5460490ed3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:00.310884 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d3609-b6e2-4a73-b796-5460490ed3f4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:00.322943 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1344/2632] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:00.327046 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34618c-349d-4836-96f4-fddb893971b8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:00.337281 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34618c-349d-4836-96f4-fddb893971b8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:00.341888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c06e9-4f78-469b-bef1-bb96dcb416e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:00.342756 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c06e9-4f78-469b-bef1-bb96dcb416e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:00.343041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c06e9-4f78-469b-bef1-bb96dcb416e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:00.343320 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c06e9-4f78-469b-bef1-bb96dcb416e2 admin admin] PATH_INFO: `/v3/projects/1551eab54b0f4d05a0b58a1942727c55/users/75d31ca37b4e448ab4c84bc21547aacf/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:00.359136 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c06e9-4f78-469b-bef1-bb96dcb416e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1551eab54b0f4d05a0b58a1942727c55, user_id=75d31ca37b4e448ab4c84bc21547aacf, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:00.361819 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c06e9-4f78-469b-bef1-bb96dcb416e2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:00.433912 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1289/2633] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:12:00 2022] PUT /identity/v3/projects/1551eab54b0f4d05a0b58a1942727c55/users/75d31ca37b4e448ab4c84bc21547aacf/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:00.438901 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc06bf-2b39-47c6-b2bd-90163f9ffd61 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:00.439198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc06bf-2b39-47c6-b2bd-90163f9ffd61 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:00.439481 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc06bf-2b39-47c6-b2bd-90163f9ffd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:00.456605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-39cc06bf-2b39-47c6-b2bd-90163f9ffd61 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:00.457805 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-39cc06bf-2b39-47c6-b2bd-90163f9ffd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:00.516020 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1345/2634] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:00.525500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c06e9-4f78-469b-bef1-bb96dcb416e2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:00.527801 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3b5c06e9-4f78-469b-bef1-bb96dcb416e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:00.585654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c06e9-4f78-469b-bef1-bb96dcb416e2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:00.589915 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d5dd4-6b18-40b1-b98c-2c4c2829e01d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:00.590565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d5dd4-6b18-40b1-b98c-2c4c2829e01d service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:00.590851 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d5dd4-6b18-40b1-b98c-2c4c2829e01d service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:00.591133 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d5dd4-6b18-40b1-b98c-2c4c2829e01d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:00.600497 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d5dd4-6b18-40b1-b98c-2c4c2829e01d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:00.601931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d5dd4-6b18-40b1-b98c-2c4c2829e01d service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:00.612104 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1290/2635] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:01.960560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08464df7-475a-4ca7-967b-adf90f236d9c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:01.961110 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08464df7-475a-4ca7-967b-adf90f236d9c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:01.961375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08464df7-475a-4ca7-967b-adf90f236d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:01.989993 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-08464df7-475a-4ca7-967b-adf90f236d9c None None] MFA Rules not processed for user `75d31ca37b4e448ab4c84bc21547aacf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:01.991325 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-08464df7-475a-4ca7-967b-adf90f236d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:02.057336 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1346/2636] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:02.061902 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d5dd4-6b18-40b1-b98c-2c4c2829e01d service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:02.071601 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d5dd4-6b18-40b1-b98c-2c4c2829e01d service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:02.076498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7af02-fb54-4502-a52e-2f722727f2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:02.077146 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7af02-fb54-4502-a52e-2f722727f2f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:02.077433 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7af02-fb54-4502-a52e-2f722727f2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:02.077756 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7af02-fb54-4502-a52e-2f722727f2f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:02.078438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7af02-fb54-4502-a52e-2f722727f2f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:02.080373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7af02-fb54-4502-a52e-2f722727f2f1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:02.206676 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1291/2637] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:12:02 2022] POST /identity/v3/projects => generated 405 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:12:02.210736 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08464df7-475a-4ca7-967b-adf90f236d9c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:02.221848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08464df7-475a-4ca7-967b-adf90f236d9c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:02.279800 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53991b0d-8bae-4a9e-a1e3-d06287500157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:02.280499 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53991b0d-8bae-4a9e-a1e3-d06287500157 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:02.280888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53991b0d-8bae-4a9e-a1e3-d06287500157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:02.281174 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53991b0d-8bae-4a9e-a1e3-d06287500157 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:02.281854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53991b0d-8bae-4a9e-a1e3-d06287500157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:02.283770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53991b0d-8bae-4a9e-a1e3-d06287500157 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:02.371077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:02.377030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1347/2638] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:12:02 2022] POST /identity/v3/users => generated 309 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:02.381099 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7af02-fb54-4502-a52e-2f722727f2f1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:02.392276 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7af02-fb54-4502-a52e-2f722727f2f1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:02.396873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356a836-46e9-4185-8c35-517713e9d1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:02.399911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356a836-46e9-4185-8c35-517713e9d1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:02.399911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356a836-46e9-4185-8c35-517713e9d1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:02.399911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356a836-46e9-4185-8c35-517713e9d1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:02.399911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356a836-46e9-4185-8c35-517713e9d1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:02.400495 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356a836-46e9-4185-8c35-517713e9d1f3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:02.411501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1292/2639] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:02.415604 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53991b0d-8bae-4a9e-a1e3-d06287500157 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:02.425727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53991b0d-8bae-4a9e-a1e3-d06287500157 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:02.430369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629dc085-8088-4385-a3b2-cea0e3a60da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:02.431264 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dc085-8088-4385-a3b2-cea0e3a60da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:02.431553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dc085-8088-4385-a3b2-cea0e3a60da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:02.431835 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629dc085-8088-4385-a3b2-cea0e3a60da2 admin admin] PATH_INFO: `/v3/projects/a5baf51b1e7046559d8cec9a869ebfb5/users/0f01b58ced7c443fad5e9e20b85cf0c7/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:02.446168 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629dc085-8088-4385-a3b2-cea0e3a60da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5baf51b1e7046559d8cec9a869ebfb5, user_id=0f01b58ced7c443fad5e9e20b85cf0c7, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:02.449384 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629dc085-8088-4385-a3b2-cea0e3a60da2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:02.547940 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1348/2640] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:12:02 2022] PUT /identity/v3/projects/a5baf51b1e7046559d8cec9a869ebfb5/users/0f01b58ced7c443fad5e9e20b85cf0c7/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:02.551927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356a836-46e9-4185-8c35-517713e9d1f3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:02.561882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356a836-46e9-4185-8c35-517713e9d1f3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:02.604928 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:02.617271 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a36794-6fa5-41e5-ae78-f10e1f285f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:02.617926 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a36794-6fa5-41e5-ae78-f10e1f285f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:02.620483 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a36794-6fa5-41e5-ae78-f10e1f285f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:02.620483 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a36794-6fa5-41e5-ae78-f10e1f285f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:02.620483 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a36794-6fa5-41e5-ae78-f10e1f285f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:02.621638 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a36794-6fa5-41e5-ae78-f10e1f285f1b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:02.631349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1293/2641] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:02.637040 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629dc085-8088-4385-a3b2-cea0e3a60da2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:02.646556 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629dc085-8088-4385-a3b2-cea0e3a60da2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:02.651131 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a265fb-96c4-470f-aaf1-d01b9dc7b496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:02.652043 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a265fb-96c4-470f-aaf1-d01b9dc7b496 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:02.652331 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a265fb-96c4-470f-aaf1-d01b9dc7b496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:02.652607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a265fb-96c4-470f-aaf1-d01b9dc7b496 admin admin] PATH_INFO: `/v3/projects/a5baf51b1e7046559d8cec9a869ebfb5/users/0f01b58ced7c443fad5e9e20b85cf0c7/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:02.654568 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a265fb-96c4-470f-aaf1-d01b9dc7b496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5baf51b1e7046559d8cec9a869ebfb5, user_id=0f01b58ced7c443fad5e9e20b85cf0c7, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:02.657221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a265fb-96c4-470f-aaf1-d01b9dc7b496 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:02.667408 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1349/2642] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:12:02 2022] PUT /identity/v3/projects/a5baf51b1e7046559d8cec9a869ebfb5/users/0f01b58ced7c443fad5e9e20b85cf0c7/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:12:04.013548 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8efc59-d51f-4c8b-a4c5-d12e17a615dd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:04.014463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8efc59-d51f-4c8b-a4c5-d12e17a615dd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:04.014561 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8efc59-d51f-4c8b-a4c5-d12e17a615dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:04.045219 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1d8efc59-d51f-4c8b-a4c5-d12e17a615dd None None] MFA Rules not processed for user `0f01b58ced7c443fad5e9e20b85cf0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:04.046457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1d8efc59-d51f-4c8b-a4c5-d12e17a615dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:04.119681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1294/2643] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:04 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:04.679370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a265fb-96c4-470f-aaf1-d01b9dc7b496 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:04.680008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f7a265fb-96c4-470f-aaf1-d01b9dc7b496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:04.749977 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a265fb-96c4-470f-aaf1-d01b9dc7b496 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:04.754983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeee083-4656-4f75-9a8a-279499258173 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60a2abffc04ba59b65d5fca5e318a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:04.755661 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeee083-4656-4f75-9a8a-279499258173 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:04.755945 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeee083-4656-4f75-9a8a-279499258173 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:04.756253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeee083-4656-4f75-9a8a-279499258173 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:04.757979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ebeee083-4656-4f75-9a8a-279499258173 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:04.769905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeee083-4656-4f75-9a8a-279499258173 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:04.771414 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeee083-4656-4f75-9a8a-279499258173 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:04.781916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1350/2644] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:05.482785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8efc59-d51f-4c8b-a4c5-d12e17a615dd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:05.554660 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8efc59-d51f-4c8b-a4c5-d12e17a615dd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:05.561839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb337d7-6fcc-47a2-b7a8-27fe6eb6c090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:05.561839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb337d7-6fcc-47a2-b7a8-27fe6eb6c090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:05.561839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb337d7-6fcc-47a2-b7a8-27fe6eb6c090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:05.561839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb337d7-6fcc-47a2-b7a8-27fe6eb6c090 admin admin] PATH_INFO: `/v3/users/75d31ca37b4e448ab4c84bc21547aacf` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:05.562524 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb337d7-6fcc-47a2-b7a8-27fe6eb6c090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d31ca37b4e448ab4c84bc21547aacf)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:05.564498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb337d7-6fcc-47a2-b7a8-27fe6eb6c090 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:05.789890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8fb337d7-6fcc-47a2-b7a8-27fe6eb6c090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d31ca37b4e448ab4c84bc21547aacf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:05.802253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8fb337d7-6fcc-47a2-b7a8-27fe6eb6c090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d31ca37b4e448ab4c84bc21547aacf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:05.802884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8fb337d7-6fcc-47a2-b7a8-27fe6eb6c090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d31ca37b4e448ab4c84bc21547aacf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:05.808465 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:05.811353 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8fb337d7-6fcc-47a2-b7a8-27fe6eb6c090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d31ca37b4e448ab4c84bc21547aacf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:05.812035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8fb337d7-6fcc-47a2-b7a8-27fe6eb6c090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d31ca37b4e448ab4c84bc21547aacf'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:05.908801 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1295/2645] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:12:05 2022] DELETE /identity/v3/users/75d31ca37b4e448ab4c84bc21547aacf => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:06.149324 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeee083-4656-4f75-9a8a-279499258173 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:06.161171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeee083-4656-4f75-9a8a-279499258173 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:06.223021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:06.223876 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:06.224187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:06.224469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f admin admin] PATH_INFO: `/v3/projects/1551eab54b0f4d05a0b58a1942727c55` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:06.225693 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1551eab54b0f4d05a0b58a1942727c55)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:06.227723 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:06.342363 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1551eab54b0f4d05a0b58a1942727c55', 'request_id': 'req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:06.344813 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:06.445356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1551eab54b0f4d05a0b58a1942727c55', 'request_id': 'req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:06.452947 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1551eab54b0f4d05a0b58a1942727c55', 'request_id': 'req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:06.464719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f admin admin] The token cache is being invalidate because project 1551eab54b0f4d05a0b58a1942727c55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:12:06.466433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:06.466433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:06.467430 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1351/2646] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:12:06 2022] DELETE /identity/v3/projects/1551eab54b0f4d05a0b58a1942727c55 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:06.471359 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb337d7-6fcc-47a2-b7a8-27fe6eb6c090 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:06.472781 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8fb337d7-6fcc-47a2-b7a8-27fe6eb6c090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:06.487132 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb337d7-6fcc-47a2-b7a8-27fe6eb6c090 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:06.553187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e99e4-1fbd-4efd-9567-caccbd6c23f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:06.554072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e99e4-1fbd-4efd-9567-caccbd6c23f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:06.554358 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e99e4-1fbd-4efd-9567-caccbd6c23f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:06.554662 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e99e4-1fbd-4efd-9567-caccbd6c23f1 admin admin] PATH_INFO: `/v3/users/0f01b58ced7c443fad5e9e20b85cf0c7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:06.555830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e99e4-1fbd-4efd-9567-caccbd6c23f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f01b58ced7c443fad5e9e20b85cf0c7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:06.557788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e99e4-1fbd-4efd-9567-caccbd6c23f1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:06.740875 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-067e99e4-1fbd-4efd-9567-caccbd6c23f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f01b58ced7c443fad5e9e20b85cf0c7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:06.752700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-067e99e4-1fbd-4efd-9567-caccbd6c23f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f01b58ced7c443fad5e9e20b85cf0c7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:06.753370 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-067e99e4-1fbd-4efd-9567-caccbd6c23f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f01b58ced7c443fad5e9e20b85cf0c7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:06.760184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-067e99e4-1fbd-4efd-9567-caccbd6c23f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f01b58ced7c443fad5e9e20b85cf0c7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:06.761413 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-067e99e4-1fbd-4efd-9567-caccbd6c23f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f01b58ced7c443fad5e9e20b85cf0c7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:06.830479 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1296/2647] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:12:06 2022] DELETE /identity/v3/users/0f01b58ced7c443fad5e9e20b85cf0c7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:07.121002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:07.122433 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:07.136214 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ee4c2-f9eb-432a-8d39-bc6620dced1f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:07.193416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64842c-5784-4788-a216-2fa380ada523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:07.194317 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64842c-5784-4788-a216-2fa380ada523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:07.194603 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64842c-5784-4788-a216-2fa380ada523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:07.194889 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64842c-5784-4788-a216-2fa380ada523 admin admin] PATH_INFO: `/v3/projects/a5baf51b1e7046559d8cec9a869ebfb5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:07.196110 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64842c-5784-4788-a216-2fa380ada523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5baf51b1e7046559d8cec9a869ebfb5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:07.198051 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64842c-5784-4788-a216-2fa380ada523 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:07.328287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6f64842c-5784-4788-a216-2fa380ada523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5baf51b1e7046559d8cec9a869ebfb5', 'request_id': 'req-6f64842c-5784-4788-a216-2fa380ada523'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:07.414053 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6f64842c-5784-4788-a216-2fa380ada523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5baf51b1e7046559d8cec9a869ebfb5', 'request_id': 'req-6f64842c-5784-4788-a216-2fa380ada523'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:07.420799 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6f64842c-5784-4788-a216-2fa380ada523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5baf51b1e7046559d8cec9a869ebfb5', 'request_id': 'req-6f64842c-5784-4788-a216-2fa380ada523'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:07.431342 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6f64842c-5784-4788-a216-2fa380ada523 admin admin] The token cache is being invalidate because project a5baf51b1e7046559d8cec9a869ebfb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:12:07.431635 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6f64842c-5784-4788-a216-2fa380ada523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:07.435275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6f64842c-5784-4788-a216-2fa380ada523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:07.435275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1352/2648] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:12:07 2022] DELETE /identity/v3/projects/a5baf51b1e7046559d8cec9a869ebfb5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:07.438918 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97a571-6ffc-4d2f-9753-755aceae2c5e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:07.439214 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97a571-6ffc-4d2f-9753-755aceae2c5e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:07.439498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97a571-6ffc-4d2f-9753-755aceae2c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:07.457302 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0a97a571-6ffc-4d2f-9753-755aceae2c5e None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:07.458501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0a97a571-6ffc-4d2f-9753-755aceae2c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:07.518141 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1297/2649] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:07.525951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb7785-0adb-4b46-8a2a-9cd218c18454 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:07.527082 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb7785-0adb-4b46-8a2a-9cd218c18454 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:07.527369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb7785-0adb-4b46-8a2a-9cd218c18454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:07.545858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f9eb7785-0adb-4b46-8a2a-9cd218c18454 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:07.547061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f9eb7785-0adb-4b46-8a2a-9cd218c18454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:07.555643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1353/2650] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:07.560299 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97a571-6ffc-4d2f-9753-755aceae2c5e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:07.570052 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97a571-6ffc-4d2f-9753-755aceae2c5e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:07.575121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556e07d-df38-4aef-9fc4-453a212b413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:07.575762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556e07d-df38-4aef-9fc4-453a212b413e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:07.576075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556e07d-df38-4aef-9fc4-453a212b413e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:07.576361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556e07d-df38-4aef-9fc4-453a212b413e admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:07.577078 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556e07d-df38-4aef-9fc4-453a212b413e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:12:07.577389 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556e07d-df38-4aef-9fc4-453a212b413e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:07.579086 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556e07d-df38-4aef-9fc4-453a212b413e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:07.581757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:07.591360 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1298/2651] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:12:07.595775 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb7785-0adb-4b46-8a2a-9cd218c18454 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:07.605111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb7785-0adb-4b46-8a2a-9cd218c18454 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:07.609771 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f52e7a-b4b0-43f8-bb30-c0b8ca462aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:07.610415 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f52e7a-b4b0-43f8-bb30-c0b8ca462aed admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:07.610708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f52e7a-b4b0-43f8-bb30-c0b8ca462aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:07.610989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f52e7a-b4b0-43f8-bb30-c0b8ca462aed admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:07.611715 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f52e7a-b4b0-43f8-bb30-c0b8ca462aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:07.613721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f52e7a-b4b0-43f8-bb30-c0b8ca462aed admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:07.729954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1354/2652] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:12:07 2022] POST /identity/v3/projects => generated 363 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:07.734102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556e07d-df38-4aef-9fc4-453a212b413e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:07.744062 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556e07d-df38-4aef-9fc4-453a212b413e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:07.800237 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaabf30-2e13-4fa2-94a3-c01422c279ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:07.800901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaabf30-2e13-4fa2-94a3-c01422c279ef admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:07.801196 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaabf30-2e13-4fa2-94a3-c01422c279ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:07.801486 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaabf30-2e13-4fa2-94a3-c01422c279ef admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:07.802181 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaabf30-2e13-4fa2-94a3-c01422c279ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:07.804109 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaabf30-2e13-4fa2-94a3-c01422c279ef admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:07.913457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1299/2653] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:12:07 2022] POST /identity/v3/users => generated 282 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:12:07.918424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f52e7a-b4b0-43f8-bb30-c0b8ca462aed admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:07.928969 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f52e7a-b4b0-43f8-bb30-c0b8ca462aed admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:07.934235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d62d5a-6052-44f3-ba68-c8b77d622853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:07.934895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d62d5a-6052-44f3-ba68-c8b77d622853 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:07.935183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d62d5a-6052-44f3-ba68-c8b77d622853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:07.935465 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d62d5a-6052-44f3-ba68-c8b77d622853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:07.936219 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d62d5a-6052-44f3-ba68-c8b77d622853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:07.937828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d62d5a-6052-44f3-ba68-c8b77d622853 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:07.948065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1355/2654] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:07.952153 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaabf30-2e13-4fa2-94a3-c01422c279ef admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:07.962602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaabf30-2e13-4fa2-94a3-c01422c279ef admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:07.967560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ef105-3e6e-489d-8878-5473b1b85d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:07.968253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ef105-3e6e-489d-8878-5473b1b85d94 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:07.968542 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ef105-3e6e-489d-8878-5473b1b85d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:07.968844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ef105-3e6e-489d-8878-5473b1b85d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:07.969570 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ef105-3e6e-489d-8878-5473b1b85d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:07.971165 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ef105-3e6e-489d-8878-5473b1b85d94 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:07.981755 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1300/2655] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:12:07.985964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d62d5a-6052-44f3-ba68-c8b77d622853 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:07.996685 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d62d5a-6052-44f3-ba68-c8b77d622853 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:08.001362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc367c-b286-4143-96a9-115df2488745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:08.002233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc367c-b286-4143-96a9-115df2488745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:08.002523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc367c-b286-4143-96a9-115df2488745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:08.002803 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc367c-b286-4143-96a9-115df2488745 admin admin] PATH_INFO: `/v3/projects/2bed56732989405283d8576880ada899/users/755f9c86e5b34476bff21cc0b6c6abc2/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:08.017798 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc367c-b286-4143-96a9-115df2488745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bed56732989405283d8576880ada899, user_id=755f9c86e5b34476bff21cc0b6c6abc2, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:08.020527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc367c-b286-4143-96a9-115df2488745 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:08.114120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:08.119742 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1356/2656] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:12:07 2022] PUT /identity/v3/projects/2bed56732989405283d8576880ada899/users/755f9c86e5b34476bff21cc0b6c6abc2/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:08.131548 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325484f4-8248-4513-b74b-5108e42fabbd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:08.131844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325484f4-8248-4513-b74b-5108e42fabbd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:08.132162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325484f4-8248-4513-b74b-5108e42fabbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:08.158281 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-325484f4-8248-4513-b74b-5108e42fabbd None None] MFA Rules not processed for user `755f9c86e5b34476bff21cc0b6c6abc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:08.159497 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-325484f4-8248-4513-b74b-5108e42fabbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:08.223552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1301/2657] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:08.228154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc367c-b286-4143-96a9-115df2488745 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:08.290467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc367c-b286-4143-96a9-115df2488745 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:08.295880 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dad41-776b-473e-a552-99a7c5e3f060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:08.296570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dad41-776b-473e-a552-99a7c5e3f060 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:08.296859 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dad41-776b-473e-a552-99a7c5e3f060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:08.297139 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dad41-776b-473e-a552-99a7c5e3f060 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:08.297821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2dad41-776b-473e-a552-99a7c5e3f060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:08.299892 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2dad41-776b-473e-a552-99a7c5e3f060 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:08.383464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1357/2658] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:12:08 2022] POST /identity/v3/projects => generated 363 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:08.387583 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325484f4-8248-4513-b74b-5108e42fabbd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:08.398708 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325484f4-8248-4513-b74b-5108e42fabbd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:08.454356 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c55ba-1d44-4a9a-a6f1-a79ef7962be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:08.455026 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c55ba-1d44-4a9a-a6f1-a79ef7962be5 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:08.455316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c55ba-1d44-4a9a-a6f1-a79ef7962be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:08.455603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c55ba-1d44-4a9a-a6f1-a79ef7962be5 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:08.456341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c55ba-1d44-4a9a-a6f1-a79ef7962be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:08.458270 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c55ba-1d44-4a9a-a6f1-a79ef7962be5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:08.466192 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:08.565041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1302/2659] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:12:08 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:08.569041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dad41-776b-473e-a552-99a7c5e3f060 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:08.579371 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dad41-776b-473e-a552-99a7c5e3f060 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:08.584081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee8402-42f0-45fd-8c01-0e8ae6658da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:08.584737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee8402-42f0-45fd-8c01-0e8ae6658da1 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:08.585028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee8402-42f0-45fd-8c01-0e8ae6658da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:08.585311 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee8402-42f0-45fd-8c01-0e8ae6658da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:08.586033 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee8402-42f0-45fd-8c01-0e8ae6658da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:08.587637 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee8402-42f0-45fd-8c01-0e8ae6658da1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:08.598555 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1358/2660] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:08.602498 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c55ba-1d44-4a9a-a6f1-a79ef7962be5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:08.612943 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c55ba-1d44-4a9a-a6f1-a79ef7962be5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:08.617504 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e70e2-4bc1-45c5-b129-21fa3f55d41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:08.618374 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e70e2-4bc1-45c5-b129-21fa3f55d41d admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:08.618658 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e70e2-4bc1-45c5-b129-21fa3f55d41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:08.618937 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e70e2-4bc1-45c5-b129-21fa3f55d41d admin admin] PATH_INFO: `/v3/projects/a04c95a9fbbe4c648fcfe2697e001ef6/users/06c619926d804688bdfb0afa9baf660f/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:08.633173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e70e2-4bc1-45c5-b129-21fa3f55d41d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04c95a9fbbe4c648fcfe2697e001ef6, user_id=06c619926d804688bdfb0afa9baf660f, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:08.636300 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e70e2-4bc1-45c5-b129-21fa3f55d41d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:08.719713 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1303/2661] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:12:08 2022] PUT /identity/v3/projects/a04c95a9fbbe4c648fcfe2697e001ef6/users/06c619926d804688bdfb0afa9baf660f/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:08.723602 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee8402-42f0-45fd-8c01-0e8ae6658da1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:08.735030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee8402-42f0-45fd-8c01-0e8ae6658da1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:08.790000 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55de2ac-a9f4-4d6f-a073-bb6caf12b8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:08.790659 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55de2ac-a9f4-4d6f-a073-bb6caf12b8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:08.790946 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55de2ac-a9f4-4d6f-a073-bb6caf12b8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:08.791228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55de2ac-a9f4-4d6f-a073-bb6caf12b8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:08.791933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55de2ac-a9f4-4d6f-a073-bb6caf12b8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:08.793544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55de2ac-a9f4-4d6f-a073-bb6caf12b8d0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:08.802919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1359/2662] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:08.806927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e70e2-4bc1-45c5-b129-21fa3f55d41d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:08.817425 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e70e2-4bc1-45c5-b129-21fa3f55d41d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:08.822035 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975fc0c-673b-4043-bc30-78da8cf86815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:08.823509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975fc0c-673b-4043-bc30-78da8cf86815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:08.823977 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975fc0c-673b-4043-bc30-78da8cf86815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:08.824455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975fc0c-673b-4043-bc30-78da8cf86815 admin admin] PATH_INFO: `/v3/projects/a04c95a9fbbe4c648fcfe2697e001ef6/users/06c619926d804688bdfb0afa9baf660f/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:08.826574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975fc0c-673b-4043-bc30-78da8cf86815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04c95a9fbbe4c648fcfe2697e001ef6, user_id=06c619926d804688bdfb0afa9baf660f, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:08.829342 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975fc0c-673b-4043-bc30-78da8cf86815 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:08.839645 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1304/2663] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:12:08 2022] PUT /identity/v3/projects/a04c95a9fbbe4c648fcfe2697e001ef6/users/06c619926d804688bdfb0afa9baf660f/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:08.849454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e5dc2-d092-4f76-b789-fd7d90756a4d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:08.849752 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e5dc2-d092-4f76-b789-fd7d90756a4d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:08.850063 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e5dc2-d092-4f76-b789-fd7d90756a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:08.877861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5e7e5dc2-d092-4f76-b789-fd7d90756a4d None None] MFA Rules not processed for user `06c619926d804688bdfb0afa9baf660f`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:08.879126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5e7e5dc2-d092-4f76-b789-fd7d90756a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:08.936286 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:08.946016 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1360/2664] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:08 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:08.958296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975fc0c-673b-4043-bc30-78da8cf86815 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:08.959193 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4975fc0c-673b-4043-bc30-78da8cf86815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:09.016054 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975fc0c-673b-4043-bc30-78da8cf86815 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:09.019691 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd409181-a3de-4671-ab71-a822b7dae23e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:09.020354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd409181-a3de-4671-ab71-a822b7dae23e service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:09.020639 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd409181-a3de-4671-ab71-a822b7dae23e service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:09.020915 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd409181-a3de-4671-ab71-a822b7dae23e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:09.030393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd409181-a3de-4671-ab71-a822b7dae23e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:09.031816 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd409181-a3de-4671-ab71-a822b7dae23e service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:09.041221 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1305/2665] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:08 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:09.923666 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e5dc2-d092-4f76-b789-fd7d90756a4d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:09.990102 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e5dc2-d092-4f76-b789-fd7d90756a4d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:09.994755 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9823d6-a22e-42d4-8d1a-5fa3c2c4d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:09.995625 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9823d6-a22e-42d4-8d1a-5fa3c2c4d4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:09.995911 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9823d6-a22e-42d4-8d1a-5fa3c2c4d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:09.996244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9823d6-a22e-42d4-8d1a-5fa3c2c4d4c9 admin admin] PATH_INFO: `/v3/users/755f9c86e5b34476bff21cc0b6c6abc2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:09.997417 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9823d6-a22e-42d4-8d1a-5fa3c2c4d4c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=755f9c86e5b34476bff21cc0b6c6abc2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:09.999374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9823d6-a22e-42d4-8d1a-5fa3c2c4d4c9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:10.213105 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e9823d6-a22e-42d4-8d1a-5fa3c2c4d4c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '755f9c86e5b34476bff21cc0b6c6abc2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:10.214226 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e9823d6-a22e-42d4-8d1a-5fa3c2c4d4c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '755f9c86e5b34476bff21cc0b6c6abc2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:10.290774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e9823d6-a22e-42d4-8d1a-5fa3c2c4d4c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '755f9c86e5b34476bff21cc0b6c6abc2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:10.298291 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e9823d6-a22e-42d4-8d1a-5fa3c2c4d4c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '755f9c86e5b34476bff21cc0b6c6abc2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:10.301780 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8e9823d6-a22e-42d4-8d1a-5fa3c2c4d4c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '755f9c86e5b34476bff21cc0b6c6abc2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:10.315937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1361/2666] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:12:09 2022] DELETE /identity/v3/users/755f9c86e5b34476bff21cc0b6c6abc2 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:10.320548 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843deb8c-6500-411a-b56e-a8baa6674622 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:10.321051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843deb8c-6500-411a-b56e-a8baa6674622 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:10.321160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843deb8c-6500-411a-b56e-a8baa6674622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:10.339829 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-843deb8c-6500-411a-b56e-a8baa6674622 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:10.341103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-843deb8c-6500-411a-b56e-a8baa6674622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:10.400285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1306/2667] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:10.410538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9823d6-a22e-42d4-8d1a-5fa3c2c4d4c9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:10.411940 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8e9823d6-a22e-42d4-8d1a-5fa3c2c4d4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:10.467921 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9823d6-a22e-42d4-8d1a-5fa3c2c4d4c9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:10.471532 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69b33d-4cd5-40a4-93ae-92d8e614c4de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:10.472202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69b33d-4cd5-40a4-93ae-92d8e614c4de service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:10.472488 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69b33d-4cd5-40a4-93ae-92d8e614c4de service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:10.472794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69b33d-4cd5-40a4-93ae-92d8e614c4de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:10.481709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69b33d-4cd5-40a4-93ae-92d8e614c4de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:10.483150 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69b33d-4cd5-40a4-93ae-92d8e614c4de service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:10.492541 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1362/2668] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:10.946449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843deb8c-6500-411a-b56e-a8baa6674622 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:10.947959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-843deb8c-6500-411a-b56e-a8baa6674622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:10.960705 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843deb8c-6500-411a-b56e-a8baa6674622 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:10.965705 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:10.966561 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:10.966851 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:10.967134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2 admin admin] PATH_INFO: `/v3/projects/2bed56732989405283d8576880ada899` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:10.968352 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bed56732989405283d8576880ada899)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:10.970278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:11.088616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bed56732989405283d8576880ada899', 'request_id': 'req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:11.090550 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:11.094380 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bed56732989405283d8576880ada899', 'request_id': 'req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:11.193548 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bed56732989405283d8576880ada899', 'request_id': 'req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:11.205501 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2 admin admin] The token cache is being invalidate because project 2bed56732989405283d8576880ada899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:12:11.205790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:11.206439 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:11.207961 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1307/2669] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:12:10 2022] DELETE /identity/v3/projects/2bed56732989405283d8576880ada899 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:11.211961 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69b33d-4cd5-40a4-93ae-92d8e614c4de service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:11.221774 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69b33d-4cd5-40a4-93ae-92d8e614c4de service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:11.233713 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:11.278687 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896318f-0aed-493b-b04b-ae6dd23e5728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:11.279491 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896318f-0aed-493b-b04b-ae6dd23e5728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:11.279777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896318f-0aed-493b-b04b-ae6dd23e5728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:11.280094 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896318f-0aed-493b-b04b-ae6dd23e5728 admin admin] PATH_INFO: `/v3/users/06c619926d804688bdfb0afa9baf660f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:11.281287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896318f-0aed-493b-b04b-ae6dd23e5728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c619926d804688bdfb0afa9baf660f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:11.283229 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896318f-0aed-493b-b04b-ae6dd23e5728 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:11.550168 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0896318f-0aed-493b-b04b-ae6dd23e5728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c619926d804688bdfb0afa9baf660f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:11.550772 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0896318f-0aed-493b-b04b-ae6dd23e5728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c619926d804688bdfb0afa9baf660f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:11.684966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0896318f-0aed-493b-b04b-ae6dd23e5728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c619926d804688bdfb0afa9baf660f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:11.695293 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0896318f-0aed-493b-b04b-ae6dd23e5728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c619926d804688bdfb0afa9baf660f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:11.698641 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0896318f-0aed-493b-b04b-ae6dd23e5728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c619926d804688bdfb0afa9baf660f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:11.717461 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1363/2670] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:12:11 2022] DELETE /identity/v3/users/06c619926d804688bdfb0afa9baf660f => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:12.164003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:12.164003 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:12.175666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e920b5-388c-4cf2-b0ca-a048f2ff0da2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:12.233042 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f7c58-e9c4-43d5-b4bc-c9405666f3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:12.233904 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f7c58-e9c4-43d5-b4bc-c9405666f3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:12.234191 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f7c58-e9c4-43d5-b4bc-c9405666f3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:12.234472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f7c58-e9c4-43d5-b4bc-c9405666f3ef admin admin] PATH_INFO: `/v3/projects/a04c95a9fbbe4c648fcfe2697e001ef6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:12.235670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f7c58-e9c4-43d5-b4bc-c9405666f3ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a04c95a9fbbe4c648fcfe2697e001ef6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:12.237630 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f7c58-e9c4-43d5-b4bc-c9405666f3ef admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:12.359809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0d2f7c58-e9c4-43d5-b4bc-c9405666f3ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a04c95a9fbbe4c648fcfe2697e001ef6', 'request_id': 'req-0d2f7c58-e9c4-43d5-b4bc-c9405666f3ef'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:12.365405 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0d2f7c58-e9c4-43d5-b4bc-c9405666f3ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a04c95a9fbbe4c648fcfe2697e001ef6', 'request_id': 'req-0d2f7c58-e9c4-43d5-b4bc-c9405666f3ef'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:12.453727 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0d2f7c58-e9c4-43d5-b4bc-c9405666f3ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a04c95a9fbbe4c648fcfe2697e001ef6', 'request_id': 'req-0d2f7c58-e9c4-43d5-b4bc-c9405666f3ef'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:12.465882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0d2f7c58-e9c4-43d5-b4bc-c9405666f3ef admin admin] The token cache is being invalidate because project a04c95a9fbbe4c648fcfe2697e001ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:12:12.466175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0d2f7c58-e9c4-43d5-b4bc-c9405666f3ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:12.469912 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0d2f7c58-e9c4-43d5-b4bc-c9405666f3ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:12.469912 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1308/2671] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:12:12 2022] DELETE /identity/v3/projects/a04c95a9fbbe4c648fcfe2697e001ef6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:12.473329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a905e4d-cc91-4cb9-abc4-539cad59d059 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:12.473795 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a905e4d-cc91-4cb9-abc4-539cad59d059 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:12.473903 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a905e4d-cc91-4cb9-abc4-539cad59d059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:12.492827 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4a905e4d-cc91-4cb9-abc4-539cad59d059 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:12.494057 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4a905e4d-cc91-4cb9-abc4-539cad59d059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:12.552343 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1364/2672] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:12.560040 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0d34e-3fd1-4e63-85a6-b55b11e19bad None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:12.560341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0d34e-3fd1-4e63-85a6-b55b11e19bad None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:12.560630 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0d34e-3fd1-4e63-85a6-b55b11e19bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:12.579948 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-45f0d34e-3fd1-4e63-85a6-b55b11e19bad None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:12.592394 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-45f0d34e-3fd1-4e63-85a6-b55b11e19bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:12.596817 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1309/2673] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:12.601282 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a905e4d-cc91-4cb9-abc4-539cad59d059 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:12.611627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a905e4d-cc91-4cb9-abc4-539cad59d059 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:12.616196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea39aa-402f-47df-a85a-610e79570140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:12.616841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea39aa-402f-47df-a85a-610e79570140 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:12.617124 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea39aa-402f-47df-a85a-610e79570140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:12.617398 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea39aa-402f-47df-a85a-610e79570140 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:12.618113 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea39aa-402f-47df-a85a-610e79570140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:12:12.618578 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea39aa-402f-47df-a85a-610e79570140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:12.620153 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea39aa-402f-47df-a85a-610e79570140 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:12.631764 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1365/2674] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:12:12.636656 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0d34e-3fd1-4e63-85a6-b55b11e19bad None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:12.646379 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0d34e-3fd1-4e63-85a6-b55b11e19bad None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:12.651771 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8eb4f-500b-451a-beee-de4b6a7539a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:12.652451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8eb4f-500b-451a-beee-de4b6a7539a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:12.652761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8eb4f-500b-451a-beee-de4b6a7539a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:12.653045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8eb4f-500b-451a-beee-de4b6a7539a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:12.653764 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8eb4f-500b-451a-beee-de4b6a7539a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:12.655764 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8eb4f-500b-451a-beee-de4b6a7539a6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:12.780034 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1310/2675] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:12:12 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:12.782494 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea39aa-402f-47df-a85a-610e79570140 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:12.792748 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea39aa-402f-47df-a85a-610e79570140 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:12.811980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:12.850909 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a623e3f-e976-4c83-b3d2-ac1b639cab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:12.851586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a623e3f-e976-4c83-b3d2-ac1b639cab65 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:12.851872 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a623e3f-e976-4c83-b3d2-ac1b639cab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:12.852178 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a623e3f-e976-4c83-b3d2-ac1b639cab65 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:12.852862 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a623e3f-e976-4c83-b3d2-ac1b639cab65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:12.854825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a623e3f-e976-4c83-b3d2-ac1b639cab65 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:12.957474 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1366/2676] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:12:12 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:12.961546 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8eb4f-500b-451a-beee-de4b6a7539a6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:12.971761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8eb4f-500b-451a-beee-de4b6a7539a6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:12.977567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1c143-ad44-4e8e-ab2b-3a0f77588d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:12.977567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1c143-ad44-4e8e-ab2b-3a0f77588d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:12.977567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1c143-ad44-4e8e-ab2b-3a0f77588d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:12.977567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1c143-ad44-4e8e-ab2b-3a0f77588d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:12.978243 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1c143-ad44-4e8e-ab2b-3a0f77588d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:12.979839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1c143-ad44-4e8e-ab2b-3a0f77588d6c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:12.990117 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1311/2677] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:12.993863 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a623e3f-e976-4c83-b3d2-ac1b639cab65 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:13.004176 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a623e3f-e976-4c83-b3d2-ac1b639cab65 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:13.008873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7dae1-66a6-49ca-bb99-05eab4e494bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:13.009523 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7dae1-66a6-49ca-bb99-05eab4e494bf admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:13.009808 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7dae1-66a6-49ca-bb99-05eab4e494bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:13.010087 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7dae1-66a6-49ca-bb99-05eab4e494bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:13.011390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7dae1-66a6-49ca-bb99-05eab4e494bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:13.013046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7dae1-66a6-49ca-bb99-05eab4e494bf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:13.023522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1367/2678] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:13.027481 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1c143-ad44-4e8e-ab2b-3a0f77588d6c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:13.037203 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1c143-ad44-4e8e-ab2b-3a0f77588d6c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:13.041806 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57c186-93d2-4f37-ac9f-242ccec0502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:13.042673 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c186-93d2-4f37-ac9f-242ccec0502c admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:13.042957 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c186-93d2-4f37-ac9f-242ccec0502c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:13.043233 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c186-93d2-4f37-ac9f-242ccec0502c admin admin] PATH_INFO: `/v3/projects/ab59a82b414b4aa88a97617f847b126e/users/416d1c239acb466183d67036e68dafc8/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:13.057909 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57c186-93d2-4f37-ac9f-242ccec0502c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab59a82b414b4aa88a97617f847b126e, user_id=416d1c239acb466183d67036e68dafc8, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:13.060556 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57c186-93d2-4f37-ac9f-242ccec0502c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:13.127874 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1312/2679] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:12:13 2022] PUT /identity/v3/projects/ab59a82b414b4aa88a97617f847b126e/users/416d1c239acb466183d67036e68dafc8/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:13.139863 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f2847-630e-4b51-8ebc-2799b68fa521 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:13.140211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f2847-630e-4b51-8ebc-2799b68fa521 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:13.140611 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f2847-630e-4b51-8ebc-2799b68fa521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:13.166493 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3e6f2847-630e-4b51-8ebc-2799b68fa521 None None] MFA Rules not processed for user `416d1c239acb466183d67036e68dafc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:13.168231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3e6f2847-630e-4b51-8ebc-2799b68fa521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:13.230950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1368/2680] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:13.235533 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57c186-93d2-4f37-ac9f-242ccec0502c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:13.244648 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:13.297624 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57c186-93d2-4f37-ac9f-242ccec0502c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:13.302354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1471ec-143a-43af-a780-a93c66c04aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:13.303001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1471ec-143a-43af-a780-a93c66c04aea admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:13.303288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1471ec-143a-43af-a780-a93c66c04aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:13.303568 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1471ec-143a-43af-a780-a93c66c04aea admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:13.304329 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1471ec-143a-43af-a780-a93c66c04aea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:13.306325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1471ec-143a-43af-a780-a93c66c04aea admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:13.377672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1313/2681] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:12:13 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:13.381750 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f2847-630e-4b51-8ebc-2799b68fa521 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:13.393301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f2847-630e-4b51-8ebc-2799b68fa521 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:13.449938 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ee4ea-82d6-4dc2-920a-950f7a9b95a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:13.450613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee4ea-82d6-4dc2-920a-950f7a9b95a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:13.450905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee4ea-82d6-4dc2-920a-950f7a9b95a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:13.451191 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee4ea-82d6-4dc2-920a-950f7a9b95a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:13.451902 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ee4ea-82d6-4dc2-920a-950f7a9b95a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:13.453893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ee4ea-82d6-4dc2-920a-950f7a9b95a6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:13.551123 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1369/2682] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:12:13 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:13.555265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1471ec-143a-43af-a780-a93c66c04aea admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:13.566514 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1471ec-143a-43af-a780-a93c66c04aea admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:13.571231 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c9a72-09bd-4a71-b8b6-8ed932ddc16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:13.571892 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c9a72-09bd-4a71-b8b6-8ed932ddc16d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:13.572232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c9a72-09bd-4a71-b8b6-8ed932ddc16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:13.572520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c9a72-09bd-4a71-b8b6-8ed932ddc16d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:13.573839 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c9a72-09bd-4a71-b8b6-8ed932ddc16d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:13.575500 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c9a72-09bd-4a71-b8b6-8ed932ddc16d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:13.585961 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1314/2683] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:13.589905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ee4ea-82d6-4dc2-920a-950f7a9b95a6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:13.599838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ee4ea-82d6-4dc2-920a-950f7a9b95a6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:13.604505 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdc0b8-fd64-4dfd-97c9-eacc91cbf326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:13.605380 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdc0b8-fd64-4dfd-97c9-eacc91cbf326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:13.605672 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdc0b8-fd64-4dfd-97c9-eacc91cbf326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:13.605957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdc0b8-fd64-4dfd-97c9-eacc91cbf326 admin admin] PATH_INFO: `/v3/projects/62719e5c14834fa28fb32204613d89d7/users/de034b41ad1746a393a9c9a0e5baa927/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:13.620742 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdc0b8-fd64-4dfd-97c9-eacc91cbf326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62719e5c14834fa28fb32204613d89d7, user_id=de034b41ad1746a393a9c9a0e5baa927, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:13.623383 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdc0b8-fd64-4dfd-97c9-eacc91cbf326 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:13.627002 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:13.690235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1370/2684] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:12:13 2022] PUT /identity/v3/projects/62719e5c14834fa28fb32204613d89d7/users/de034b41ad1746a393a9c9a0e5baa927/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:12:13.694246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c9a72-09bd-4a71-b8b6-8ed932ddc16d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:13.705085 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c9a72-09bd-4a71-b8b6-8ed932ddc16d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:13.760263 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615b8ba-7650-470e-bcd2-b38bcdd3c581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:13.761472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615b8ba-7650-470e-bcd2-b38bcdd3c581 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:13.761763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615b8ba-7650-470e-bcd2-b38bcdd3c581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:13.762063 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615b8ba-7650-470e-bcd2-b38bcdd3c581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:13.762761 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615b8ba-7650-470e-bcd2-b38bcdd3c581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:13.764700 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615b8ba-7650-470e-bcd2-b38bcdd3c581 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:13.774410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1315/2685] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:13.778483 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdc0b8-fd64-4dfd-97c9-eacc91cbf326 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:13.788529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdc0b8-fd64-4dfd-97c9-eacc91cbf326 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:13.793279 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31719d62-d380-4d24-8b0d-02b90ea3ec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:13.794157 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31719d62-d380-4d24-8b0d-02b90ea3ec38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:13.794467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31719d62-d380-4d24-8b0d-02b90ea3ec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:13.794746 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31719d62-d380-4d24-8b0d-02b90ea3ec38 admin admin] PATH_INFO: `/v3/projects/62719e5c14834fa28fb32204613d89d7/users/de034b41ad1746a393a9c9a0e5baa927/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:13.796725 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31719d62-d380-4d24-8b0d-02b90ea3ec38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62719e5c14834fa28fb32204613d89d7, user_id=de034b41ad1746a393a9c9a0e5baa927, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:13.799334 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31719d62-d380-4d24-8b0d-02b90ea3ec38 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:13.809944 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1371/2686] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:12:13 2022] PUT /identity/v3/projects/62719e5c14834fa28fb32204613d89d7/users/de034b41ad1746a393a9c9a0e5baa927/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:13.819599 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a18477-7ed9-46f0-aa5e-0823b9260a53 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:13.819917 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a18477-7ed9-46f0-aa5e-0823b9260a53 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:13.820235 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a18477-7ed9-46f0-aa5e-0823b9260a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:13.846844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e7a18477-7ed9-46f0-aa5e-0823b9260a53 None None] MFA Rules not processed for user `de034b41ad1746a393a9c9a0e5baa927`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:13.848090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e7a18477-7ed9-46f0-aa5e-0823b9260a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:13.917192 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1316/2687] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:13.930390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31719d62-d380-4d24-8b0d-02b90ea3ec38 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:13.930781 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-31719d62-d380-4d24-8b0d-02b90ea3ec38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:13.999062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31719d62-d380-4d24-8b0d-02b90ea3ec38 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:14.004513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2134ea-48da-4a34-a4c0-7093e523b944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:14.004513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2134ea-48da-4a34-a4c0-7093e523b944 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:14.004513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2134ea-48da-4a34-a4c0-7093e523b944 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:14.004513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2134ea-48da-4a34-a4c0-7093e523b944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:14.014424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2134ea-48da-4a34-a4c0-7093e523b944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:14.015878 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2134ea-48da-4a34-a4c0-7093e523b944 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:14.026464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1372/2688] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:14.053966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a18477-7ed9-46f0-aa5e-0823b9260a53 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:14.062009 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:14.120809 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a18477-7ed9-46f0-aa5e-0823b9260a53 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:14.125555 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c3664-d676-4afb-a931-1afb35e724a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:14.126423 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c3664-d676-4afb-a931-1afb35e724a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:14.126775 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c3664-d676-4afb-a931-1afb35e724a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:14.126984 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c3664-d676-4afb-a931-1afb35e724a0 admin admin] PATH_INFO: `/v3/users/416d1c239acb466183d67036e68dafc8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:14.128207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c3664-d676-4afb-a931-1afb35e724a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=416d1c239acb466183d67036e68dafc8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:14.130663 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c3664-d676-4afb-a931-1afb35e724a0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:14.416291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-138c3664-d676-4afb-a931-1afb35e724a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '416d1c239acb466183d67036e68dafc8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:14.428715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-138c3664-d676-4afb-a931-1afb35e724a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '416d1c239acb466183d67036e68dafc8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:14.429378 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-138c3664-d676-4afb-a931-1afb35e724a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '416d1c239acb466183d67036e68dafc8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:14.436138 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-138c3664-d676-4afb-a931-1afb35e724a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '416d1c239acb466183d67036e68dafc8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:14.436762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-138c3664-d676-4afb-a931-1afb35e724a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '416d1c239acb466183d67036e68dafc8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:14.568288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1317/2689] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:12:14 2022] DELETE /identity/v3/users/416d1c239acb466183d67036e68dafc8 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:14.572769 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d06b47-cb66-41ae-a2f4-ca9314d063aa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:14.573221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d06b47-cb66-41ae-a2f4-ca9314d063aa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:14.573363 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d06b47-cb66-41ae-a2f4-ca9314d063aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:14.590768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-83d06b47-cb66-41ae-a2f4-ca9314d063aa None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:14.602045 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-83d06b47-cb66-41ae-a2f4-ca9314d063aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:14.655777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1373/2690] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:14.665260 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c3664-d676-4afb-a931-1afb35e724a0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:14.666650 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-138c3664-d676-4afb-a931-1afb35e724a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:14.723450 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c3664-d676-4afb-a931-1afb35e724a0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:14.727046 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b7e4f-fdea-427c-9037-cadb357b30a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:14.727687 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b7e4f-fdea-427c-9037-cadb357b30a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:14.727975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b7e4f-fdea-427c-9037-cadb357b30a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:14.728288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b7e4f-fdea-427c-9037-cadb357b30a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:14.737140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b7e4f-fdea-427c-9037-cadb357b30a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:14.738854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b7e4f-fdea-427c-9037-cadb357b30a4 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:14.748218 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1318/2691] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:15.177659 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d06b47-cb66-41ae-a2f4-ca9314d063aa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:15.179317 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-83d06b47-cb66-41ae-a2f4-ca9314d063aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:15.208004 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d06b47-cb66-41ae-a2f4-ca9314d063aa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:15.214738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b7682-8b1f-4db0-9cdf-80120f72b79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:15.215723 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b7682-8b1f-4db0-9cdf-80120f72b79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:15.216157 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b7682-8b1f-4db0-9cdf-80120f72b79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:15.216519 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b7682-8b1f-4db0-9cdf-80120f72b79b admin admin] PATH_INFO: `/v3/projects/ab59a82b414b4aa88a97617f847b126e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:15.217849 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b7682-8b1f-4db0-9cdf-80120f72b79b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab59a82b414b4aa88a97617f847b126e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:15.219848 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b7682-8b1f-4db0-9cdf-80120f72b79b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:15.386263 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e61b7682-8b1f-4db0-9cdf-80120f72b79b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab59a82b414b4aa88a97617f847b126e', 'request_id': 'req-e61b7682-8b1f-4db0-9cdf-80120f72b79b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:15.467905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e61b7682-8b1f-4db0-9cdf-80120f72b79b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab59a82b414b4aa88a97617f847b126e', 'request_id': 'req-e61b7682-8b1f-4db0-9cdf-80120f72b79b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:15.474798 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e61b7682-8b1f-4db0-9cdf-80120f72b79b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab59a82b414b4aa88a97617f847b126e', 'request_id': 'req-e61b7682-8b1f-4db0-9cdf-80120f72b79b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:15.485667 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e61b7682-8b1f-4db0-9cdf-80120f72b79b admin admin] The token cache is being invalidate because project ab59a82b414b4aa88a97617f847b126e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:12:15.485961 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e61b7682-8b1f-4db0-9cdf-80120f72b79b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:15.486594 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e61b7682-8b1f-4db0-9cdf-80120f72b79b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:15.488156 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1374/2692] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:12:15 2022] DELETE /identity/v3/projects/ab59a82b414b4aa88a97617f847b126e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:15.492219 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b7e4f-fdea-427c-9037-cadb357b30a4 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:15.502548 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b7e4f-fdea-427c-9037-cadb357b30a4 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:15.522396 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:15.560804 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd6ead-5505-4a6e-bc60-f3f4cce7c620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:15.561725 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd6ead-5505-4a6e-bc60-f3f4cce7c620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:15.562007 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd6ead-5505-4a6e-bc60-f3f4cce7c620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:15.562301 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd6ead-5505-4a6e-bc60-f3f4cce7c620 admin admin] PATH_INFO: `/v3/users/de034b41ad1746a393a9c9a0e5baa927` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:15.563469 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd6ead-5505-4a6e-bc60-f3f4cce7c620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de034b41ad1746a393a9c9a0e5baa927)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:15.565468 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd6ead-5505-4a6e-bc60-f3f4cce7c620 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:15.796288 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-48dd6ead-5505-4a6e-bc60-f3f4cce7c620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de034b41ad1746a393a9c9a0e5baa927'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:15.808834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-48dd6ead-5505-4a6e-bc60-f3f4cce7c620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de034b41ad1746a393a9c9a0e5baa927'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:15.809634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-48dd6ead-5505-4a6e-bc60-f3f4cce7c620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de034b41ad1746a393a9c9a0e5baa927'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:15.816586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-48dd6ead-5505-4a6e-bc60-f3f4cce7c620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de034b41ad1746a393a9c9a0e5baa927'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:15.817220 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-48dd6ead-5505-4a6e-bc60-f3f4cce7c620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de034b41ad1746a393a9c9a0e5baa927'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:15.913878 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1319/2693] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:12:15 2022] DELETE /identity/v3/users/de034b41ad1746a393a9c9a0e5baa927 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:16.328076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b7682-8b1f-4db0-9cdf-80120f72b79b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:16.329977 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e61b7682-8b1f-4db0-9cdf-80120f72b79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:16.343387 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b7682-8b1f-4db0-9cdf-80120f72b79b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:16.348246 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:16.418013 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04de06-75b1-46c1-94a0-389b18bb6221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:16.418991 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04de06-75b1-46c1-94a0-389b18bb6221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:16.419345 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04de06-75b1-46c1-94a0-389b18bb6221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:16.419629 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04de06-75b1-46c1-94a0-389b18bb6221 admin admin] PATH_INFO: `/v3/projects/62719e5c14834fa28fb32204613d89d7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:16.420875 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04de06-75b1-46c1-94a0-389b18bb6221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62719e5c14834fa28fb32204613d89d7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:16.422779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04de06-75b1-46c1-94a0-389b18bb6221 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:16.530956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ee04de06-75b1-46c1-94a0-389b18bb6221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62719e5c14834fa28fb32204613d89d7', 'request_id': 'req-ee04de06-75b1-46c1-94a0-389b18bb6221'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:16.596806 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ee04de06-75b1-46c1-94a0-389b18bb6221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62719e5c14834fa28fb32204613d89d7', 'request_id': 'req-ee04de06-75b1-46c1-94a0-389b18bb6221'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:16.603181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ee04de06-75b1-46c1-94a0-389b18bb6221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62719e5c14834fa28fb32204613d89d7', 'request_id': 'req-ee04de06-75b1-46c1-94a0-389b18bb6221'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:16.613807 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ee04de06-75b1-46c1-94a0-389b18bb6221 admin admin] The token cache is being invalidate because project 62719e5c14834fa28fb32204613d89d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:12:16.614099 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ee04de06-75b1-46c1-94a0-389b18bb6221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:16.614789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ee04de06-75b1-46c1-94a0-389b18bb6221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:16.616375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1375/2694] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:12:16 2022] DELETE /identity/v3/projects/62719e5c14834fa28fb32204613d89d7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:16.621225 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41446c-b38d-488e-bf53-f3902fbd7cd9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:16.621729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41446c-b38d-488e-bf53-f3902fbd7cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:16.621828 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41446c-b38d-488e-bf53-f3902fbd7cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:16.639373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-da41446c-b38d-488e-bf53-f3902fbd7cd9 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:16.640627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-da41446c-b38d-488e-bf53-f3902fbd7cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:16.701933 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1320/2695] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:16.709903 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bd49f-d93a-4189-b114-c8f071a37db6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:16.710199 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bd49f-d93a-4189-b114-c8f071a37db6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:16.710487 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bd49f-d93a-4189-b114-c8f071a37db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:16.730143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-178bd49f-d93a-4189-b114-c8f071a37db6 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:16.735033 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-178bd49f-d93a-4189-b114-c8f071a37db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:16.739208 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1376/2696] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:16.743326 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41446c-b38d-488e-bf53-f3902fbd7cd9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:16.753193 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41446c-b38d-488e-bf53-f3902fbd7cd9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:16.757790 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dd53e-1d72-4946-bcfa-d41c0b29da4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:16.758439 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dd53e-1d72-4946-bcfa-d41c0b29da4c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:16.758729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dd53e-1d72-4946-bcfa-d41c0b29da4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:16.759012 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dd53e-1d72-4946-bcfa-d41c0b29da4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:16.759732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dd53e-1d72-4946-bcfa-d41c0b29da4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:12:16.760082 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dd53e-1d72-4946-bcfa-d41c0b29da4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:16.761715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dd53e-1d72-4946-bcfa-d41c0b29da4c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:16.773728 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1321/2697] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:12:16.778301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bd49f-d93a-4189-b114-c8f071a37db6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:16.787390 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bd49f-d93a-4189-b114-c8f071a37db6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:16.793570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd03ad7-3db0-4f90-a268-d23467ee85f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:16.794244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03ad7-3db0-4f90-a268-d23467ee85f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:16.794530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03ad7-3db0-4f90-a268-d23467ee85f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:16.794809 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03ad7-3db0-4f90-a268-d23467ee85f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:16.795498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd03ad7-3db0-4f90-a268-d23467ee85f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:16.797423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd03ad7-3db0-4f90-a268-d23467ee85f2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:16.898183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1377/2698] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:12:16 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:16.902791 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dd53e-1d72-4946-bcfa-d41c0b29da4c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:16.912814 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dd53e-1d72-4946-bcfa-d41c0b29da4c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:16.941797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:16.971102 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a026b-404c-4ac9-a1da-bf36b553cd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:16.971776 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a026b-404c-4ac9-a1da-bf36b553cd58 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:16.972111 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a026b-404c-4ac9-a1da-bf36b553cd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:16.977732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a026b-404c-4ac9-a1da-bf36b553cd58 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:16.977732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a026b-404c-4ac9-a1da-bf36b553cd58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:16.977732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a026b-404c-4ac9-a1da-bf36b553cd58 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:17.071695 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1322/2699] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:12:16 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:17.076534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd03ad7-3db0-4f90-a268-d23467ee85f2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:17.087133 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd03ad7-3db0-4f90-a268-d23467ee85f2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:17.092326 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca50463-839f-4d43-8bac-4e9e46cca4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:17.092979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca50463-839f-4d43-8bac-4e9e46cca4fb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:17.093263 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca50463-839f-4d43-8bac-4e9e46cca4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:17.093542 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca50463-839f-4d43-8bac-4e9e46cca4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:17.094261 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca50463-839f-4d43-8bac-4e9e46cca4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:17.095843 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca50463-839f-4d43-8bac-4e9e46cca4fb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:17.106583 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1378/2700] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:17.110394 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a026b-404c-4ac9-a1da-bf36b553cd58 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:17.120309 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a026b-404c-4ac9-a1da-bf36b553cd58 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:17.124953 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac0669-ec8e-48b6-b263-248d0cb9f240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:17.125656 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac0669-ec8e-48b6-b263-248d0cb9f240 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:17.125890 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac0669-ec8e-48b6-b263-248d0cb9f240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:17.126171 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac0669-ec8e-48b6-b263-248d0cb9f240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:17.126969 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac0669-ec8e-48b6-b263-248d0cb9f240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:17.132257 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac0669-ec8e-48b6-b263-248d0cb9f240 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:17.142323 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1323/2701] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:17.143915 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca50463-839f-4d43-8bac-4e9e46cca4fb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:17.155213 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca50463-839f-4d43-8bac-4e9e46cca4fb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:17.160149 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cf089-d337-4105-af69-213edbef6c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:17.161008 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cf089-d337-4105-af69-213edbef6c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:17.161292 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cf089-d337-4105-af69-213edbef6c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:17.161573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cf089-d337-4105-af69-213edbef6c5a admin admin] PATH_INFO: `/v3/projects/6754bc449d664f119207465170f64367/users/428c2f33898b486d99f570bb1b3dfa42/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:17.176619 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cf089-d337-4105-af69-213edbef6c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6754bc449d664f119207465170f64367, user_id=428c2f33898b486d99f570bb1b3dfa42, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:17.179410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cf089-d337-4105-af69-213edbef6c5a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:17.277385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1379/2702] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:12:17 2022] PUT /identity/v3/projects/6754bc449d664f119207465170f64367/users/428c2f33898b486d99f570bb1b3dfa42/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:17.288710 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49107a37-e750-4590-a479-a95bd280a58b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:17.289020 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49107a37-e750-4590-a479-a95bd280a58b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:17.289311 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49107a37-e750-4590-a479-a95bd280a58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:17.316436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-49107a37-e750-4590-a479-a95bd280a58b None None] MFA Rules not processed for user `428c2f33898b486d99f570bb1b3dfa42`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:17.317748 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-49107a37-e750-4590-a479-a95bd280a58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:17.386319 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1324/2703] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:12:17.390933 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cf089-d337-4105-af69-213edbef6c5a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:17.430099 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:17.456916 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cf089-d337-4105-af69-213edbef6c5a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:17.462031 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78369133-a6b7-4cca-9574-0c239fb7a460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:17.462698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78369133-a6b7-4cca-9574-0c239fb7a460 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:17.462986 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78369133-a6b7-4cca-9574-0c239fb7a460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:17.463266 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78369133-a6b7-4cca-9574-0c239fb7a460 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:17.464081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78369133-a6b7-4cca-9574-0c239fb7a460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:17.466005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78369133-a6b7-4cca-9574-0c239fb7a460 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:17.557012 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1380/2704] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:12:17 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:17.558624 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49107a37-e750-4590-a479-a95bd280a58b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:17.571312 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49107a37-e750-4590-a479-a95bd280a58b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:17.637212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a3b40-25ea-4e92-b078-386102cf3ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:17.637891 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3b40-25ea-4e92-b078-386102cf3ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:17.638075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3b40-25ea-4e92-b078-386102cf3ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:17.638361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a3b40-25ea-4e92-b078-386102cf3ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:17.639318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a3b40-25ea-4e92-b078-386102cf3ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:17.641279 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a3b40-25ea-4e92-b078-386102cf3ed0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:17.814858 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1325/2705] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:12:17 2022] POST /identity/v3/users => generated 299 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:12:17.818610 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78369133-a6b7-4cca-9574-0c239fb7a460 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:17.828749 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78369133-a6b7-4cca-9574-0c239fb7a460 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:17.833177 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c2efb-5838-44e1-81c4-fab712afc7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:17.833834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2efb-5838-44e1-81c4-fab712afc7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:17.834120 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2efb-5838-44e1-81c4-fab712afc7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:17.834399 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c2efb-5838-44e1-81c4-fab712afc7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:17.835183 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c2efb-5838-44e1-81c4-fab712afc7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:17.836809 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c2efb-5838-44e1-81c4-fab712afc7b0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:17.847117 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1381/2706] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:17.851044 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a3b40-25ea-4e92-b078-386102cf3ed0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:17.861444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a3b40-25ea-4e92-b078-386102cf3ed0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:17.865967 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316c1cf-3b03-44d7-b753-51aaca08b953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:17.866847 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316c1cf-3b03-44d7-b753-51aaca08b953 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:17.867137 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316c1cf-3b03-44d7-b753-51aaca08b953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:17.867417 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316c1cf-3b03-44d7-b753-51aaca08b953 admin admin] PATH_INFO: `/v3/projects/bad8b91ddf9849d28b1af37024808d6b/users/0d8f922f5846498793414d63077ee5d2/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:17.883737 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316c1cf-3b03-44d7-b753-51aaca08b953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad8b91ddf9849d28b1af37024808d6b, user_id=0d8f922f5846498793414d63077ee5d2, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:17.886435 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316c1cf-3b03-44d7-b753-51aaca08b953 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:18.092507 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1326/2707] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:12:17 2022] PUT /identity/v3/projects/bad8b91ddf9849d28b1af37024808d6b/users/0d8f922f5846498793414d63077ee5d2/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:18.096563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c2efb-5838-44e1-81c4-fab712afc7b0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:18.107266 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c2efb-5838-44e1-81c4-fab712afc7b0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:18.186296 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c1266-7f31-45df-abf6-6bd9f3ae044e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:18.188413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c1266-7f31-45df-abf6-6bd9f3ae044e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:18.188413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c1266-7f31-45df-abf6-6bd9f3ae044e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:18.188413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c1266-7f31-45df-abf6-6bd9f3ae044e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:18.188413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c1266-7f31-45df-abf6-6bd9f3ae044e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:18.189919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c1266-7f31-45df-abf6-6bd9f3ae044e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:18.200677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1382/2708] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:18.204679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316c1cf-3b03-44d7-b753-51aaca08b953 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:18.216129 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:18.220671 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316c1cf-3b03-44d7-b753-51aaca08b953 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:18.227171 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f524393-9f50-4454-aa95-89aef2c76a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:18.228675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f524393-9f50-4454-aa95-89aef2c76a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:18.228992 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f524393-9f50-4454-aa95-89aef2c76a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:18.229892 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f524393-9f50-4454-aa95-89aef2c76a35 admin admin] PATH_INFO: `/v3/projects/bad8b91ddf9849d28b1af37024808d6b/users/0d8f922f5846498793414d63077ee5d2/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:18.232096 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f524393-9f50-4454-aa95-89aef2c76a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad8b91ddf9849d28b1af37024808d6b, user_id=0d8f922f5846498793414d63077ee5d2, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:18.234795 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f524393-9f50-4454-aa95-89aef2c76a35 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:18.248722 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1327/2709] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:12:18 2022] PUT /identity/v3/projects/bad8b91ddf9849d28b1af37024808d6b/users/0d8f922f5846498793414d63077ee5d2/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:12:18.261630 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6bfbe-99b7-407e-8ea0-87712e36cb90 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:18.261630 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6bfbe-99b7-407e-8ea0-87712e36cb90 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:18.261630 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6bfbe-99b7-407e-8ea0-87712e36cb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:18.298463 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-86e6bfbe-99b7-407e-8ea0-87712e36cb90 None None] MFA Rules not processed for user `0d8f922f5846498793414d63077ee5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:18.307634 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-86e6bfbe-99b7-407e-8ea0-87712e36cb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:18.392547 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1383/2710] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:18.403663 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f524393-9f50-4454-aa95-89aef2c76a35 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:18.406533 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6f524393-9f50-4454-aa95-89aef2c76a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:18.478900 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f524393-9f50-4454-aa95-89aef2c76a35 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:18.483502 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdba211-3693-474d-a7db-75dc488f88c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:18.484253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdba211-3693-474d-a7db-75dc488f88c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:18.484541 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdba211-3693-474d-a7db-75dc488f88c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:18.484818 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdba211-3693-474d-a7db-75dc488f88c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:18.494173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdba211-3693-474d-a7db-75dc488f88c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:18.496444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdba211-3693-474d-a7db-75dc488f88c0 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:18.507564 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1328/2711] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:18.574443 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6bfbe-99b7-407e-8ea0-87712e36cb90 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:18.611099 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:18.647952 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6bfbe-99b7-407e-8ea0-87712e36cb90 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:18.653275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73963b-5045-47ba-b1cf-d4b3467f3d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:18.654468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73963b-5045-47ba-b1cf-d4b3467f3d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:18.654765 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73963b-5045-47ba-b1cf-d4b3467f3d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:18.655047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73963b-5045-47ba-b1cf-d4b3467f3d4d admin admin] PATH_INFO: `/v3/users/428c2f33898b486d99f570bb1b3dfa42` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:18.656358 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73963b-5045-47ba-b1cf-d4b3467f3d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=428c2f33898b486d99f570bb1b3dfa42)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:18.658490 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73963b-5045-47ba-b1cf-d4b3467f3d4d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:18.864647 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ee73963b-5045-47ba-b1cf-d4b3467f3d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '428c2f33898b486d99f570bb1b3dfa42'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:18.865324 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ee73963b-5045-47ba-b1cf-d4b3467f3d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '428c2f33898b486d99f570bb1b3dfa42'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:18.936565 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ee73963b-5045-47ba-b1cf-d4b3467f3d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '428c2f33898b486d99f570bb1b3dfa42'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:18.944320 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ee73963b-5045-47ba-b1cf-d4b3467f3d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '428c2f33898b486d99f570bb1b3dfa42'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:18.945092 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ee73963b-5045-47ba-b1cf-d4b3467f3d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '428c2f33898b486d99f570bb1b3dfa42'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:18.967058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1384/2712] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:12:18 2022] DELETE /identity/v3/users/428c2f33898b486d99f570bb1b3dfa42 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:18.972324 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a01ed-8f9d-4ab6-aa25-e15093747062 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:18.972850 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a01ed-8f9d-4ab6-aa25-e15093747062 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:18.972950 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a01ed-8f9d-4ab6-aa25-e15093747062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:18.993857 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-940a01ed-8f9d-4ab6-aa25-e15093747062 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:18.994990 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-940a01ed-8f9d-4ab6-aa25-e15093747062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:19.057457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1329/2713] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:19.067213 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73963b-5045-47ba-b1cf-d4b3467f3d4d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:19.068643 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ee73963b-5045-47ba-b1cf-d4b3467f3d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:19.132972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73963b-5045-47ba-b1cf-d4b3467f3d4d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:19.137228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba50f45-409d-4f2b-b626-b45aef38bc68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:19.137876 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50f45-409d-4f2b-b626-b45aef38bc68 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:19.138164 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50f45-409d-4f2b-b626-b45aef38bc68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:19.141235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50f45-409d-4f2b-b626-b45aef38bc68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:19.148255 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba50f45-409d-4f2b-b626-b45aef38bc68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:19.149709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba50f45-409d-4f2b-b626-b45aef38bc68 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:19.166411 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1385/2714] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:19.629429 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a01ed-8f9d-4ab6-aa25-e15093747062 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:19.631383 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-940a01ed-8f9d-4ab6-aa25-e15093747062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:19.647729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a01ed-8f9d-4ab6-aa25-e15093747062 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:19.652789 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ca56d-e468-4f3a-aac9-79a56aa16a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:19.653653 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ca56d-e468-4f3a-aac9-79a56aa16a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:19.653938 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ca56d-e468-4f3a-aac9-79a56aa16a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:19.654213 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ca56d-e468-4f3a-aac9-79a56aa16a0d admin admin] PATH_INFO: `/v3/projects/6754bc449d664f119207465170f64367` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:19.656496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ca56d-e468-4f3a-aac9-79a56aa16a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6754bc449d664f119207465170f64367)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:19.658419 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ca56d-e468-4f3a-aac9-79a56aa16a0d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:19.771140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-164ca56d-e468-4f3a-aac9-79a56aa16a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6754bc449d664f119207465170f64367', 'request_id': 'req-164ca56d-e468-4f3a-aac9-79a56aa16a0d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:19.776713 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-164ca56d-e468-4f3a-aac9-79a56aa16a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6754bc449d664f119207465170f64367', 'request_id': 'req-164ca56d-e468-4f3a-aac9-79a56aa16a0d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:19.859177 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-164ca56d-e468-4f3a-aac9-79a56aa16a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6754bc449d664f119207465170f64367', 'request_id': 'req-164ca56d-e468-4f3a-aac9-79a56aa16a0d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:19.871496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-164ca56d-e468-4f3a-aac9-79a56aa16a0d admin admin] The token cache is being invalidate because project 6754bc449d664f119207465170f64367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:12:19.871786 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-164ca56d-e468-4f3a-aac9-79a56aa16a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:19.872482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-164ca56d-e468-4f3a-aac9-79a56aa16a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:19.874052 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1330/2715] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:12:19 2022] DELETE /identity/v3/projects/6754bc449d664f119207465170f64367 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:19.878148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba50f45-409d-4f2b-b626-b45aef38bc68 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:19.889644 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba50f45-409d-4f2b-b626-b45aef38bc68 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:19.939952 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:19.949157 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a157d6a-6041-4794-b36e-1a94c4d44e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:19.950047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a157d6a-6041-4794-b36e-1a94c4d44e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:19.950364 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a157d6a-6041-4794-b36e-1a94c4d44e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:19.950673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a157d6a-6041-4794-b36e-1a94c4d44e49 admin admin] PATH_INFO: `/v3/users/0d8f922f5846498793414d63077ee5d2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:19.951877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a157d6a-6041-4794-b36e-1a94c4d44e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8f922f5846498793414d63077ee5d2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:19.953897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a157d6a-6041-4794-b36e-1a94c4d44e49 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:20.124401 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a157d6a-6041-4794-b36e-1a94c4d44e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8f922f5846498793414d63077ee5d2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:20.125131 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a157d6a-6041-4794-b36e-1a94c4d44e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8f922f5846498793414d63077ee5d2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:20.202203 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a157d6a-6041-4794-b36e-1a94c4d44e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8f922f5846498793414d63077ee5d2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:20.209459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a157d6a-6041-4794-b36e-1a94c4d44e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8f922f5846498793414d63077ee5d2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:20.210067 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0a157d6a-6041-4794-b36e-1a94c4d44e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8f922f5846498793414d63077ee5d2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:20.227312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1386/2716] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:12:19 2022] DELETE /identity/v3/users/0d8f922f5846498793414d63077ee5d2 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:20.658438 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ca56d-e468-4f3a-aac9-79a56aa16a0d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:20.659969 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-164ca56d-e468-4f3a-aac9-79a56aa16a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:20.674358 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ca56d-e468-4f3a-aac9-79a56aa16a0d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:20.692583 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:20.741976 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100992b-4370-4536-a616-90861d8f2b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:20.742871 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100992b-4370-4536-a616-90861d8f2b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:20.743165 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100992b-4370-4536-a616-90861d8f2b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:20.743688 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100992b-4370-4536-a616-90861d8f2b31 admin admin] PATH_INFO: `/v3/projects/bad8b91ddf9849d28b1af37024808d6b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:20.745278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100992b-4370-4536-a616-90861d8f2b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bad8b91ddf9849d28b1af37024808d6b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:20.747255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6100992b-4370-4536-a616-90861d8f2b31 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:20.897128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6100992b-4370-4536-a616-90861d8f2b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bad8b91ddf9849d28b1af37024808d6b', 'request_id': 'req-6100992b-4370-4536-a616-90861d8f2b31'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:20.902956 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6100992b-4370-4536-a616-90861d8f2b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bad8b91ddf9849d28b1af37024808d6b', 'request_id': 'req-6100992b-4370-4536-a616-90861d8f2b31'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:20.982373 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6100992b-4370-4536-a616-90861d8f2b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bad8b91ddf9849d28b1af37024808d6b', 'request_id': 'req-6100992b-4370-4536-a616-90861d8f2b31'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:20.998760 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6100992b-4370-4536-a616-90861d8f2b31 admin admin] The token cache is being invalidate because project bad8b91ddf9849d28b1af37024808d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:12:20.999121 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6100992b-4370-4536-a616-90861d8f2b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:20.999717 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6100992b-4370-4536-a616-90861d8f2b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:21.005415 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1331/2717] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:12:20 2022] DELETE /identity/v3/projects/bad8b91ddf9849d28b1af37024808d6b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:12:21.006744 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cb572-a397-48fc-bdc1-f236557461ac None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:21.007200 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cb572-a397-48fc-bdc1-f236557461ac None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:21.007346 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cb572-a397-48fc-bdc1-f236557461ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:21.028757 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a61cb572-a397-48fc-bdc1-f236557461ac None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:21.030041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a61cb572-a397-48fc-bdc1-f236557461ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:21.094219 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1387/2718] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:12:21.103180 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f511e-4b59-453d-ae9b-d25688ef6286 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:21.103305 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f511e-4b59-453d-ae9b-d25688ef6286 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:21.103556 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f511e-4b59-453d-ae9b-d25688ef6286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:21.122937 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-921f511e-4b59-453d-ae9b-d25688ef6286 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:21.124197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-921f511e-4b59-453d-ae9b-d25688ef6286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:21.132183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1332/2719] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:21.137022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cb572-a397-48fc-bdc1-f236557461ac None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:21.146919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cb572-a397-48fc-bdc1-f236557461ac None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:21.152369 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fcbe6-2051-4ead-9afb-90d1a67ab639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:21.152964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fcbe6-2051-4ead-9afb-90d1a67ab639 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:21.153249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fcbe6-2051-4ead-9afb-90d1a67ab639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:21.153553 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fcbe6-2051-4ead-9afb-90d1a67ab639 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:21.154275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fcbe6-2051-4ead-9afb-90d1a67ab639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:12:21.154582 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fcbe6-2051-4ead-9afb-90d1a67ab639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:21.156244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fcbe6-2051-4ead-9afb-90d1a67ab639 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:21.170868 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1388/2720] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:12:21.182526 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f511e-4b59-453d-ae9b-d25688ef6286 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:21.191733 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f511e-4b59-453d-ae9b-d25688ef6286 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:21.196574 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d6009-ef99-4789-b5d2-98dedc5cf44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:21.197243 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d6009-ef99-4789-b5d2-98dedc5cf44d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:21.197650 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d6009-ef99-4789-b5d2-98dedc5cf44d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:21.198072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d6009-ef99-4789-b5d2-98dedc5cf44d admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:21.198493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d6009-ef99-4789-b5d2-98dedc5cf44d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:21.200443 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d6009-ef99-4789-b5d2-98dedc5cf44d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:21.310532 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1333/2721] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:12:21 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:21.320009 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fcbe6-2051-4ead-9afb-90d1a67ab639 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:21.331153 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fcbe6-2051-4ead-9afb-90d1a67ab639 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:21.387742 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab78d4-31ab-4fe1-a90f-4e9bfcae665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:21.388439 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab78d4-31ab-4fe1-a90f-4e9bfcae665c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:21.388980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab78d4-31ab-4fe1-a90f-4e9bfcae665c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:21.389258 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab78d4-31ab-4fe1-a90f-4e9bfcae665c admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:21.389940 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab78d4-31ab-4fe1-a90f-4e9bfcae665c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:21.391855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab78d4-31ab-4fe1-a90f-4e9bfcae665c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:21.398475 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:21.568424 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1389/2722] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:12:21 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:12:21.572305 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d6009-ef99-4789-b5d2-98dedc5cf44d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:21.583427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d6009-ef99-4789-b5d2-98dedc5cf44d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:21.588187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8b965-3572-43c8-a7d2-c83508afe23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:21.589554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8b965-3572-43c8-a7d2-c83508afe23c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:21.589832 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8b965-3572-43c8-a7d2-c83508afe23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:21.596968 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8b965-3572-43c8-a7d2-c83508afe23c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:21.596968 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8b965-3572-43c8-a7d2-c83508afe23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:21.596968 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8b965-3572-43c8-a7d2-c83508afe23c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:21.604173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1334/2723] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:21.608344 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab78d4-31ab-4fe1-a90f-4e9bfcae665c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:21.618611 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab78d4-31ab-4fe1-a90f-4e9bfcae665c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:21.623964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff538b7a-6c4a-43e5-beda-cefb0f2df0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:21.624677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff538b7a-6c4a-43e5-beda-cefb0f2df0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:21.624962 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff538b7a-6c4a-43e5-beda-cefb0f2df0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:21.625240 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff538b7a-6c4a-43e5-beda-cefb0f2df0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:21.626043 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff538b7a-6c4a-43e5-beda-cefb0f2df0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:21.627696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff538b7a-6c4a-43e5-beda-cefb0f2df0c5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:21.642132 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1390/2724] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:21.646297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8b965-3572-43c8-a7d2-c83508afe23c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:21.657820 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8b965-3572-43c8-a7d2-c83508afe23c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:21.662600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12a5b9-6f15-4aa5-aa09-36cf3d83f14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:21.663484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12a5b9-6f15-4aa5-aa09-36cf3d83f14a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:21.663768 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12a5b9-6f15-4aa5-aa09-36cf3d83f14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:21.664083 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12a5b9-6f15-4aa5-aa09-36cf3d83f14a admin admin] PATH_INFO: `/v3/projects/b9f6ac78964b45b996f0aca25e91200e/users/195cd87ccc9241ada92a2c7cd91fa0bc/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:21.680330 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12a5b9-6f15-4aa5-aa09-36cf3d83f14a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f6ac78964b45b996f0aca25e91200e, user_id=195cd87ccc9241ada92a2c7cd91fa0bc, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:21.683374 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12a5b9-6f15-4aa5-aa09-36cf3d83f14a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:21.825627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1335/2725] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:12:21 2022] PUT /identity/v3/projects/b9f6ac78964b45b996f0aca25e91200e/users/195cd87ccc9241ada92a2c7cd91fa0bc/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:21.835768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5252e-e0bd-4740-9695-7bc2298b1daa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:21.836088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5252e-e0bd-4740-9695-7bc2298b1daa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:21.836373 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5252e-e0bd-4740-9695-7bc2298b1daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:21.862111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-72f5252e-e0bd-4740-9695-7bc2298b1daa None None] MFA Rules not processed for user `195cd87ccc9241ada92a2c7cd91fa0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:21.863331 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-72f5252e-e0bd-4740-9695-7bc2298b1daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:21.929218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1391/2726] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:21.941295 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12a5b9-6f15-4aa5-aa09-36cf3d83f14a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:21.943142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7d12a5b9-6f15-4aa5-aa09-36cf3d83f14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:21.993190 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:22.008812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12a5b9-6f15-4aa5-aa09-36cf3d83f14a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:22.015037 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05018009-6fe4-4333-8a5c-0a1d4f90815b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:22.016034 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05018009-6fe4-4333-8a5c-0a1d4f90815b service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:22.016477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05018009-6fe4-4333-8a5c-0a1d4f90815b service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:22.017179 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05018009-6fe4-4333-8a5c-0a1d4f90815b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:22.029882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05018009-6fe4-4333-8a5c-0a1d4f90815b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:22.032250 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05018009-6fe4-4333-8a5c-0a1d4f90815b service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:22.045384 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1336/2727] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:24.305709 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5252e-e0bd-4740-9695-7bc2298b1daa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:24.307833 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-72f5252e-e0bd-4740-9695-7bc2298b1daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:24.367195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5252e-e0bd-4740-9695-7bc2298b1daa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:24.371516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052cca1-8ef4-4fdf-aeb9-478c284922ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:24.372196 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052cca1-8ef4-4fdf-aeb9-478c284922ae service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:24.372484 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052cca1-8ef4-4fdf-aeb9-478c284922ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:24.372768 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052cca1-8ef4-4fdf-aeb9-478c284922ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:24.374695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e052cca1-8ef4-4fdf-aeb9-478c284922ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:24.441285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052cca1-8ef4-4fdf-aeb9-478c284922ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:24.442776 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052cca1-8ef4-4fdf-aeb9-478c284922ae service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:24.452771 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1392/2728] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:24.746618 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05018009-6fe4-4333-8a5c-0a1d4f90815b service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:24.749846 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-05018009-6fe4-4333-8a5c-0a1d4f90815b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:24.838904 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05018009-6fe4-4333-8a5c-0a1d4f90815b service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:24.845805 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e971b-2055-47b0-9578-d80abbbdb35e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:24.846550 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e971b-2055-47b0-9578-d80abbbdb35e service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:24.846847 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e971b-2055-47b0-9578-d80abbbdb35e service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:24.847160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e971b-2055-47b0-9578-d80abbbdb35e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:24.849572 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f59e971b-2055-47b0-9578-d80abbbdb35e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:24.879662 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e971b-2055-47b0-9578-d80abbbdb35e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:24.881407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e971b-2055-47b0-9578-d80abbbdb35e service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:24.895555 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1337/2729] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:29.368760 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052cca1-8ef4-4fdf-aeb9-478c284922ae service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:29.370329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e052cca1-8ef4-4fdf-aeb9-478c284922ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:29.387793 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052cca1-8ef4-4fdf-aeb9-478c284922ae service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:29.392964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e40b0-92ee-4188-9426-9a446bab29ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:29.393779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e40b0-92ee-4188-9426-9a446bab29ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:29.394065 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e40b0-92ee-4188-9426-9a446bab29ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:29.394344 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e40b0-92ee-4188-9426-9a446bab29ec admin admin] PATH_INFO: `/v3/users/3913e5416fd742509fe6b431261e2620` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:29.395656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e40b0-92ee-4188-9426-9a446bab29ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3913e5416fd742509fe6b431261e2620)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:29.397805 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e40b0-92ee-4188-9426-9a446bab29ec admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:29.411226 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:29.622770 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-442e40b0-92ee-4188-9426-9a446bab29ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3913e5416fd742509fe6b431261e2620'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:29.623455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-442e40b0-92ee-4188-9426-9a446bab29ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3913e5416fd742509fe6b431261e2620'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:29.678901 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-442e40b0-92ee-4188-9426-9a446bab29ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3913e5416fd742509fe6b431261e2620'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:29.686895 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-442e40b0-92ee-4188-9426-9a446bab29ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3913e5416fd742509fe6b431261e2620'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:29.687552 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-442e40b0-92ee-4188-9426-9a446bab29ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3913e5416fd742509fe6b431261e2620'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:29.705665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1393/2730] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:12:29 2022] DELETE /identity/v3/users/3913e5416fd742509fe6b431261e2620 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:29.972408 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e971b-2055-47b0-9578-d80abbbdb35e service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:29.990830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e971b-2055-47b0-9578-d80abbbdb35e service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:30.064549 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa68bf-c3c9-4c1a-b11b-d7d9a5f98cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:30.065541 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa68bf-c3c9-4c1a-b11b-d7d9a5f98cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:30.065828 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa68bf-c3c9-4c1a-b11b-d7d9a5f98cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:30.066106 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa68bf-c3c9-4c1a-b11b-d7d9a5f98cc7 admin admin] PATH_INFO: `/v3/projects/c1c05fb09f254ceaa36692a0c5b96013` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:30.067291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa68bf-c3c9-4c1a-b11b-d7d9a5f98cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c05fb09f254ceaa36692a0c5b96013)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:30.069234 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa68bf-c3c9-4c1a-b11b-d7d9a5f98cc7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:30.201626 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-37aa68bf-c3c9-4c1a-b11b-d7d9a5f98cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c05fb09f254ceaa36692a0c5b96013', 'request_id': 'req-37aa68bf-c3c9-4c1a-b11b-d7d9a5f98cc7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:30.207331 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-37aa68bf-c3c9-4c1a-b11b-d7d9a5f98cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c05fb09f254ceaa36692a0c5b96013', 'request_id': 'req-37aa68bf-c3c9-4c1a-b11b-d7d9a5f98cc7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:30.320047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-37aa68bf-c3c9-4c1a-b11b-d7d9a5f98cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c05fb09f254ceaa36692a0c5b96013', 'request_id': 'req-37aa68bf-c3c9-4c1a-b11b-d7d9a5f98cc7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:30.336057 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-37aa68bf-c3c9-4c1a-b11b-d7d9a5f98cc7 admin admin] The token cache is being invalidate because project c1c05fb09f254ceaa36692a0c5b96013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:12:30.336453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-37aa68bf-c3c9-4c1a-b11b-d7d9a5f98cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:30.337232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-37aa68bf-c3c9-4c1a-b11b-d7d9a5f98cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:30.342285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1338/2731] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:12:29 2022] DELETE /identity/v3/projects/c1c05fb09f254ceaa36692a0c5b96013 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:30.344329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796225f-b04b-4d9b-b329-400b99b9d310 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:30.344807 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796225f-b04b-4d9b-b329-400b99b9d310 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:30.345102 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796225f-b04b-4d9b-b329-400b99b9d310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:30.381611 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d796225f-b04b-4d9b-b329-400b99b9d310 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:30.382954 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d796225f-b04b-4d9b-b329-400b99b9d310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:30.455218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1394/2732] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:30.462959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a375e7f-af14-48b8-b36e-5c8b2f82a26b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:30.463278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a375e7f-af14-48b8-b36e-5c8b2f82a26b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:30.463547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a375e7f-af14-48b8-b36e-5c8b2f82a26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:30.470845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:30.485041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6a375e7f-af14-48b8-b36e-5c8b2f82a26b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:30.486264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6a375e7f-af14-48b8-b36e-5c8b2f82a26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:30.494741 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1339/2733] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:30.498936 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796225f-b04b-4d9b-b329-400b99b9d310 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:30.508637 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796225f-b04b-4d9b-b329-400b99b9d310 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:30.513253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd9ca6-4ee8-4f67-85d0-75402d169027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:30.514262 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9ca6-4ee8-4f67-85d0-75402d169027 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:30.514451 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9ca6-4ee8-4f67-85d0-75402d169027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:30.514840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9ca6-4ee8-4f67-85d0-75402d169027 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:30.515448 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd9ca6-4ee8-4f67-85d0-75402d169027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:12:30.515758 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd9ca6-4ee8-4f67-85d0-75402d169027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:30.517742 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd9ca6-4ee8-4f67-85d0-75402d169027 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:30.529522 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1395/2734] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:12:30.533894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a375e7f-af14-48b8-b36e-5c8b2f82a26b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:30.543945 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a375e7f-af14-48b8-b36e-5c8b2f82a26b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:30.549350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2685adb-1a69-4231-83f7-3c4ab7a41534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:30.550031 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2685adb-1a69-4231-83f7-3c4ab7a41534 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:30.550315 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2685adb-1a69-4231-83f7-3c4ab7a41534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:30.550609 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2685adb-1a69-4231-83f7-3c4ab7a41534 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:30.551278 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2685adb-1a69-4231-83f7-3c4ab7a41534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:30.553248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2685adb-1a69-4231-83f7-3c4ab7a41534 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:30.659583 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1340/2735] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:12:30 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:30.665064 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd9ca6-4ee8-4f67-85d0-75402d169027 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:30.677896 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd9ca6-4ee8-4f67-85d0-75402d169027 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:30.754705 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248de15f-00e6-4d20-b246-2ed2f22d5883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:30.755796 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248de15f-00e6-4d20-b246-2ed2f22d5883 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:30.756330 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248de15f-00e6-4d20-b246-2ed2f22d5883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:30.756810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248de15f-00e6-4d20-b246-2ed2f22d5883 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:30.757686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248de15f-00e6-4d20-b246-2ed2f22d5883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:30.763489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248de15f-00e6-4d20-b246-2ed2f22d5883 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:30.863904 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1396/2736] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:12:30 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:30.864973 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2685adb-1a69-4231-83f7-3c4ab7a41534 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:30.879898 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2685adb-1a69-4231-83f7-3c4ab7a41534 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:30.893012 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5eeda-d148-42eb-a6cd-8b55f5284fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:30.894028 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5eeda-d148-42eb-a6cd-8b55f5284fbe admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:30.894427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5eeda-d148-42eb-a6cd-8b55f5284fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:30.894984 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5eeda-d148-42eb-a6cd-8b55f5284fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:30.895866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5eeda-d148-42eb-a6cd-8b55f5284fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:30.898750 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5eeda-d148-42eb-a6cd-8b55f5284fbe admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:30.921995 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1341/2737] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:30.925737 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248de15f-00e6-4d20-b246-2ed2f22d5883 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:30.936509 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248de15f-00e6-4d20-b246-2ed2f22d5883 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:30.945512 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d090cd1-90a3-4805-8c95-b0ac228542e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:30.946323 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d090cd1-90a3-4805-8c95-b0ac228542e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:30.946677 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d090cd1-90a3-4805-8c95-b0ac228542e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:30.947042 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d090cd1-90a3-4805-8c95-b0ac228542e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:30.947864 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d090cd1-90a3-4805-8c95-b0ac228542e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:30.949613 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d090cd1-90a3-4805-8c95-b0ac228542e9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:30.951217 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:30.962253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1397/2738] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:30.967099 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5eeda-d148-42eb-a6cd-8b55f5284fbe admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:30.977991 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5eeda-d148-42eb-a6cd-8b55f5284fbe admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:30.983486 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a07abb-b676-4e47-a0bd-b50fa4cba86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:30.984490 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a07abb-b676-4e47-a0bd-b50fa4cba86c admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:30.984785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a07abb-b676-4e47-a0bd-b50fa4cba86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:30.985069 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a07abb-b676-4e47-a0bd-b50fa4cba86c admin admin] PATH_INFO: `/v3/projects/9ec63da2fbbf405597fd0369b0d48482/users/21212ff6f80441eab1538722c960481c/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:31.008130 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a07abb-b676-4e47-a0bd-b50fa4cba86c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec63da2fbbf405597fd0369b0d48482, user_id=21212ff6f80441eab1538722c960481c, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:31.014509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a07abb-b676-4e47-a0bd-b50fa4cba86c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:31.117744 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1342/2739] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:12:30 2022] PUT /identity/v3/projects/9ec63da2fbbf405597fd0369b0d48482/users/21212ff6f80441eab1538722c960481c/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:31.122314 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8dbf1-817b-415d-adb5-69d4046dd8e8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:31.122605 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8dbf1-817b-415d-adb5-69d4046dd8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:31.122893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8dbf1-817b-415d-adb5-69d4046dd8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:31.142802 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d0d8dbf1-817b-415d-adb5-69d4046dd8e8 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:31.143981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d0d8dbf1-817b-415d-adb5-69d4046dd8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:31.211409 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1398/2740] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:12:31.223424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a07abb-b676-4e47-a0bd-b50fa4cba86c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:31.223424 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d8a07abb-b676-4e47-a0bd-b50fa4cba86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:31.281954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a07abb-b676-4e47-a0bd-b50fa4cba86c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:31.285680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ef6d3-fab9-403f-b8d1-2d9127b5a714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:31.286330 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ef6d3-fab9-403f-b8d1-2d9127b5a714 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:31.286617 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ef6d3-fab9-403f-b8d1-2d9127b5a714 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:31.286897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ef6d3-fab9-403f-b8d1-2d9127b5a714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:31.296768 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ef6d3-fab9-403f-b8d1-2d9127b5a714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:31.298207 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ef6d3-fab9-403f-b8d1-2d9127b5a714 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:31.308566 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1343/2741] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:32.903444 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38876428-10a7-4b7c-bc74-b50e834549ef None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:32.903922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38876428-10a7-4b7c-bc74-b50e834549ef None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:32.904098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38876428-10a7-4b7c-bc74-b50e834549ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:32.938290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-38876428-10a7-4b7c-bc74-b50e834549ef None None] MFA Rules not processed for user `63b40cb0ce3b420a918ec12672c0eccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:32.939546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-38876428-10a7-4b7c-bc74-b50e834549ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:33.009370 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1399/2742] 10.222.0.50 () {58 vars in 967 bytes} [Thu Jun 2 16:12:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:33.032253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ef6d3-fab9-403f-b8d1-2d9127b5a714 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:33.033679 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-025ef6d3-fab9-403f-b8d1-2d9127b5a714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:33.107403 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ef6d3-fab9-403f-b8d1-2d9127b5a714 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:33.113237 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5f5c-d016-410b-84be-ff116131f965 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02eade9a475b4002bd3990f08f8a1198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:33.113885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5f5c-d016-410b-84be-ff116131f965 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:33.114172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5f5c-d016-410b-84be-ff116131f965 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:33.114462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5f5c-d016-410b-84be-ff116131f965 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:33.124472 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da5f5c-d016-410b-84be-ff116131f965 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:33.126091 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da5f5c-d016-410b-84be-ff116131f965 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:33.135620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1344/2743] 10.222.0.50 () {60 vars in 1384 bytes} [Thu Jun 2 16:12:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 16:12:37.806266 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf0252-4b02-49e4-a1db-e377d96cae96 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:37.806810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf0252-4b02-49e4-a1db-e377d96cae96 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:37.806810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf0252-4b02-49e4-a1db-e377d96cae96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:37.843464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1daf0252-4b02-49e4-a1db-e377d96cae96 None None] MFA Rules not processed for user `21212ff6f80441eab1538722c960481c`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:37.846996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1daf0252-4b02-49e4-a1db-e377d96cae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:37.961781 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1400/2744] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:37.983763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5f5c-d016-410b-84be-ff116131f965 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:37.985449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-53da5f5c-d016-410b-84be-ff116131f965 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:38.045934 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:38.088753 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5f5c-d016-410b-84be-ff116131f965 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:38.095736 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ac4b0-3021-4eca-a325-a18330058b84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:38.096719 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ac4b0-3021-4eca-a325-a18330058b84 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:38.097253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ac4b0-3021-4eca-a325-a18330058b84 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:38.098952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ac4b0-3021-4eca-a325-a18330058b84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:38.110028 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ac4b0-3021-4eca-a325-a18330058b84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:38.112066 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ac4b0-3021-4eca-a325-a18330058b84 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:38.122965 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1345/2745] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:39.224771 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf0252-4b02-49e4-a1db-e377d96cae96 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:39.226310 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1daf0252-4b02-49e4-a1db-e377d96cae96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:39.252429 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf0252-4b02-49e4-a1db-e377d96cae96 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:39.278758 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cdafb-14a2-4f76-8c5f-5e4620d23586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:39.279683 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cdafb-14a2-4f76-8c5f-5e4620d23586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:39.279972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cdafb-14a2-4f76-8c5f-5e4620d23586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:39.280328 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607cdafb-14a2-4f76-8c5f-5e4620d23586 admin admin] PATH_INFO: `/v3/users/195cd87ccc9241ada92a2c7cd91fa0bc` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:39.281668 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cdafb-14a2-4f76-8c5f-5e4620d23586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=195cd87ccc9241ada92a2c7cd91fa0bc)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:39.285437 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607cdafb-14a2-4f76-8c5f-5e4620d23586 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:39.440814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:39.555093 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-607cdafb-14a2-4f76-8c5f-5e4620d23586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195cd87ccc9241ada92a2c7cd91fa0bc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:39.556062 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-607cdafb-14a2-4f76-8c5f-5e4620d23586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195cd87ccc9241ada92a2c7cd91fa0bc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:39.673940 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-607cdafb-14a2-4f76-8c5f-5e4620d23586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195cd87ccc9241ada92a2c7cd91fa0bc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:39.681455 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-607cdafb-14a2-4f76-8c5f-5e4620d23586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195cd87ccc9241ada92a2c7cd91fa0bc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:39.682187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-607cdafb-14a2-4f76-8c5f-5e4620d23586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195cd87ccc9241ada92a2c7cd91fa0bc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:39.719022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1401/2746] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:12:39 2022] DELETE /identity/v3/users/195cd87ccc9241ada92a2c7cd91fa0bc => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:39.726463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5b2e3-daea-4356-99ad-1f993af3d919 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:39.727436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5b2e3-daea-4356-99ad-1f993af3d919 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:39.728512 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5b2e3-daea-4356-99ad-1f993af3d919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:39.751876 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f9a5b2e3-daea-4356-99ad-1f993af3d919 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:39.753301 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f9a5b2e3-daea-4356-99ad-1f993af3d919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:39.828664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1346/2747] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:12:39.836129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cdafb-14a2-4f76-8c5f-5e4620d23586 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:39.838187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-607cdafb-14a2-4f76-8c5f-5e4620d23586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:39.906512 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607cdafb-14a2-4f76-8c5f-5e4620d23586 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:39.910903 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cf0b1-95dc-4474-8e81-23d963a2134f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:39.910903 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf0b1-95dc-4474-8e81-23d963a2134f service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:39.911178 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf0b1-95dc-4474-8e81-23d963a2134f service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:39.911459 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cf0b1-95dc-4474-8e81-23d963a2134f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:39.923410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6cf0b1-95dc-4474-8e81-23d963a2134f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:39.926454 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6cf0b1-95dc-4474-8e81-23d963a2134f service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:39.936647 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1402/2748] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:40.535184 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5b2e3-daea-4356-99ad-1f993af3d919 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:40.537042 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f9a5b2e3-daea-4356-99ad-1f993af3d919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:40.566674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5b2e3-daea-4356-99ad-1f993af3d919 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:40.587964 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6702cc3-f3be-4fbf-88ba-6dca36709657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:40.590848 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6702cc3-f3be-4fbf-88ba-6dca36709657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:40.591146 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6702cc3-f3be-4fbf-88ba-6dca36709657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:40.591433 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6702cc3-f3be-4fbf-88ba-6dca36709657 admin admin] PATH_INFO: `/v3/projects/b9f6ac78964b45b996f0aca25e91200e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:40.593027 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6702cc3-f3be-4fbf-88ba-6dca36709657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f6ac78964b45b996f0aca25e91200e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:40.595901 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6702cc3-f3be-4fbf-88ba-6dca36709657 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:40.773840 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c6702cc3-f3be-4fbf-88ba-6dca36709657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f6ac78964b45b996f0aca25e91200e', 'request_id': 'req-c6702cc3-f3be-4fbf-88ba-6dca36709657'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:40.782885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c6702cc3-f3be-4fbf-88ba-6dca36709657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f6ac78964b45b996f0aca25e91200e', 'request_id': 'req-c6702cc3-f3be-4fbf-88ba-6dca36709657'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:40.877653 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c6702cc3-f3be-4fbf-88ba-6dca36709657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f6ac78964b45b996f0aca25e91200e', 'request_id': 'req-c6702cc3-f3be-4fbf-88ba-6dca36709657'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:40.895910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c6702cc3-f3be-4fbf-88ba-6dca36709657 admin admin] The token cache is being invalidate because project b9f6ac78964b45b996f0aca25e91200e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:12:40.896153 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c6702cc3-f3be-4fbf-88ba-6dca36709657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:40.907944 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c6702cc3-f3be-4fbf-88ba-6dca36709657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:40.907944 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1347/2749] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:12:40 2022] DELETE /identity/v3/projects/b9f6ac78964b45b996f0aca25e91200e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:40.908391 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abd183-4368-451b-b2d1-26ac25a6672c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:40.908391 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abd183-4368-451b-b2d1-26ac25a6672c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:40.908391 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abd183-4368-451b-b2d1-26ac25a6672c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:40.929698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d0abd183-4368-451b-b2d1-26ac25a6672c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:40.931361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d0abd183-4368-451b-b2d1-26ac25a6672c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:41.031220 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1403/2750] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:41.032854 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836da9c3-79a4-43f8-b779-3a8e09fb4cf8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:41.033155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836da9c3-79a4-43f8-b779-3a8e09fb4cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:41.033441 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836da9c3-79a4-43f8-b779-3a8e09fb4cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:41.058325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-836da9c3-79a4-43f8-b779-3a8e09fb4cf8 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:41.060213 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-836da9c3-79a4-43f8-b779-3a8e09fb4cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:41.071510 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1348/2751] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:41.075966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abd183-4368-451b-b2d1-26ac25a6672c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:41.086797 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abd183-4368-451b-b2d1-26ac25a6672c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:41.093279 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff7d98-4837-44f5-9340-ea2c886e1818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:41.094267 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff7d98-4837-44f5-9340-ea2c886e1818 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:41.094655 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff7d98-4837-44f5-9340-ea2c886e1818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:41.095141 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff7d98-4837-44f5-9340-ea2c886e1818 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:41.096097 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff7d98-4837-44f5-9340-ea2c886e1818 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:12:41.096485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff7d98-4837-44f5-9340-ea2c886e1818 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:41.098130 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff7d98-4837-44f5-9340-ea2c886e1818 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:41.116223 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1404/2752] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:12:41.116866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836da9c3-79a4-43f8-b779-3a8e09fb4cf8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:41.132720 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836da9c3-79a4-43f8-b779-3a8e09fb4cf8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:41.138072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea468140-f272-4782-a6f5-bb7943dbfa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:41.138765 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea468140-f272-4782-a6f5-bb7943dbfa29 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:41.139318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea468140-f272-4782-a6f5-bb7943dbfa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:41.139802 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea468140-f272-4782-a6f5-bb7943dbfa29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:41.140739 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea468140-f272-4782-a6f5-bb7943dbfa29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:41.142670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea468140-f272-4782-a6f5-bb7943dbfa29 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:41.273456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1349/2753] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:12:41 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:12:41.278393 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff7d98-4837-44f5-9340-ea2c886e1818 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:41.289698 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff7d98-4837-44f5-9340-ea2c886e1818 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:41.332748 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:41.370466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2089de-0daf-43bd-9b68-5e48d202c624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:41.372213 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2089de-0daf-43bd-9b68-5e48d202c624 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:41.372501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2089de-0daf-43bd-9b68-5e48d202c624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:41.372781 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2089de-0daf-43bd-9b68-5e48d202c624 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:41.373489 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2089de-0daf-43bd-9b68-5e48d202c624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:41.375708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2089de-0daf-43bd-9b68-5e48d202c624 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:41.482533 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1405/2754] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:12:41 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:12:41.486355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea468140-f272-4782-a6f5-bb7943dbfa29 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:41.497715 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea468140-f272-4782-a6f5-bb7943dbfa29 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:41.504422 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2178d3-0dd0-423c-b274-12db3ad22651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:41.505104 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2178d3-0dd0-423c-b274-12db3ad22651 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:41.505394 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2178d3-0dd0-423c-b274-12db3ad22651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:41.505677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2178d3-0dd0-423c-b274-12db3ad22651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:41.506411 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2178d3-0dd0-423c-b274-12db3ad22651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:41.508374 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2178d3-0dd0-423c-b274-12db3ad22651 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:41.515512 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:41.526711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1350/2755] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:41.530778 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2089de-0daf-43bd-9b68-5e48d202c624 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:41.541656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2089de-0daf-43bd-9b68-5e48d202c624 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:41.547448 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72afc4c-6318-4164-bafd-97741f0adf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:41.548171 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72afc4c-6318-4164-bafd-97741f0adf85 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:41.548467 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72afc4c-6318-4164-bafd-97741f0adf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:41.548744 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72afc4c-6318-4164-bafd-97741f0adf85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:41.549471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72afc4c-6318-4164-bafd-97741f0adf85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:41.551374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72afc4c-6318-4164-bafd-97741f0adf85 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:41.563491 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1406/2756] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:41.567390 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2178d3-0dd0-423c-b274-12db3ad22651 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:41.578257 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2178d3-0dd0-423c-b274-12db3ad22651 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:41.583022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff1488-1b92-4585-856c-d8d071759bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:41.584089 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff1488-1b92-4585-856c-d8d071759bae admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:41.584382 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff1488-1b92-4585-856c-d8d071759bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:41.584664 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff1488-1b92-4585-856c-d8d071759bae admin admin] PATH_INFO: `/v3/projects/0c05e79af8a7435290cd0e8f45acfaa4/users/0d316eed24cf4cdb9bd970e20478ee3b/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:41.603557 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff1488-1b92-4585-856c-d8d071759bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c05e79af8a7435290cd0e8f45acfaa4, user_id=0d316eed24cf4cdb9bd970e20478ee3b, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:41.606976 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff1488-1b92-4585-856c-d8d071759bae admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:41.732039 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1351/2757] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:12:41 2022] PUT /identity/v3/projects/0c05e79af8a7435290cd0e8f45acfaa4/users/0d316eed24cf4cdb9bd970e20478ee3b/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:41.794752 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455af05-9e2c-4c1a-acef-50642896bfba None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:41.795046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455af05-9e2c-4c1a-acef-50642896bfba None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:41.795329 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455af05-9e2c-4c1a-acef-50642896bfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:41.851299 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c455af05-9e2c-4c1a-acef-50642896bfba None None] MFA Rules not processed for user `0d316eed24cf4cdb9bd970e20478ee3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:41.852333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c455af05-9e2c-4c1a-acef-50642896bfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:41.946417 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1407/2758] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:41.960158 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff1488-1b92-4585-856c-d8d071759bae admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:41.962484 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e0ff1488-1b92-4585-856c-d8d071759bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:42.027032 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff1488-1b92-4585-856c-d8d071759bae admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:42.031087 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adf869-194c-4ebb-8c5d-27c63c7df684 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:42.031782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adf869-194c-4ebb-8c5d-27c63c7df684 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:42.032100 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adf869-194c-4ebb-8c5d-27c63c7df684 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:42.032387 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adf869-194c-4ebb-8c5d-27c63c7df684 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:42.042663 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adf869-194c-4ebb-8c5d-27c63c7df684 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:42.044155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adf869-194c-4ebb-8c5d-27c63c7df684 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:42.065833 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1352/2759] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:42.190221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c18c59-4d13-4976-a961-b168db45bc45 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:42.190527 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c18c59-4d13-4976-a961-b168db45bc45 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:42.191101 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c18c59-4d13-4976-a961-b168db45bc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:42.216928 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-60c18c59-4d13-4976-a961-b168db45bc45 None None] MFA Rules not processed for user `21212ff6f80441eab1538722c960481c`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:42.218256 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-60c18c59-4d13-4976-a961-b168db45bc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:42.284673 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1408/2760] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:42.829142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adf869-194c-4ebb-8c5d-27c63c7df684 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:42.830735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b1adf869-194c-4ebb-8c5d-27c63c7df684 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:42.908813 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adf869-194c-4ebb-8c5d-27c63c7df684 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:42.914053 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1133e5c-89f4-4099-a3ee-48988dd20a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:42.915415 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1133e5c-89f4-4099-a3ee-48988dd20a6f service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:42.915415 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1133e5c-89f4-4099-a3ee-48988dd20a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:42.915415 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1133e5c-89f4-4099-a3ee-48988dd20a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:42.917497 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f1133e5c-89f4-4099-a3ee-48988dd20a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:42.929114 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1133e5c-89f4-4099-a3ee-48988dd20a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:42.930616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1133e5c-89f4-4099-a3ee-48988dd20a6f service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:42.941407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1353/2761] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:44.643818 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c18c59-4d13-4976-a961-b168db45bc45 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:44.645546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-60c18c59-4d13-4976-a961-b168db45bc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:44.701570 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:44.722191 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c18c59-4d13-4976-a961-b168db45bc45 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:44.727448 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3066cb-ea5c-4b16-ae41-a8c214df1df0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60a2abffc04ba59b65d5fca5e318a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:44.728162 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3066cb-ea5c-4b16-ae41-a8c214df1df0 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:44.728456 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3066cb-ea5c-4b16-ae41-a8c214df1df0 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:44.728740 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3066cb-ea5c-4b16-ae41-a8c214df1df0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:44.731022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2d3066cb-ea5c-4b16-ae41-a8c214df1df0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:44.742740 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3066cb-ea5c-4b16-ae41-a8c214df1df0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:44.744361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3066cb-ea5c-4b16-ae41-a8c214df1df0 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:44.755340 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1409/2762] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:44.787677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1133e5c-89f4-4099-a3ee-48988dd20a6f service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:44.789320 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f1133e5c-89f4-4099-a3ee-48988dd20a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:44.856800 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1133e5c-89f4-4099-a3ee-48988dd20a6f service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:44.861322 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e07678-bd57-4aa8-a69e-eb996441ac50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:44.862187 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07678-bd57-4aa8-a69e-eb996441ac50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:44.862474 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07678-bd57-4aa8-a69e-eb996441ac50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:44.862755 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07678-bd57-4aa8-a69e-eb996441ac50 admin admin] PATH_INFO: `/v3/users/e55a3cb62b094932bc7e3811d5da78f2` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:44.863935 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e07678-bd57-4aa8-a69e-eb996441ac50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e55a3cb62b094932bc7e3811d5da78f2)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:44.866080 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e07678-bd57-4aa8-a69e-eb996441ac50 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:44.890345 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:45.063952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e0e07678-bd57-4aa8-a69e-eb996441ac50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e55a3cb62b094932bc7e3811d5da78f2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:45.076090 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e0e07678-bd57-4aa8-a69e-eb996441ac50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e55a3cb62b094932bc7e3811d5da78f2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:45.076823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e0e07678-bd57-4aa8-a69e-eb996441ac50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e55a3cb62b094932bc7e3811d5da78f2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:45.083478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e0e07678-bd57-4aa8-a69e-eb996441ac50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e55a3cb62b094932bc7e3811d5da78f2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:45.084123 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e0e07678-bd57-4aa8-a69e-eb996441ac50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e55a3cb62b094932bc7e3811d5da78f2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:45.164182 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1354/2763] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:12:44 2022] DELETE /identity/v3/users/e55a3cb62b094932bc7e3811d5da78f2 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:45.210011 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3066cb-ea5c-4b16-ae41-a8c214df1df0 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:45.221678 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3066cb-ea5c-4b16-ae41-a8c214df1df0 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:45.287632 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a25e8-1b7a-4776-8941-82a091b815a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:45.288585 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a25e8-1b7a-4776-8941-82a091b815a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:45.288966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a25e8-1b7a-4776-8941-82a091b815a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:45.289253 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a25e8-1b7a-4776-8941-82a091b815a4 admin admin] PATH_INFO: `/v3/users/0d316eed24cf4cdb9bd970e20478ee3b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:45.290480 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a25e8-1b7a-4776-8941-82a091b815a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d316eed24cf4cdb9bd970e20478ee3b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:45.293000 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a25e8-1b7a-4776-8941-82a091b815a4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:45.432944 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e07678-bd57-4aa8-a69e-eb996441ac50 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:45.434586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e0e07678-bd57-4aa8-a69e-eb996441ac50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:45.451034 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e07678-bd57-4aa8-a69e-eb996441ac50 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:45.455913 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:45.457140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:45.457140 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:45.457347 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d admin admin] PATH_INFO: `/v3/projects/d8a529b2d7e0459484fad3c078ea1e02` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:45.458545 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a529b2d7e0459484fad3c078ea1e02)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:45.460512 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:45.500475 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fd5a25e8-1b7a-4776-8941-82a091b815a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d316eed24cf4cdb9bd970e20478ee3b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:45.501146 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fd5a25e8-1b7a-4776-8941-82a091b815a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d316eed24cf4cdb9bd970e20478ee3b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:45.579084 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fd5a25e8-1b7a-4776-8941-82a091b815a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d316eed24cf4cdb9bd970e20478ee3b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:45.586716 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fd5a25e8-1b7a-4776-8941-82a091b815a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d316eed24cf4cdb9bd970e20478ee3b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:45.587413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fd5a25e8-1b7a-4776-8941-82a091b815a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d316eed24cf4cdb9bd970e20478ee3b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:45.597104 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a529b2d7e0459484fad3c078ea1e02', 'request_id': 'req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:45.603746 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a529b2d7e0459484fad3c078ea1e02', 'request_id': 'req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:45.606595 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1410/2764] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:12:45 2022] DELETE /identity/v3/users/0d316eed24cf4cdb9bd970e20478ee3b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:45.611005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08af62-65db-4b8b-9bb4-3af82dddb3d4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:45.617285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08af62-65db-4b8b-9bb4-3af82dddb3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:45.617285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08af62-65db-4b8b-9bb4-3af82dddb3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:45.628756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ff08af62-65db-4b8b-9bb4-3af82dddb3d4 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:45.629947 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ff08af62-65db-4b8b-9bb4-3af82dddb3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:45.690926 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1411/2765] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:12:45.695925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a529b2d7e0459484fad3c078ea1e02', 'request_id': 'req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:45.701141 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08af62-65db-4b8b-9bb4-3af82dddb3d4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:45.702564 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ff08af62-65db-4b8b-9bb4-3af82dddb3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:45.719188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d admin admin] The token cache is being invalidate because project d8a529b2d7e0459484fad3c078ea1e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:12:45.722388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:45.722388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:45.722388 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1355/2766] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:12:45 2022] DELETE /identity/v3/projects/d8a529b2d7e0459484fad3c078ea1e02 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:12:45.725636 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:45.728832 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:45.762853 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08af62-65db-4b8b-9bb4-3af82dddb3d4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:45.767756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127be82-21ee-4e24-bf9b-27c6287f7e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:45.768445 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127be82-21ee-4e24-bf9b-27c6287f7e2d service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:45.768873 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127be82-21ee-4e24-bf9b-27c6287f7e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:45.769297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127be82-21ee-4e24-bf9b-27c6287f7e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:45.771126 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2127be82-21ee-4e24-bf9b-27c6287f7e2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:45.783363 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127be82-21ee-4e24-bf9b-27c6287f7e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:45.784840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127be82-21ee-4e24-bf9b-27c6287f7e2d service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:45.794728 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf71f6e-4cf3-4dea-9f39-fcf8dfcab30d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:45.797079 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1412/2767] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:12:45.800067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671c27a-6b9c-4286-9d13-9460c446664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:45.800963 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671c27a-6b9c-4286-9d13-9460c446664b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:45.801165 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671c27a-6b9c-4286-9d13-9460c446664b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:45.801444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671c27a-6b9c-4286-9d13-9460c446664b admin admin] PATH_INFO: `/v3/users/6a2feae5771546f19a5106a5d31c367c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:45.802704 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671c27a-6b9c-4286-9d13-9460c446664b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2feae5771546f19a5106a5d31c367c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:45.804635 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671c27a-6b9c-4286-9d13-9460c446664b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:46.078317 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:46.083258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3671c27a-6b9c-4286-9d13-9460c446664b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2feae5771546f19a5106a5d31c367c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:46.122161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3671c27a-6b9c-4286-9d13-9460c446664b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2feae5771546f19a5106a5d31c367c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:46.123844 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3671c27a-6b9c-4286-9d13-9460c446664b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2feae5771546f19a5106a5d31c367c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:46.130729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3671c27a-6b9c-4286-9d13-9460c446664b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2feae5771546f19a5106a5d31c367c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:46.135265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3671c27a-6b9c-4286-9d13-9460c446664b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2feae5771546f19a5106a5d31c367c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:46.227212 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1356/2768] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:12:45 2022] DELETE /identity/v3/users/6a2feae5771546f19a5106a5d31c367c => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:12:46.429809 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127be82-21ee-4e24-bf9b-27c6287f7e2d service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:46.434443 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2127be82-21ee-4e24-bf9b-27c6287f7e2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:46.447965 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127be82-21ee-4e24-bf9b-27c6287f7e2d service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:46.509943 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671c27a-6b9c-4286-9d13-9460c446664b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:46.512973 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3671c27a-6b9c-4286-9d13-9460c446664b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:46.541244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e866b5-14e9-4065-a20a-0646ecd98f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:46.543308 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e866b5-14e9-4065-a20a-0646ecd98f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:46.544224 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e866b5-14e9-4065-a20a-0646ecd98f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:46.544672 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e866b5-14e9-4065-a20a-0646ecd98f5b admin admin] PATH_INFO: `/v3/projects/0c05e79af8a7435290cd0e8f45acfaa4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:46.546044 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e866b5-14e9-4065-a20a-0646ecd98f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c05e79af8a7435290cd0e8f45acfaa4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:46.548160 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e866b5-14e9-4065-a20a-0646ecd98f5b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:46.584236 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671c27a-6b9c-4286-9d13-9460c446664b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:46.589895 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24800979-85f4-4b77-aee2-5f6b4e82a56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:46.590860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24800979-85f4-4b77-aee2-5f6b4e82a56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:46.591273 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24800979-85f4-4b77-aee2-5f6b4e82a56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:46.591629 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24800979-85f4-4b77-aee2-5f6b4e82a56d admin admin] PATH_INFO: `/v3/projects/03d3b3b5d87e440aafce921848ea84c9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:46.593256 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24800979-85f4-4b77-aee2-5f6b4e82a56d admin admin] RBAC: Authorizing `identity:delete_project(project_id=03d3b3b5d87e440aafce921848ea84c9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:46.595165 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24800979-85f4-4b77-aee2-5f6b4e82a56d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:46.685972 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36e866b5-14e9-4065-a20a-0646ecd98f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c05e79af8a7435290cd0e8f45acfaa4', 'request_id': 'req-36e866b5-14e9-4065-a20a-0646ecd98f5b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:46.775183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-24800979-85f4-4b77-aee2-5f6b4e82a56d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03d3b3b5d87e440aafce921848ea84c9', 'request_id': 'req-24800979-85f4-4b77-aee2-5f6b4e82a56d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:46.781307 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-24800979-85f4-4b77-aee2-5f6b4e82a56d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03d3b3b5d87e440aafce921848ea84c9', 'request_id': 'req-24800979-85f4-4b77-aee2-5f6b4e82a56d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:46.785473 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36e866b5-14e9-4065-a20a-0646ecd98f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c05e79af8a7435290cd0e8f45acfaa4', 'request_id': 'req-36e866b5-14e9-4065-a20a-0646ecd98f5b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:46.799840 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36e866b5-14e9-4065-a20a-0646ecd98f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c05e79af8a7435290cd0e8f45acfaa4', 'request_id': 'req-36e866b5-14e9-4065-a20a-0646ecd98f5b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:46.804922 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36e866b5-14e9-4065-a20a-0646ecd98f5b admin admin] The token cache is being invalidate because project 0c05e79af8a7435290cd0e8f45acfaa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:12:46.805215 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36e866b5-14e9-4065-a20a-0646ecd98f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:46.805882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36e866b5-14e9-4065-a20a-0646ecd98f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:46.807413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1413/2769] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:12:46 2022] DELETE /identity/v3/projects/0c05e79af8a7435290cd0e8f45acfaa4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:46.811957 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f714568-e2ad-4c3a-8e31-186b5289ecd4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:46.812297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f714568-e2ad-4c3a-8e31-186b5289ecd4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:46.812586 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f714568-e2ad-4c3a-8e31-186b5289ecd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:46.830315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0f714568-e2ad-4c3a-8e31-186b5289ecd4 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:46.831513 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0f714568-e2ad-4c3a-8e31-186b5289ecd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:46.874134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:46.875477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-24800979-85f4-4b77-aee2-5f6b4e82a56d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03d3b3b5d87e440aafce921848ea84c9', 'request_id': 'req-24800979-85f4-4b77-aee2-5f6b4e82a56d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:46.889361 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-24800979-85f4-4b77-aee2-5f6b4e82a56d admin admin] The token cache is being invalidate because project 03d3b3b5d87e440aafce921848ea84c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:12:46.889713 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-24800979-85f4-4b77-aee2-5f6b4e82a56d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:46.890270 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-24800979-85f4-4b77-aee2-5f6b4e82a56d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:12:46.899924 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1357/2770] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:12:46 2022] DELETE /identity/v3/projects/03d3b3b5d87e440aafce921848ea84c9 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:12:46.906192 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1414/2771] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:12:46.919499 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95957ec2-4661-4b98-95a6-2c72463b36e1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:46.919940 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95957ec2-4661-4b98-95a6-2c72463b36e1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:46.922952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95957ec2-4661-4b98-95a6-2c72463b36e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:46.946751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-95957ec2-4661-4b98-95a6-2c72463b36e1 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:46.948891 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-95957ec2-4661-4b98-95a6-2c72463b36e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:46.959961 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1358/2772] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:46.965273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f714568-e2ad-4c3a-8e31-186b5289ecd4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:46.966719 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0f714568-e2ad-4c3a-8e31-186b5289ecd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:46.989012 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f714568-e2ad-4c3a-8e31-186b5289ecd4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:46.994484 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcde96-f2de-4cef-bdc2-f9f0e75bd5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:46.995398 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcde96-f2de-4cef-bdc2-f9f0e75bd5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:46.995746 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcde96-f2de-4cef-bdc2-f9f0e75bd5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:46.996172 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcde96-f2de-4cef-bdc2-f9f0e75bd5a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:46.996985 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcde96-f2de-4cef-bdc2-f9f0e75bd5a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:12:46.997363 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcde96-f2de-4cef-bdc2-f9f0e75bd5a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:46.999091 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcde96-f2de-4cef-bdc2-f9f0e75bd5a6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:47.013663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1415/2773] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:12:47.019205 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95957ec2-4661-4b98-95a6-2c72463b36e1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:47.031270 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95957ec2-4661-4b98-95a6-2c72463b36e1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:47.040432 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d155e5c-214e-491d-966f-1d1ea1da2bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:47.040432 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d155e5c-214e-491d-966f-1d1ea1da2bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:47.040432 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d155e5c-214e-491d-966f-1d1ea1da2bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:47.040432 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d155e5c-214e-491d-966f-1d1ea1da2bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:47.040760 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d155e5c-214e-491d-966f-1d1ea1da2bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:47.040760 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d155e5c-214e-491d-966f-1d1ea1da2bd9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:47.154556 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1359/2774] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:12:47 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:47.155901 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcde96-f2de-4cef-bdc2-f9f0e75bd5a6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:47.167400 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcde96-f2de-4cef-bdc2-f9f0e75bd5a6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:47.236611 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1da96-57da-4ae8-b87f-4277194c32f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:47.237443 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1da96-57da-4ae8-b87f-4277194c32f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:47.237735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1da96-57da-4ae8-b87f-4277194c32f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:47.238022 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1da96-57da-4ae8-b87f-4277194c32f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:47.238948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1da96-57da-4ae8-b87f-4277194c32f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:47.240947 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1da96-57da-4ae8-b87f-4277194c32f1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:47.350528 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1416/2775] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:12:47 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:12:47.352242 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d155e5c-214e-491d-966f-1d1ea1da2bd9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:47.362728 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d155e5c-214e-491d-966f-1d1ea1da2bd9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:47.367431 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843e8fc-1ad0-4e56-8d40-2a0cb5087bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:47.368345 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843e8fc-1ad0-4e56-8d40-2a0cb5087bdf admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:47.368492 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843e8fc-1ad0-4e56-8d40-2a0cb5087bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:47.368712 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843e8fc-1ad0-4e56-8d40-2a0cb5087bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:47.369444 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843e8fc-1ad0-4e56-8d40-2a0cb5087bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:47.371620 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843e8fc-1ad0-4e56-8d40-2a0cb5087bdf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:47.382308 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1360/2776] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:47.386973 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1da96-57da-4ae8-b87f-4277194c32f1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:47.397250 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1da96-57da-4ae8-b87f-4277194c32f1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:47.402026 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417193a4-beeb-456d-b042-15d5fbefa234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:47.402686 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417193a4-beeb-456d-b042-15d5fbefa234 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:47.402975 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417193a4-beeb-456d-b042-15d5fbefa234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:47.403258 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417193a4-beeb-456d-b042-15d5fbefa234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:47.403979 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417193a4-beeb-456d-b042-15d5fbefa234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:47.405603 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417193a4-beeb-456d-b042-15d5fbefa234 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:47.416137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1417/2777] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:12:47.420449 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843e8fc-1ad0-4e56-8d40-2a0cb5087bdf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:47.430455 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843e8fc-1ad0-4e56-8d40-2a0cb5087bdf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:47.435628 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6b0ce-91e2-453f-aa24-25f5b9d2b73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:47.436622 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6b0ce-91e2-453f-aa24-25f5b9d2b73f admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:47.436977 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6b0ce-91e2-453f-aa24-25f5b9d2b73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:47.437336 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6b0ce-91e2-453f-aa24-25f5b9d2b73f admin admin] PATH_INFO: `/v3/projects/df72412f54564d12bd4a3a0d5a51566c/users/3a2bd2ed4ed144178daf6c52cf5c86e4/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:47.452891 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6b0ce-91e2-453f-aa24-25f5b9d2b73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df72412f54564d12bd4a3a0d5a51566c, user_id=3a2bd2ed4ed144178daf6c52cf5c86e4, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:47.455702 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6b0ce-91e2-453f-aa24-25f5b9d2b73f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:47.524409 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1361/2778] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:12:47 2022] PUT /identity/v3/projects/df72412f54564d12bd4a3a0d5a51566c/users/3a2bd2ed4ed144178daf6c52cf5c86e4/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:12:47.529721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c7335-c3cd-46de-b5b6-8902f7278e7e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:47.530021 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c7335-c3cd-46de-b5b6-8902f7278e7e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:47.530312 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c7335-c3cd-46de-b5b6-8902f7278e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:47.548050 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-125c7335-c3cd-46de-b5b6-8902f7278e7e None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:47.549316 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-125c7335-c3cd-46de-b5b6-8902f7278e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:47.613879 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1418/2779] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:47.624923 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6b0ce-91e2-453f-aa24-25f5b9d2b73f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:47.627437 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f5a6b0ce-91e2-453f-aa24-25f5b9d2b73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:47.697803 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6b0ce-91e2-453f-aa24-25f5b9d2b73f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:47.702296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a1b3c-a228-4c9b-b7fc-a74d2a273639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:47.703175 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a1b3c-a228-4c9b-b7fc-a74d2a273639 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:47.703517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a1b3c-a228-4c9b-b7fc-a74d2a273639 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:47.703966 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a1b3c-a228-4c9b-b7fc-a74d2a273639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:47.715044 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a1b3c-a228-4c9b-b7fc-a74d2a273639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:47.717034 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a1b3c-a228-4c9b-b7fc-a74d2a273639 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:47.732176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1362/2780] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:47.919219 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:48.615956 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:49.165545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04646b05-6fc0-4ab4-ab97-eb7da9db340e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:49.166031 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04646b05-6fc0-4ab4-ab97-eb7da9db340e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:49.166233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04646b05-6fc0-4ab4-ab97-eb7da9db340e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:49.193462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-04646b05-6fc0-4ab4-ab97-eb7da9db340e None None] MFA Rules not processed for user `3a2bd2ed4ed144178daf6c52cf5c86e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:49.194708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-04646b05-6fc0-4ab4-ab97-eb7da9db340e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:49.223365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:12:49.264727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1419/2781] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:49.275730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a1b3c-a228-4c9b-b7fc-a74d2a273639 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:12:49.277255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-600a1b3c-a228-4c9b-b7fc-a74d2a273639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:49.336015 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a1b3c-a228-4c9b-b7fc-a74d2a273639 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:12:49.339735 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75f8d5-c6bf-49ed-b3fd-41176c40d7df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:12:49.340410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75f8d5-c6bf-49ed-b3fd-41176c40d7df service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:49.340701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75f8d5-c6bf-49ed-b3fd-41176c40d7df service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:49.340984 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75f8d5-c6bf-49ed-b3fd-41176c40d7df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:49.349932 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75f8d5-c6bf-49ed-b3fd-41176c40d7df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:12:49.351385 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75f8d5-c6bf-49ed-b3fd-41176c40d7df service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:12:49.361836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1363/2782] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:12:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:12:51.148119 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d1fdd-76b4-46f8-8564-5de039f782d4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:12:51.148742 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d1fdd-76b4-46f8-8564-5de039f782d4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:12:51.154422 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d1fdd-76b4-46f8-8564-5de039f782d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:12:51.167070 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ca1d1fdd-76b4-46f8-8564-5de039f782d4 None None] MFA Rules not processed for user `3a2bd2ed4ed144178daf6c52cf5c86e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:12:51.168288 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ca1d1fdd-76b4-46f8-8564-5de039f782d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:12:51.175010 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1420/2783] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:12:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:12:59.363277 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=65,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:01.161923 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=19 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:23.335390 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62325a-331c-4f7a-8d91-2e851f55bc78 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:23.336057 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62325a-331c-4f7a-8d91-2e851f55bc78 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:23.336057 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62325a-331c-4f7a-8d91-2e851f55bc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:23.353586 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0e62325a-331c-4f7a-8d91-2e851f55bc78 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:13:23.354812 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0e62325a-331c-4f7a-8d91-2e851f55bc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:23.363069 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1364/2784] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jun 2 16:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:13:23.378635 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d1fdd-76b4-46f8-8564-5de039f782d4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:23.380028 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ca1d1fdd-76b4-46f8-8564-5de039f782d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:23.452280 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d1fdd-76b4-46f8-8564-5de039f782d4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:23.457816 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477bc9a-3d78-450e-ac27-3a2a894958f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:23.458463 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477bc9a-3d78-450e-ac27-3a2a894958f0 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:23.458807 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477bc9a-3d78-450e-ac27-3a2a894958f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:23.459031 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477bc9a-3d78-450e-ac27-3a2a894958f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:23.467175 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477bc9a-3d78-450e-ac27-3a2a894958f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:23.468805 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477bc9a-3d78-450e-ac27-3a2a894958f0 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:23.478705 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1421/2785] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:13:27.591606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023be9e-3bd8-435b-8f72-e1d3d7612134 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:27.592172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023be9e-3bd8-435b-8f72-e1d3d7612134 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:27.592172 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023be9e-3bd8-435b-8f72-e1d3d7612134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:27.609925 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7023be9e-3bd8-435b-8f72-e1d3d7612134 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:13:27.611603 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7023be9e-3bd8-435b-8f72-e1d3d7612134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:27.619316 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1365/2786] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jun 2 16:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:13:27.634195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477bc9a-3d78-450e-ac27-3a2a894958f0 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:27.635627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e477bc9a-3d78-450e-ac27-3a2a894958f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:27.650785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477bc9a-3d78-450e-ac27-3a2a894958f0 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:27.656249 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f2214-41ec-4d18-a6b7-74bfccd52dd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:27.656988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f2214-41ec-4d18-a6b7-74bfccd52dd4 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:27.657315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f2214-41ec-4d18-a6b7-74bfccd52dd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:27.657597 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f2214-41ec-4d18-a6b7-74bfccd52dd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:27.665812 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f2214-41ec-4d18-a6b7-74bfccd52dd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:27.667412 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f2214-41ec-4d18-a6b7-74bfccd52dd4 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:27.677529 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1422/2787] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:13:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:13:31.011684 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515a26a-e875-423e-adbd-e54b6afa812f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:31.012341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515a26a-e875-423e-adbd-e54b6afa812f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:31.012341 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515a26a-e875-423e-adbd-e54b6afa812f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:31.031075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9515a26a-e875-423e-adbd-e54b6afa812f None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:13:31.032334 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9515a26a-e875-423e-adbd-e54b6afa812f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:31.040681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1366/2788] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jun 2 16:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:13:31.055937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f2214-41ec-4d18-a6b7-74bfccd52dd4 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:31.067956 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f2214-41ec-4d18-a6b7-74bfccd52dd4 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:31.073538 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1817a-707b-4b7f-8859-05993f6168f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:31.074211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1817a-707b-4b7f-8859-05993f6168f6 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:31.074501 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1817a-707b-4b7f-8859-05993f6168f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:31.074785 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1817a-707b-4b7f-8859-05993f6168f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:31.084030 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1817a-707b-4b7f-8859-05993f6168f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:31.085717 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1817a-707b-4b7f-8859-05993f6168f6 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:31.095098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1423/2789] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:13:39.019537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc70bb-8bb1-411c-b2f6-8d9cd3af39e1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:39.020162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc70bb-8bb1-411c-b2f6-8d9cd3af39e1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:39.020162 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc70bb-8bb1-411c-b2f6-8d9cd3af39e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:39.039362 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d1fc70bb-8bb1-411c-b2f6-8d9cd3af39e1 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:13:39.040646 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d1fc70bb-8bb1-411c-b2f6-8d9cd3af39e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:39.048453 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1367/2790] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jun 2 16:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:13:39.066211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1817a-707b-4b7f-8859-05993f6168f6 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:39.077560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1817a-707b-4b7f-8859-05993f6168f6 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:39.083473 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7ff42-e37b-423f-8bd6-e7053ee72b91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:39.084147 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7ff42-e37b-423f-8bd6-e7053ee72b91 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:39.084440 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7ff42-e37b-423f-8bd6-e7053ee72b91 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:39.084722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7ff42-e37b-423f-8bd6-e7053ee72b91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:39.092855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7ff42-e37b-423f-8bd6-e7053ee72b91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:39.094432 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7ff42-e37b-423f-8bd6-e7053ee72b91 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:39.104548 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1424/2791] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 16:13:42.242600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592a468-596e-46ed-852e-021d17d9f7f5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:42.243128 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592a468-596e-46ed-852e-021d17d9f7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:42.243235 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592a468-596e-46ed-852e-021d17d9f7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:42.262094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8592a468-596e-46ed-852e-021d17d9f7f5 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:13:42.263353 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8592a468-596e-46ed-852e-021d17d9f7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:42.272407 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1368/2792] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jun 2 16:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:13:42.306277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7ff42-e37b-423f-8bd6-e7053ee72b91 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:42.317974 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7ff42-e37b-423f-8bd6-e7053ee72b91 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:42.323573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13964ade-723e-4450-b750-849d06352b8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:42.324237 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13964ade-723e-4450-b750-849d06352b8b service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:42.324530 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13964ade-723e-4450-b750-849d06352b8b service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:42.324815 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13964ade-723e-4450-b750-849d06352b8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:42.333856 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13964ade-723e-4450-b750-849d06352b8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:42.335474 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13964ade-723e-4450-b750-849d06352b8b service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:42.345280 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1425/2793] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:13:45.474092 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fd844-11c1-407d-8f60-1a8229491b5e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:45.474588 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fd844-11c1-407d-8f60-1a8229491b5e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:45.474705 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fd844-11c1-407d-8f60-1a8229491b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:45.494061 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a04fd844-11c1-407d-8f60-1a8229491b5e None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:13:45.495283 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a04fd844-11c1-407d-8f60-1a8229491b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:45.503324 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1369/2794] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jun 2 16:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:13:45.519381 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13964ade-723e-4450-b750-849d06352b8b service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:45.531815 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13964ade-723e-4450-b750-849d06352b8b service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:45.538983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308a0f2-c1b4-426f-aadf-b1bcaa4f7025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:45.539697 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308a0f2-c1b4-426f-aadf-b1bcaa4f7025 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:45.540887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308a0f2-c1b4-426f-aadf-b1bcaa4f7025 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:45.540887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308a0f2-c1b4-426f-aadf-b1bcaa4f7025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:45.550838 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308a0f2-c1b4-426f-aadf-b1bcaa4f7025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:45.552517 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308a0f2-c1b4-426f-aadf-b1bcaa4f7025 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:45.562293 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1426/2795] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:13:55.487759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=18 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:55.557850 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=64 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:13:57.723837 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fd844-11c1-407d-8f60-1a8229491b5e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:13:57.725874 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a04fd844-11c1-407d-8f60-1a8229491b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:57.809044 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fd844-11c1-407d-8f60-1a8229491b5e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:13:57.815101 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634d138-7c38-40de-9ebf-d7c3f6570526 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60a2abffc04ba59b65d5fca5e318a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:13:57.815762 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634d138-7c38-40de-9ebf-d7c3f6570526 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:13:57.816073 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634d138-7c38-40de-9ebf-d7c3f6570526 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:13:57.816421 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634d138-7c38-40de-9ebf-d7c3f6570526 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:13:57.818353 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a634d138-7c38-40de-9ebf-d7c3f6570526 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:13:57.831291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634d138-7c38-40de-9ebf-d7c3f6570526 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:13:57.833851 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634d138-7c38-40de-9ebf-d7c3f6570526 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:13:57.846618 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1370/2796] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:13:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:14:03.259189 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0fb99-faf3-4b4b-80c5-068182988461 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:03.259678 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0fb99-faf3-4b4b-80c5-068182988461 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:03.259786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0fb99-faf3-4b4b-80c5-068182988461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:03.278071 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-35d0fb99-faf3-4b4b-80c5-068182988461 None None] MFA Rules not processed for user `3a2bd2ed4ed144178daf6c52cf5c86e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:14:03.279356 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-35d0fb99-faf3-4b4b-80c5-068182988461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:03.286687 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1427/2797] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:14:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:14:07.289713 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634d138-7c38-40de-9ebf-d7c3f6570526 service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:07.291612 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a634d138-7c38-40de-9ebf-d7c3f6570526 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:07.309329 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634d138-7c38-40de-9ebf-d7c3f6570526 service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:07.314766 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54b4f6-be37-4e5f-b822-835158f47668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:07.315759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54b4f6-be37-4e5f-b822-835158f47668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:07.316183 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54b4f6-be37-4e5f-b822-835158f47668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:07.316567 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54b4f6-be37-4e5f-b822-835158f47668 admin admin] PATH_INFO: `/v3/users/5fc1c3e9e955412398e52a32236848a4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:07.317941 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54b4f6-be37-4e5f-b822-835158f47668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc1c3e9e955412398e52a32236848a4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:07.320509 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54b4f6-be37-4e5f-b822-835158f47668 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:07.616835 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9a54b4f6-be37-4e5f-b822-835158f47668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc1c3e9e955412398e52a32236848a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:07.634996 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9a54b4f6-be37-4e5f-b822-835158f47668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc1c3e9e955412398e52a32236848a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:07.635846 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9a54b4f6-be37-4e5f-b822-835158f47668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc1c3e9e955412398e52a32236848a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:07.644922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9a54b4f6-be37-4e5f-b822-835158f47668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc1c3e9e955412398e52a32236848a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:07.645676 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9a54b4f6-be37-4e5f-b822-835158f47668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc1c3e9e955412398e52a32236848a4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:07.711952 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1371/2798] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:14:07 2022] DELETE /identity/v3/users/5fc1c3e9e955412398e52a32236848a4 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:14:08.096277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0fb99-faf3-4b4b-80c5-068182988461 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:08.112583 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0fb99-faf3-4b4b-80c5-068182988461 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:08.177244 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fb8f1-26d1-472a-90ce-9e841097670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:08.179073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fb8f1-26d1-472a-90ce-9e841097670e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:08.179073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fb8f1-26d1-472a-90ce-9e841097670e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:08.179073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fb8f1-26d1-472a-90ce-9e841097670e admin admin] PATH_INFO: `/v3/projects/b543e52f50c44ba395185b5f094edf71` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:08.180405 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fb8f1-26d1-472a-90ce-9e841097670e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b543e52f50c44ba395185b5f094edf71)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:08.182364 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fb8f1-26d1-472a-90ce-9e841097670e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:08.333893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b38fb8f1-26d1-472a-90ce-9e841097670e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b543e52f50c44ba395185b5f094edf71', 'request_id': 'req-b38fb8f1-26d1-472a-90ce-9e841097670e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:08.420516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b38fb8f1-26d1-472a-90ce-9e841097670e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b543e52f50c44ba395185b5f094edf71', 'request_id': 'req-b38fb8f1-26d1-472a-90ce-9e841097670e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:08.428907 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b38fb8f1-26d1-472a-90ce-9e841097670e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b543e52f50c44ba395185b5f094edf71', 'request_id': 'req-b38fb8f1-26d1-472a-90ce-9e841097670e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:08.442899 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b38fb8f1-26d1-472a-90ce-9e841097670e admin admin] The token cache is being invalidate because project b543e52f50c44ba395185b5f094edf71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:14:08.443754 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b38fb8f1-26d1-472a-90ce-9e841097670e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:08.444518 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b38fb8f1-26d1-472a-90ce-9e841097670e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:08.446130 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1428/2799] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:14:08 2022] DELETE /identity/v3/projects/b543e52f50c44ba395185b5f094edf71 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:14:08.450050 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54b4f6-be37-4e5f-b822-835158f47668 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:08.451626 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9a54b4f6-be37-4e5f-b822-835158f47668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:08.465339 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54b4f6-be37-4e5f-b822-835158f47668 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:08.523001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829055bb-8f4e-46a5-9803-51971f709108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:08.523885 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829055bb-8f4e-46a5-9803-51971f709108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:08.524204 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829055bb-8f4e-46a5-9803-51971f709108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:08.524489 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829055bb-8f4e-46a5-9803-51971f709108 admin admin] PATH_INFO: `/v3/users/339979971398409891a7c1e71b3d6c67` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:08.525686 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829055bb-8f4e-46a5-9803-51971f709108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=339979971398409891a7c1e71b3d6c67)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:08.527608 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829055bb-8f4e-46a5-9803-51971f709108 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:08.530197 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:08.742005 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-829055bb-8f4e-46a5-9803-51971f709108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '339979971398409891a7c1e71b3d6c67'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:08.760610 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-829055bb-8f4e-46a5-9803-51971f709108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '339979971398409891a7c1e71b3d6c67'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:08.761421 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-829055bb-8f4e-46a5-9803-51971f709108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '339979971398409891a7c1e71b3d6c67'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:08.771435 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-829055bb-8f4e-46a5-9803-51971f709108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '339979971398409891a7c1e71b3d6c67'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:08.772232 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-829055bb-8f4e-46a5-9803-51971f709108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '339979971398409891a7c1e71b3d6c67'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:08.854363 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1372/2800] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:14:08 2022] DELETE /identity/v3/users/339979971398409891a7c1e71b3d6c67 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:14:09.136292 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fb8f1-26d1-472a-90ce-9e841097670e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:09.137832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b38fb8f1-26d1-472a-90ce-9e841097670e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:09.153267 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fb8f1-26d1-472a-90ce-9e841097670e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:09.212544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967fc96-02a2-4587-9f02-37003f958f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:09.213409 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967fc96-02a2-4587-9f02-37003f958f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:09.213696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967fc96-02a2-4587-9f02-37003f958f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:09.213996 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967fc96-02a2-4587-9f02-37003f958f33 admin admin] PATH_INFO: `/v3/projects/5e9a9e7a581b42a5a1428db2cbd7bc47` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:09.215178 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967fc96-02a2-4587-9f02-37003f958f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e9a9e7a581b42a5a1428db2cbd7bc47)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:09.217138 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967fc96-02a2-4587-9f02-37003f958f33 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:09.339660 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:09.360041 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3967fc96-02a2-4587-9f02-37003f958f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9a9e7a581b42a5a1428db2cbd7bc47', 'request_id': 'req-3967fc96-02a2-4587-9f02-37003f958f33'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:09.476514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3967fc96-02a2-4587-9f02-37003f958f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9a9e7a581b42a5a1428db2cbd7bc47', 'request_id': 'req-3967fc96-02a2-4587-9f02-37003f958f33'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:09.484236 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3967fc96-02a2-4587-9f02-37003f958f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9a9e7a581b42a5a1428db2cbd7bc47', 'request_id': 'req-3967fc96-02a2-4587-9f02-37003f958f33'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:09.495436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3967fc96-02a2-4587-9f02-37003f958f33 admin admin] The token cache is being invalidate because project 5e9a9e7a581b42a5a1428db2cbd7bc47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:14:09.495722 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3967fc96-02a2-4587-9f02-37003f958f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:09.496381 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3967fc96-02a2-4587-9f02-37003f958f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:14:09.498046 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1429/2801] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:14:09 2022] DELETE /identity/v3/projects/5e9a9e7a581b42a5a1428db2cbd7bc47 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:14:18.850230 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:19.556691 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:20.667798 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a284e5-8fec-4930-a886-172d4cf65476 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:20.668375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a284e5-8fec-4930-a886-172d4cf65476 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:20.668375 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a284e5-8fec-4930-a886-172d4cf65476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:20.685577 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-25a284e5-8fec-4930-a886-172d4cf65476 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:14:20.690150 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-25a284e5-8fec-4930-a886-172d4cf65476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:20.744845 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1373/2802] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jun 2 16:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:14:20.759398 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967fc96-02a2-4587-9f02-37003f958f33 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:20.760808 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3967fc96-02a2-4587-9f02-37003f958f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:20.832640 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967fc96-02a2-4587-9f02-37003f958f33 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:20.838118 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b96c2-68ce-4c40-8903-a3af5c32941d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:20.838761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b96c2-68ce-4c40-8903-a3af5c32941d service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:20.839051 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b96c2-68ce-4c40-8903-a3af5c32941d service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:20.839334 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b96c2-68ce-4c40-8903-a3af5c32941d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:20.847333 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b96c2-68ce-4c40-8903-a3af5c32941d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:20.848948 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b96c2-68ce-4c40-8903-a3af5c32941d service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:20.858259 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1430/2803] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:14:24.436616 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4153f-fb6a-41cf-9b4f-3f969cc7bdf3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:24.437136 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4153f-fb6a-41cf-9b4f-3f969cc7bdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:24.437136 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4153f-fb6a-41cf-9b4f-3f969cc7bdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:24.455362 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bbe4153f-fb6a-41cf-9b4f-3f969cc7bdf3 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:14:24.456602 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bbe4153f-fb6a-41cf-9b4f-3f969cc7bdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:24.464512 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1374/2804] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jun 2 16:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:14:24.478861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b96c2-68ce-4c40-8903-a3af5c32941d service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:24.480362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ed7b96c2-68ce-4c40-8903-a3af5c32941d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:24.495514 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b96c2-68ce-4c40-8903-a3af5c32941d service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:24.500988 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd8c70-c742-4e13-9da5-fea8f101e9c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:24.501621 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd8c70-c742-4e13-9da5-fea8f101e9c4 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:24.501937 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd8c70-c742-4e13-9da5-fea8f101e9c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:24.502217 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd8c70-c742-4e13-9da5-fea8f101e9c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:24.510300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd8c70-c742-4e13-9da5-fea8f101e9c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:24.511870 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd8c70-c742-4e13-9da5-fea8f101e9c4 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:24.522285 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1431/2805] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:14:27.138792 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc9531-0df2-4234-ad65-9081f8d4ddb4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:27.139260 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc9531-0df2-4234-ad65-9081f8d4ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:27.139381 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc9531-0df2-4234-ad65-9081f8d4ddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:27.159235 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0adc9531-0df2-4234-ad65-9081f8d4ddb4 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:14:27.160479 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0adc9531-0df2-4234-ad65-9081f8d4ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:27.168622 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1375/2806] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jun 2 16:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:14:27.192845 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd8c70-c742-4e13-9da5-fea8f101e9c4 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:27.204040 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd8c70-c742-4e13-9da5-fea8f101e9c4 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:27.210267 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078138c1-c22b-404a-8804-bbe5330fe708 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:27.210906 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078138c1-c22b-404a-8804-bbe5330fe708 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:27.211221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078138c1-c22b-404a-8804-bbe5330fe708 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:27.211488 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078138c1-c22b-404a-8804-bbe5330fe708 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:27.219729 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078138c1-c22b-404a-8804-bbe5330fe708 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:27.221362 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078138c1-c22b-404a-8804-bbe5330fe708 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:27.230814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1432/2807] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:14:30.439784 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f971-a19b-4bd9-9572-e739866a8d08 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:30.440353 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f971-a19b-4bd9-9572-e739866a8d08 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:30.440471 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f971-a19b-4bd9-9572-e739866a8d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:30.458546 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3472f971-a19b-4bd9-9572-e739866a8d08 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:14:30.460060 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3472f971-a19b-4bd9-9572-e739866a8d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:30.468105 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1376/2808] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jun 2 16:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:14:30.483038 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078138c1-c22b-404a-8804-bbe5330fe708 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:30.494504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078138c1-c22b-404a-8804-bbe5330fe708 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:30.500140 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e056a-0035-44b8-9c20-2e83baa988b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:30.500773 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e056a-0035-44b8-9c20-2e83baa988b2 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:30.501066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e056a-0035-44b8-9c20-2e83baa988b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:30.501352 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e056a-0035-44b8-9c20-2e83baa988b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:30.509929 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e056a-0035-44b8-9c20-2e83baa988b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:30.511506 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e056a-0035-44b8-9c20-2e83baa988b2 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:30.521772 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1433/2809] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:14:33.656324 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85078ad9-ebf3-40bc-8882-467ccc6019ec None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:33.657169 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85078ad9-ebf3-40bc-8882-467ccc6019ec None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:33.657456 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85078ad9-ebf3-40bc-8882-467ccc6019ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:33.675788 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-85078ad9-ebf3-40bc-8882-467ccc6019ec None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:14:33.677054 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-85078ad9-ebf3-40bc-8882-467ccc6019ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:14:33.684944 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1377/2810] 10.222.0.39 () {58 vars in 1016 bytes} [Thu Jun 2 16:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:14:33.701018 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e056a-0035-44b8-9c20-2e83baa988b2 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:14:33.712074 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e056a-0035-44b8-9c20-2e83baa988b2 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:14:33.717804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3c5e7-a56b-438c-96c3-c1a46591c2f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:14:33.721511 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3c5e7-a56b-438c-96c3-c1a46591c2f0 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:14:33.721511 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3c5e7-a56b-438c-96c3-c1a46591c2f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:14:33.721511 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3c5e7-a56b-438c-96c3-c1a46591c2f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:14:33.727231 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3c5e7-a56b-438c-96c3-c1a46591c2f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:14:33.728842 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3c5e7-a56b-438c-96c3-c1a46591c2f0 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:14:33.738705 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1434/2811] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:14:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:14:43.670135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=39 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:14:43.733951 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=58 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:05.939004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85078ad9-ebf3-40bc-8882-467ccc6019ec None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:05.940143 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-85078ad9-ebf3-40bc-8882-467ccc6019ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:05.952547 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85078ad9-ebf3-40bc-8882-467ccc6019ec None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:05.957618 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34997c-2bcf-4d83-8afc-3b87cda5fa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:05.958483 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34997c-2bcf-4d83-8afc-3b87cda5fa8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:05.958767 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34997c-2bcf-4d83-8afc-3b87cda5fa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:05.959045 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34997c-2bcf-4d83-8afc-3b87cda5fa8e admin admin] PATH_INFO: `/v3/users/3a2bd2ed4ed144178daf6c52cf5c86e4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:05.961062 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34997c-2bcf-4d83-8afc-3b87cda5fa8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2bd2ed4ed144178daf6c52cf5c86e4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:05.963155 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34997c-2bcf-4d83-8afc-3b87cda5fa8e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:06.144732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dc34997c-2bcf-4d83-8afc-3b87cda5fa8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2bd2ed4ed144178daf6c52cf5c86e4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:06.156374 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dc34997c-2bcf-4d83-8afc-3b87cda5fa8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2bd2ed4ed144178daf6c52cf5c86e4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:06.157036 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dc34997c-2bcf-4d83-8afc-3b87cda5fa8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2bd2ed4ed144178daf6c52cf5c86e4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:06.163783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dc34997c-2bcf-4d83-8afc-3b87cda5fa8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2bd2ed4ed144178daf6c52cf5c86e4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:06.164920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dc34997c-2bcf-4d83-8afc-3b87cda5fa8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2bd2ed4ed144178daf6c52cf5c86e4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:06.253204 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1378/2812] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:15:05 2022] DELETE /identity/v3/users/3a2bd2ed4ed144178daf6c52cf5c86e4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:15:06.500058 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3c5e7-a56b-438c-96c3-c1a46591c2f0 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:15:06.509890 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3c5e7-a56b-438c-96c3-c1a46591c2f0 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:15:06.567854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a337e9-9cce-4eb2-b372-59859350ccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:15:06.568791 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a337e9-9cce-4eb2-b372-59859350ccac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:06.569073 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a337e9-9cce-4eb2-b372-59859350ccac admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:06.569355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a337e9-9cce-4eb2-b372-59859350ccac admin admin] PATH_INFO: `/v3/projects/df72412f54564d12bd4a3a0d5a51566c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:06.570599 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a337e9-9cce-4eb2-b372-59859350ccac admin admin] RBAC: Authorizing `identity:delete_project(project_id=df72412f54564d12bd4a3a0d5a51566c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:15:06.572552 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a337e9-9cce-4eb2-b372-59859350ccac admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:15:06.690283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-93a337e9-9cce-4eb2-b372-59859350ccac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df72412f54564d12bd4a3a0d5a51566c', 'request_id': 'req-93a337e9-9cce-4eb2-b372-59859350ccac'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:06.759865 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-93a337e9-9cce-4eb2-b372-59859350ccac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df72412f54564d12bd4a3a0d5a51566c', 'request_id': 'req-93a337e9-9cce-4eb2-b372-59859350ccac'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:06.766670 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-93a337e9-9cce-4eb2-b372-59859350ccac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df72412f54564d12bd4a3a0d5a51566c', 'request_id': 'req-93a337e9-9cce-4eb2-b372-59859350ccac'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:06.777584 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-93a337e9-9cce-4eb2-b372-59859350ccac admin admin] The token cache is being invalidate because project df72412f54564d12bd4a3a0d5a51566c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:15:06.777931 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-93a337e9-9cce-4eb2-b372-59859350ccac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:06.778561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-93a337e9-9cce-4eb2-b372-59859350ccac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:15:06.780130 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1435/2813] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:15:06 2022] DELETE /identity/v3/projects/df72412f54564d12bd4a3a0d5a51566c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:15:16.249477 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:16.773898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:15:27.345072 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6443ef-cd03-4786-b04a-1347d4bdcd85 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:15:27.345555 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6443ef-cd03-4786-b04a-1347d4bdcd85 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:15:27.345672 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6443ef-cd03-4786-b04a-1347d4bdcd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:15:27.364393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4e6443ef-cd03-4786-b04a-1347d4bdcd85 None None] MFA Rules not processed for user `21212ff6f80441eab1538722c960481c`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:15:27.365592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4e6443ef-cd03-4786-b04a-1347d4bdcd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:15:27.419247 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1379/2814] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:15:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:15:37.412880 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=25 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:22.031447 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a337e9-9cce-4eb2-b372-59859350ccac admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:22.038801 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-93a337e9-9cce-4eb2-b372-59859350ccac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:22.092195 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a337e9-9cce-4eb2-b372-59859350ccac admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:22.095791 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f2b98-53d7-498d-9396-0bf28945f036 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:22.096464 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f2b98-53d7-498d-9396-0bf28945f036 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:22.097702 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f2b98-53d7-498d-9396-0bf28945f036 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:22.097702 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f2b98-53d7-498d-9396-0bf28945f036 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:22.098779 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f16f2b98-53d7-498d-9396-0bf28945f036 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:22.168981 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f2b98-53d7-498d-9396-0bf28945f036 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:22.170418 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f2b98-53d7-498d-9396-0bf28945f036 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:22.181841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1436/2815] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:16:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:16:26.889787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6443ef-cd03-4786-b04a-1347d4bdcd85 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:26.899451 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6443ef-cd03-4786-b04a-1347d4bdcd85 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:26.903135 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7ca75-38eb-4714-a74a-d53ecabf1ae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:26.903770 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7ca75-38eb-4714-a74a-d53ecabf1ae6 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:26.904084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7ca75-38eb-4714-a74a-d53ecabf1ae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:26.904368 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7ca75-38eb-4714-a74a-d53ecabf1ae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:26.906094 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-53e7ca75-38eb-4714-a74a-d53ecabf1ae6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:26.919546 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7ca75-38eb-4714-a74a-d53ecabf1ae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:26.921000 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7ca75-38eb-4714-a74a-d53ecabf1ae6 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:26.932367 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1380/2816] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:16:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:16:32.176891 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=54 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:36.927634 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:46.976953 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f2b98-53d7-498d-9396-0bf28945f036 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:46.978427 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f16f2b98-53d7-498d-9396-0bf28945f036 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:47.042744 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f2b98-53d7-498d-9396-0bf28945f036 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:47.047235 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc422f4f-f52b-443a-8e47-104759fa4efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:47.048129 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc422f4f-f52b-443a-8e47-104759fa4efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:47.048423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc422f4f-f52b-443a-8e47-104759fa4efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:47.048735 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc422f4f-f52b-443a-8e47-104759fa4efc admin admin] PATH_INFO: `/v3/users/21212ff6f80441eab1538722c960481c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:47.049917 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc422f4f-f52b-443a-8e47-104759fa4efc admin admin] RBAC: Authorizing `identity:delete_user(user_id=21212ff6f80441eab1538722c960481c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:47.051854 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc422f4f-f52b-443a-8e47-104759fa4efc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:47.271109 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fc422f4f-f52b-443a-8e47-104759fa4efc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21212ff6f80441eab1538722c960481c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:47.271766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fc422f4f-f52b-443a-8e47-104759fa4efc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21212ff6f80441eab1538722c960481c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:47.352663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fc422f4f-f52b-443a-8e47-104759fa4efc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21212ff6f80441eab1538722c960481c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:47.360655 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fc422f4f-f52b-443a-8e47-104759fa4efc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21212ff6f80441eab1538722c960481c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:47.361804 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fc422f4f-f52b-443a-8e47-104759fa4efc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21212ff6f80441eab1538722c960481c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:47.379597 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1437/2817] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:16:46 2022] DELETE /identity/v3/users/21212ff6f80441eab1538722c960481c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:16:47.630234 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7ca75-38eb-4714-a74a-d53ecabf1ae6 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:47.643457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7ca75-38eb-4714-a74a-d53ecabf1ae6 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:47.698698 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73b847-bcc3-412d-bf58-6038be3180c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:47.699565 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73b847-bcc3-412d-bf58-6038be3180c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:47.699852 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73b847-bcc3-412d-bf58-6038be3180c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:47.700169 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73b847-bcc3-412d-bf58-6038be3180c2 admin admin] PATH_INFO: `/v3/projects/9ec63da2fbbf405597fd0369b0d48482` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:47.701348 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73b847-bcc3-412d-bf58-6038be3180c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ec63da2fbbf405597fd0369b0d48482)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:47.703253 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73b847-bcc3-412d-bf58-6038be3180c2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:47.811758 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fb73b847-bcc3-412d-bf58-6038be3180c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec63da2fbbf405597fd0369b0d48482', 'request_id': 'req-fb73b847-bcc3-412d-bf58-6038be3180c2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:47.817554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fb73b847-bcc3-412d-bf58-6038be3180c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec63da2fbbf405597fd0369b0d48482', 'request_id': 'req-fb73b847-bcc3-412d-bf58-6038be3180c2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:47.902667 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fb73b847-bcc3-412d-bf58-6038be3180c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec63da2fbbf405597fd0369b0d48482', 'request_id': 'req-fb73b847-bcc3-412d-bf58-6038be3180c2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:47.915488 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fb73b847-bcc3-412d-bf58-6038be3180c2 admin admin] The token cache is being invalidate because project 9ec63da2fbbf405597fd0369b0d48482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:16:47.915794 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fb73b847-bcc3-412d-bf58-6038be3180c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:47.916445 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fb73b847-bcc3-412d-bf58-6038be3180c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:47.918020 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1381/2818] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:16:47 2022] DELETE /identity/v3/projects/9ec63da2fbbf405597fd0369b0d48482 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:16:47.923056 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670afe54-33ad-4a37-8d2d-c87b0873f773 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:47.923350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670afe54-33ad-4a37-8d2d-c87b0873f773 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:47.923680 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670afe54-33ad-4a37-8d2d-c87b0873f773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:47.942327 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-670afe54-33ad-4a37-8d2d-c87b0873f773 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:16:47.943533 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-670afe54-33ad-4a37-8d2d-c87b0873f773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:48.000696 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1438/2819] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:16:48.008480 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fef236-9f1b-44a2-ad9d-919b9ef98a21 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:48.008772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fef236-9f1b-44a2-ad9d-919b9ef98a21 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:48.009051 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fef236-9f1b-44a2-ad9d-919b9ef98a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:48.027796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-51fef236-9f1b-44a2-ad9d-919b9ef98a21 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:16:48.029061 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-51fef236-9f1b-44a2-ad9d-919b9ef98a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:48.037834 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1382/2820] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:16:48.042190 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670afe54-33ad-4a37-8d2d-c87b0873f773 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:48.052949 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670afe54-33ad-4a37-8d2d-c87b0873f773 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:48.057562 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4723fee-43d5-4691-9ef6-03a2b2c509f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:48.058210 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723fee-43d5-4691-9ef6-03a2b2c509f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:48.058492 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723fee-43d5-4691-9ef6-03a2b2c509f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:48.058766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4723fee-43d5-4691-9ef6-03a2b2c509f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:48.059485 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4723fee-43d5-4691-9ef6-03a2b2c509f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:16:48.059793 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4723fee-43d5-4691-9ef6-03a2b2c509f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:48.061428 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4723fee-43d5-4691-9ef6-03a2b2c509f8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:48.073060 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1439/2821] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:16:48.077160 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fef236-9f1b-44a2-ad9d-919b9ef98a21 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:48.087462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fef236-9f1b-44a2-ad9d-919b9ef98a21 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:48.092113 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45318c-357a-474d-a1be-a782fce801f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:48.092787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45318c-357a-474d-a1be-a782fce801f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:48.093074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45318c-357a-474d-a1be-a782fce801f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:48.093355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45318c-357a-474d-a1be-a782fce801f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:48.094054 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45318c-357a-474d-a1be-a782fce801f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:48.096529 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45318c-357a-474d-a1be-a782fce801f6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:48.213457 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1383/2822] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:16:48 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:16:48.217184 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4723fee-43d5-4691-9ef6-03a2b2c509f8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:48.227929 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4723fee-43d5-4691-9ef6-03a2b2c509f8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:48.231635 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:48.284766 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15300fd5-c36b-461e-8fb1-16727f2abc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:48.285437 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15300fd5-c36b-461e-8fb1-16727f2abc0a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:48.285725 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15300fd5-c36b-461e-8fb1-16727f2abc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:48.286003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15300fd5-c36b-461e-8fb1-16727f2abc0a admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:48.286689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15300fd5-c36b-461e-8fb1-16727f2abc0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:48.288624 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15300fd5-c36b-461e-8fb1-16727f2abc0a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:48.392048 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1440/2823] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:16:48 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:16:48.393430 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45318c-357a-474d-a1be-a782fce801f6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:48.404436 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45318c-357a-474d-a1be-a782fce801f6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:48.409779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b45a04-6079-45eb-8953-3b7d2de260b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:48.410431 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b45a04-6079-45eb-8953-3b7d2de260b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:48.410718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b45a04-6079-45eb-8953-3b7d2de260b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:48.411000 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b45a04-6079-45eb-8953-3b7d2de260b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:48.411730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b45a04-6079-45eb-8953-3b7d2de260b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:48.413376 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b45a04-6079-45eb-8953-3b7d2de260b7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:48.427101 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1384/2824] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:16:48.428271 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15300fd5-c36b-461e-8fb1-16727f2abc0a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:48.438547 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15300fd5-c36b-461e-8fb1-16727f2abc0a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:48.443815 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90908966-6404-4ce7-998f-df74c681005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:48.444534 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90908966-6404-4ce7-998f-df74c681005b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:48.444821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90908966-6404-4ce7-998f-df74c681005b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:48.445102 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90908966-6404-4ce7-998f-df74c681005b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:48.445828 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90908966-6404-4ce7-998f-df74c681005b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:48.447456 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90908966-6404-4ce7-998f-df74c681005b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:48.458140 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1441/2825] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:16:48.462463 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b45a04-6079-45eb-8953-3b7d2de260b7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:48.472912 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b45a04-6079-45eb-8953-3b7d2de260b7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:48.477643 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5de789-724d-4a55-bf9d-0c63c05e7755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:48.478520 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5de789-724d-4a55-bf9d-0c63c05e7755 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:48.478807 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5de789-724d-4a55-bf9d-0c63c05e7755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:48.479092 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5de789-724d-4a55-bf9d-0c63c05e7755 admin admin] PATH_INFO: `/v3/projects/d5f0b1240abd4bbbb33c35f5220b9607/users/de394d2840654dbd9b7243dc90ca8fd0/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:48.493454 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5de789-724d-4a55-bf9d-0c63c05e7755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f0b1240abd4bbbb33c35f5220b9607, user_id=de394d2840654dbd9b7243dc90ca8fd0, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:48.496171 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5de789-724d-4a55-bf9d-0c63c05e7755 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:48.605365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1385/2826] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:16:48 2022] PUT /identity/v3/projects/d5f0b1240abd4bbbb33c35f5220b9607/users/de394d2840654dbd9b7243dc90ca8fd0/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:16:48.615275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710409ff-3bec-4fb7-9d54-dc144e1f5c9a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:48.615576 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710409ff-3bec-4fb7-9d54-dc144e1f5c9a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:48.615892 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710409ff-3bec-4fb7-9d54-dc144e1f5c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:48.642337 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-710409ff-3bec-4fb7-9d54-dc144e1f5c9a None None] MFA Rules not processed for user `de394d2840654dbd9b7243dc90ca8fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:16:48.644153 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-710409ff-3bec-4fb7-9d54-dc144e1f5c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:48.706616 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1442/2827] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:16:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:16:48.716953 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5de789-724d-4a55-bf9d-0c63c05e7755 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:48.718593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9e5de789-724d-4a55-bf9d-0c63c05e7755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:48.749136 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:48.792004 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5de789-724d-4a55-bf9d-0c63c05e7755 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:48.797482 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bb857-30df-49b4-ab2d-3f28306475ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e53683ae2b34947a1550de269b74d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:48.798115 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bb857-30df-49b4-ab2d-3f28306475ab service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:48.798429 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bb857-30df-49b4-ab2d-3f28306475ab service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:48.802556 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bb857-30df-49b4-ab2d-3f28306475ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:48.806836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bb857-30df-49b4-ab2d-3f28306475ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:48.808485 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bb857-30df-49b4-ab2d-3f28306475ab service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:48.817747 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1386/2828] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:16:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:16:51.991877 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710409ff-3bec-4fb7-9d54-dc144e1f5c9a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:52.050468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710409ff-3bec-4fb7-9d54-dc144e1f5c9a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:52.054964 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dae10-54c4-4c99-b885-dd03c97ca876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:52.055817 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dae10-54c4-4c99-b885-dd03c97ca876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:52.056142 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dae10-54c4-4c99-b885-dd03c97ca876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:52.056423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3dae10-54c4-4c99-b885-dd03c97ca876 admin admin] PATH_INFO: `/v3/users/de394d2840654dbd9b7243dc90ca8fd0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:52.057596 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3dae10-54c4-4c99-b885-dd03c97ca876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de394d2840654dbd9b7243dc90ca8fd0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:52.059515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3dae10-54c4-4c99-b885-dd03c97ca876 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:52.074317 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:52.219211 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-de3dae10-54c4-4c99-b885-dd03c97ca876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de394d2840654dbd9b7243dc90ca8fd0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:52.219777 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-de3dae10-54c4-4c99-b885-dd03c97ca876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de394d2840654dbd9b7243dc90ca8fd0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:52.268959 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-de3dae10-54c4-4c99-b885-dd03c97ca876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de394d2840654dbd9b7243dc90ca8fd0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:52.276059 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-de3dae10-54c4-4c99-b885-dd03c97ca876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de394d2840654dbd9b7243dc90ca8fd0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:52.276730 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-de3dae10-54c4-4c99-b885-dd03c97ca876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de394d2840654dbd9b7243dc90ca8fd0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:52.294088 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1443/2829] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:16:51 2022] DELETE /identity/v3/users/de394d2840654dbd9b7243dc90ca8fd0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:16:52.298656 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f1f7e-97d1-4e3b-a5ca-c6157bc8f84d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:52.299144 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f1f7e-97d1-4e3b-a5ca-c6157bc8f84d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:52.299280 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f1f7e-97d1-4e3b-a5ca-c6157bc8f84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:52.316425 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3c2f1f7e-97d1-4e3b-a5ca-c6157bc8f84d None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:16:52.317613 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3c2f1f7e-97d1-4e3b-a5ca-c6157bc8f84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:52.382806 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1387/2830] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 16:16:52.393404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dae10-54c4-4c99-b885-dd03c97ca876 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:52.394829 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-de3dae10-54c4-4c99-b885-dd03c97ca876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:52.451031 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3dae10-54c4-4c99-b885-dd03c97ca876 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:52.455292 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdafbce3-7579-4b15-8dbe-48db4286b686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:52.455970 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafbce3-7579-4b15-8dbe-48db4286b686 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:52.456289 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafbce3-7579-4b15-8dbe-48db4286b686 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:52.456574 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafbce3-7579-4b15-8dbe-48db4286b686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:52.465589 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafbce3-7579-4b15-8dbe-48db4286b686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:52.467014 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdafbce3-7579-4b15-8dbe-48db4286b686 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:52.476494 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1444/2831] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:16:52.955439 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f1f7e-97d1-4e3b-a5ca-c6157bc8f84d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:52.956982 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3c2f1f7e-97d1-4e3b-a5ca-c6157bc8f84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:52.969164 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f1f7e-97d1-4e3b-a5ca-c6157bc8f84d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:52.974402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadcf0e-bff9-4fbc-869f-4b0574935088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:52.975229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadcf0e-bff9-4fbc-869f-4b0574935088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:52.975517 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadcf0e-bff9-4fbc-869f-4b0574935088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:52.975797 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadcf0e-bff9-4fbc-869f-4b0574935088 admin admin] PATH_INFO: `/v3/projects/d5f0b1240abd4bbbb33c35f5220b9607` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:52.977028 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadcf0e-bff9-4fbc-869f-4b0574935088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5f0b1240abd4bbbb33c35f5220b9607)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:52.978972 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadcf0e-bff9-4fbc-869f-4b0574935088 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:53.103823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aaadcf0e-bff9-4fbc-869f-4b0574935088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5f0b1240abd4bbbb33c35f5220b9607', 'request_id': 'req-aaadcf0e-bff9-4fbc-869f-4b0574935088'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:53.109365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aaadcf0e-bff9-4fbc-869f-4b0574935088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5f0b1240abd4bbbb33c35f5220b9607', 'request_id': 'req-aaadcf0e-bff9-4fbc-869f-4b0574935088'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:53.188134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aaadcf0e-bff9-4fbc-869f-4b0574935088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5f0b1240abd4bbbb33c35f5220b9607', 'request_id': 'req-aaadcf0e-bff9-4fbc-869f-4b0574935088'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:53.199393 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aaadcf0e-bff9-4fbc-869f-4b0574935088 admin admin] The token cache is being invalidate because project d5f0b1240abd4bbbb33c35f5220b9607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:16:53.199678 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aaadcf0e-bff9-4fbc-869f-4b0574935088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:53.200308 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-aaadcf0e-bff9-4fbc-869f-4b0574935088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:16:53.201849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1388/2832] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:16:52 2022] DELETE /identity/v3/projects/d5f0b1240abd4bbbb33c35f5220b9607 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:16:53.206858 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45515011-4c68-4da5-b82c-9d866dc76d86 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:53.207331 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45515011-4c68-4da5-b82c-9d866dc76d86 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:53.207437 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45515011-4c68-4da5-b82c-9d866dc76d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:53.225354 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-45515011-4c68-4da5-b82c-9d866dc76d86 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:16:53.226536 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-45515011-4c68-4da5-b82c-9d866dc76d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:53.285099 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1445/2833] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:16:53.294024 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287ef6e-7271-4cc9-8959-f44f140249ef None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:53.294318 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287ef6e-7271-4cc9-8959-f44f140249ef None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:53.294600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287ef6e-7271-4cc9-8959-f44f140249ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:53.312656 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1287ef6e-7271-4cc9-8959-f44f140249ef None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:16:53.313859 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1287ef6e-7271-4cc9-8959-f44f140249ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:53.321713 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1389/2834] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:16:53.325983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45515011-4c68-4da5-b82c-9d866dc76d86 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:53.336453 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45515011-4c68-4da5-b82c-9d866dc76d86 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:53.341140 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bdff8-3b44-49ae-8b74-279c551cbc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:53.341786 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bdff8-3b44-49ae-8b74-279c551cbc45 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:53.342072 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bdff8-3b44-49ae-8b74-279c551cbc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:53.342374 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bdff8-3b44-49ae-8b74-279c551cbc45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:53.343100 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bdff8-3b44-49ae-8b74-279c551cbc45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:16:53.343404 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bdff8-3b44-49ae-8b74-279c551cbc45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:53.345035 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bdff8-3b44-49ae-8b74-279c551cbc45 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:53.357546 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1446/2835] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:16:53.361686 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287ef6e-7271-4cc9-8959-f44f140249ef None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:53.371005 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287ef6e-7271-4cc9-8959-f44f140249ef None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:53.375654 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb53bd-1c2a-4968-ab67-e09b6dbdb4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:53.376333 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb53bd-1c2a-4968-ab67-e09b6dbdb4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:53.376623 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb53bd-1c2a-4968-ab67-e09b6dbdb4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:53.376904 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb53bd-1c2a-4968-ab67-e09b6dbdb4a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:53.377592 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb53bd-1c2a-4968-ab67-e09b6dbdb4a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:53.379476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb53bd-1c2a-4968-ab67-e09b6dbdb4a8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:53.516040 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1390/2836] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:16:53 2022] POST /identity/v3/projects => generated 407 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:16:53.520881 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bdff8-3b44-49ae-8b74-279c551cbc45 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:53.530801 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bdff8-3b44-49ae-8b74-279c551cbc45 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:53.551221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:53.586556 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa6a1f-4438-443d-b85e-94300870c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:53.587292 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa6a1f-4438-443d-b85e-94300870c471 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:53.587575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa6a1f-4438-443d-b85e-94300870c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:53.587855 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa6a1f-4438-443d-b85e-94300870c471 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:53.588579 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa6a1f-4438-443d-b85e-94300870c471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:53.590478 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa6a1f-4438-443d-b85e-94300870c471 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:53.714350 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1447/2837] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:16:53 2022] POST /identity/v3/users => generated 304 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:16:53.718378 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb53bd-1c2a-4968-ab67-e09b6dbdb4a8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:53.728955 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb53bd-1c2a-4968-ab67-e09b6dbdb4a8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:53.733614 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634c318-3816-4e2a-9af8-7f2ea0eb7276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:53.734264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634c318-3816-4e2a-9af8-7f2ea0eb7276 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:53.734553 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634c318-3816-4e2a-9af8-7f2ea0eb7276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:53.734836 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634c318-3816-4e2a-9af8-7f2ea0eb7276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:53.737554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634c318-3816-4e2a-9af8-7f2ea0eb7276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:53.737554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634c318-3816-4e2a-9af8-7f2ea0eb7276 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:53.738402 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:53.747752 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1391/2838] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:16:53.752291 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa6a1f-4438-443d-b85e-94300870c471 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:53.762148 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa6a1f-4438-443d-b85e-94300870c471 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:53.768170 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1694c-5f5d-4eb0-a539-b3585a704fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:53.771832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1694c-5f5d-4eb0-a539-b3585a704fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:53.771832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1694c-5f5d-4eb0-a539-b3585a704fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:53.771832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1694c-5f5d-4eb0-a539-b3585a704fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:53.771832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1694c-5f5d-4eb0-a539-b3585a704fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:53.771832 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1694c-5f5d-4eb0-a539-b3585a704fe9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:53.781729 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1448/2839] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:16:53.785894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634c318-3816-4e2a-9af8-7f2ea0eb7276 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:53.795707 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634c318-3816-4e2a-9af8-7f2ea0eb7276 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:53.800269 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc216be-b28d-42ab-9717-f4f9eb427ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:53.801159 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc216be-b28d-42ab-9717-f4f9eb427ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:53.801427 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc216be-b28d-42ab-9717-f4f9eb427ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:53.801712 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc216be-b28d-42ab-9717-f4f9eb427ae8 admin admin] PATH_INFO: `/v3/projects/dd62e15cd23b41b8ad6ed30235b199f5/users/1cd28460756c49cbaeab312897b41a77/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:53.817070 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc216be-b28d-42ab-9717-f4f9eb427ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd62e15cd23b41b8ad6ed30235b199f5, user_id=1cd28460756c49cbaeab312897b41a77, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:53.819743 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc216be-b28d-42ab-9717-f4f9eb427ae8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:53.884897 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1392/2840] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:16:53 2022] PUT /identity/v3/projects/dd62e15cd23b41b8ad6ed30235b199f5/users/1cd28460756c49cbaeab312897b41a77/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:16:53.895897 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528e3f-844e-43fb-a379-8505ca672af0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:53.896218 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528e3f-844e-43fb-a379-8505ca672af0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:53.896498 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528e3f-844e-43fb-a379-8505ca672af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:53.922202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-39528e3f-844e-43fb-a379-8505ca672af0 None None] MFA Rules not processed for user `1cd28460756c49cbaeab312897b41a77`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:16:53.923397 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-39528e3f-844e-43fb-a379-8505ca672af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:53.985457 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1449/2841] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:16:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:16:53.989852 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc216be-b28d-42ab-9717-f4f9eb427ae8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:54.051224 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc216be-b28d-42ab-9717-f4f9eb427ae8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:54.055814 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e566048-435d-4f6f-a65d-1334dbc80499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:54.056491 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e566048-435d-4f6f-a65d-1334dbc80499 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:54.056780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e566048-435d-4f6f-a65d-1334dbc80499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:54.057057 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e566048-435d-4f6f-a65d-1334dbc80499 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:54.057751 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e566048-435d-4f6f-a65d-1334dbc80499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:54.059633 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e566048-435d-4f6f-a65d-1334dbc80499 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:54.120418 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1393/2842] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:16:53 2022] POST /identity/v3/projects => generated 407 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:16:54.124479 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528e3f-844e-43fb-a379-8505ca672af0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:54.135663 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528e3f-844e-43fb-a379-8505ca672af0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:54.190469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a9328-65d5-45e5-9475-a0b78d94ebb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:54.191128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a9328-65d5-45e5-9475-a0b78d94ebb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:54.191413 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a9328-65d5-45e5-9475-a0b78d94ebb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:54.191692 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a9328-65d5-45e5-9475-a0b78d94ebb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:54.192401 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a9328-65d5-45e5-9475-a0b78d94ebb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:54.194308 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a9328-65d5-45e5-9475-a0b78d94ebb3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:54.250919 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1450/2843] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:16:54 2022] POST /identity/v3/users => generated 310 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:16:54.255585 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e566048-435d-4f6f-a65d-1334dbc80499 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:54.266022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e566048-435d-4f6f-a65d-1334dbc80499 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:54.271188 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedc8b7-3612-4d6a-acf1-15e28714521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:54.271843 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedc8b7-3612-4d6a-acf1-15e28714521e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:54.272170 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedc8b7-3612-4d6a-acf1-15e28714521e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:54.272447 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedc8b7-3612-4d6a-acf1-15e28714521e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:54.273210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bedc8b7-3612-4d6a-acf1-15e28714521e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:54.274785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bedc8b7-3612-4d6a-acf1-15e28714521e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:54.285087 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1394/2844] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:16:54.289128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a9328-65d5-45e5-9475-a0b78d94ebb3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:54.299512 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a9328-65d5-45e5-9475-a0b78d94ebb3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:54.304112 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7e1c6-b443-4a93-95a4-7a18535088c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:54.304998 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7e1c6-b443-4a93-95a4-7a18535088c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:54.305291 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7e1c6-b443-4a93-95a4-7a18535088c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:54.305575 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7e1c6-b443-4a93-95a4-7a18535088c3 admin admin] PATH_INFO: `/v3/projects/e71f4d5404654f89ad9316f952648d83/users/1e53fd16be0f49918b604d8f254220f6/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:54.320764 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7e1c6-b443-4a93-95a4-7a18535088c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71f4d5404654f89ad9316f952648d83, user_id=1e53fd16be0f49918b604d8f254220f6, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:54.323423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7e1c6-b443-4a93-95a4-7a18535088c3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:54.383676 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:54.389590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1451/2845] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:16:54 2022] PUT /identity/v3/projects/e71f4d5404654f89ad9316f952648d83/users/1e53fd16be0f49918b604d8f254220f6/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:16:54.393888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedc8b7-3612-4d6a-acf1-15e28714521e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:54.404166 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedc8b7-3612-4d6a-acf1-15e28714521e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:54.460006 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f628ec5-1e63-4442-b8a4-ee27552e1e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:54.460676 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f628ec5-1e63-4442-b8a4-ee27552e1e85 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:54.460965 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f628ec5-1e63-4442-b8a4-ee27552e1e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:54.461246 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f628ec5-1e63-4442-b8a4-ee27552e1e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:54.461961 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f628ec5-1e63-4442-b8a4-ee27552e1e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:54.463552 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f628ec5-1e63-4442-b8a4-ee27552e1e85 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:54.473718 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1395/2846] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:16:54.477807 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7e1c6-b443-4a93-95a4-7a18535088c3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:54.488544 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7e1c6-b443-4a93-95a4-7a18535088c3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:54.493163 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ea684-272a-44cb-aa4e-329b5951dd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:54.494034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ea684-272a-44cb-aa4e-329b5951dd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:54.494315 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ea684-272a-44cb-aa4e-329b5951dd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:54.494603 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ea684-272a-44cb-aa4e-329b5951dd07 admin admin] PATH_INFO: `/v3/projects/e71f4d5404654f89ad9316f952648d83/users/1e53fd16be0f49918b604d8f254220f6/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:54.496671 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ea684-272a-44cb-aa4e-329b5951dd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71f4d5404654f89ad9316f952648d83, user_id=1e53fd16be0f49918b604d8f254220f6, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:54.499294 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ea684-272a-44cb-aa4e-329b5951dd07 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:54.509526 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1452/2847] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:16:54 2022] PUT /identity/v3/projects/e71f4d5404654f89ad9316f952648d83/users/1e53fd16be0f49918b604d8f254220f6/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:16:54.519508 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17f755-a2e9-4fb4-a1cb-d5e75311e15f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:54.519867 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17f755-a2e9-4fb4-a1cb-d5e75311e15f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:54.520173 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17f755-a2e9-4fb4-a1cb-d5e75311e15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:54.546633 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0c17f755-a2e9-4fb4-a1cb-d5e75311e15f None None] MFA Rules not processed for user `1e53fd16be0f49918b604d8f254220f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:16:54.547849 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0c17f755-a2e9-4fb4-a1cb-d5e75311e15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:54.577275 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:16:54.615041 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1396/2848] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:16:54 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:16:54.625505 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ea684-272a-44cb-aa4e-329b5951dd07 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:54.627403 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2d4ea684-272a-44cb-aa4e-329b5951dd07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:16:54.683976 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ea684-272a-44cb-aa4e-329b5951dd07 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:54.687649 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9c16a-6e3a-4cec-8542-0af0a151a65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:54.688313 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c16a-6e3a-4cec-8542-0af0a151a65e service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:54.688607 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c16a-6e3a-4cec-8542-0af0a151a65e service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:54.688888 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c16a-6e3a-4cec-8542-0af0a151a65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:54.697740 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9c16a-6e3a-4cec-8542-0af0a151a65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:54.699198 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9c16a-6e3a-4cec-8542-0af0a151a65e service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:54.708484 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1453/2849] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:16:54 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:16:55.063787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17f755-a2e9-4fb4-a1cb-d5e75311e15f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:16:55.073587 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17f755-a2e9-4fb4-a1cb-d5e75311e15f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:16:55.077161 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc996c-e190-49f8-acd9-be80a45d7812 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:16:55.077796 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc996c-e190-49f8-acd9-be80a45d7812 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:16:55.078087 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc996c-e190-49f8-acd9-be80a45d7812 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:16:55.078372 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc996c-e190-49f8-acd9-be80a45d7812 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:16:55.133892 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc996c-e190-49f8-acd9-be80a45d7812 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:16:55.135319 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc996c-e190-49f8-acd9-be80a45d7812 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:16:55.144900 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1397/2850] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:16:55 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:17:01.966610 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9c16a-6e3a-4cec-8542-0af0a151a65e service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:02.027250 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9c16a-6e3a-4cec-8542-0af0a151a65e service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:02.031799 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d6ee4-f5dd-4e0e-a3fa-b3fe898507ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:02.033169 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d6ee4-f5dd-4e0e-a3fa-b3fe898507ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:02.033471 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d6ee4-f5dd-4e0e-a3fa-b3fe898507ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:02.033751 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d6ee4-f5dd-4e0e-a3fa-b3fe898507ff admin admin] PATH_INFO: `/v3/users/1cd28460756c49cbaeab312897b41a77` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:02.034943 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d6ee4-f5dd-4e0e-a3fa-b3fe898507ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd28460756c49cbaeab312897b41a77)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:02.036899 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d6ee4-f5dd-4e0e-a3fa-b3fe898507ff admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:02.212468 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-878d6ee4-f5dd-4e0e-a3fa-b3fe898507ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd28460756c49cbaeab312897b41a77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:02.213128 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-878d6ee4-f5dd-4e0e-a3fa-b3fe898507ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd28460756c49cbaeab312897b41a77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:02.279517 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-878d6ee4-f5dd-4e0e-a3fa-b3fe898507ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd28460756c49cbaeab312897b41a77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:02.287191 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-878d6ee4-f5dd-4e0e-a3fa-b3fe898507ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd28460756c49cbaeab312897b41a77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:02.287821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-878d6ee4-f5dd-4e0e-a3fa-b3fe898507ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd28460756c49cbaeab312897b41a77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:02.304893 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1454/2851] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:17:01 2022] DELETE /identity/v3/users/1cd28460756c49cbaeab312897b41a77 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:17:02.309473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024793d-bd81-48bf-b2b3-915f3a82f74c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:02.309971 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024793d-bd81-48bf-b2b3-915f3a82f74c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:02.310075 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c024793d-bd81-48bf-b2b3-915f3a82f74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:02.326777 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c024793d-bd81-48bf-b2b3-915f3a82f74c None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:17:02.328044 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c024793d-bd81-48bf-b2b3-915f3a82f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:02.387235 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1398/2852] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:17:02.397820 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d6ee4-f5dd-4e0e-a3fa-b3fe898507ff admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:02.399213 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-878d6ee4-f5dd-4e0e-a3fa-b3fe898507ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:02.409638 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:02.458647 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d6ee4-f5dd-4e0e-a3fa-b3fe898507ff admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:02.462228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e6681-8e1c-4434-bca5-51c0a3f7de76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:02.462925 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e6681-8e1c-4434-bca5-51c0a3f7de76 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:02.463159 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e6681-8e1c-4434-bca5-51c0a3f7de76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:02.463438 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e6681-8e1c-4434-bca5-51c0a3f7de76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:02.473034 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e6681-8e1c-4434-bca5-51c0a3f7de76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:02.474980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e6681-8e1c-4434-bca5-51c0a3f7de76 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:02.484727 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1455/2853] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:17:02.845745 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024793d-bd81-48bf-b2b3-915f3a82f74c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:02.847287 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c024793d-bd81-48bf-b2b3-915f3a82f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:02.859619 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c024793d-bd81-48bf-b2b3-915f3a82f74c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:02.864385 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441b529-d241-493d-ad1e-0c7adc908a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:02.865255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b529-d241-493d-ad1e-0c7adc908a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:02.865545 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b529-d241-493d-ad1e-0c7adc908a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:02.865830 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441b529-d241-493d-ad1e-0c7adc908a50 admin admin] PATH_INFO: `/v3/projects/dd62e15cd23b41b8ad6ed30235b199f5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:02.867512 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441b529-d241-493d-ad1e-0c7adc908a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd62e15cd23b41b8ad6ed30235b199f5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:02.869554 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441b529-d241-493d-ad1e-0c7adc908a50 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:02.965959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8441b529-d241-493d-ad1e-0c7adc908a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd62e15cd23b41b8ad6ed30235b199f5', 'request_id': 'req-8441b529-d241-493d-ad1e-0c7adc908a50'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:02.971448 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8441b529-d241-493d-ad1e-0c7adc908a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd62e15cd23b41b8ad6ed30235b199f5', 'request_id': 'req-8441b529-d241-493d-ad1e-0c7adc908a50'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:02.973860 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:03.061292 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8441b529-d241-493d-ad1e-0c7adc908a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd62e15cd23b41b8ad6ed30235b199f5', 'request_id': 'req-8441b529-d241-493d-ad1e-0c7adc908a50'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:03.074333 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8441b529-d241-493d-ad1e-0c7adc908a50 admin admin] The token cache is being invalidate because project dd62e15cd23b41b8ad6ed30235b199f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:17:03.074633 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8441b529-d241-493d-ad1e-0c7adc908a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:03.075291 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8441b529-d241-493d-ad1e-0c7adc908a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:03.076975 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1399/2854] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:17:02 2022] DELETE /identity/v3/projects/dd62e15cd23b41b8ad6ed30235b199f5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:17:03.081083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e6681-8e1c-4434-bca5-51c0a3f7de76 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:03.095081 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e6681-8e1c-4434-bca5-51c0a3f7de76 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:03.157907 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c1be3-5ca8-460b-b196-4f3779471512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:03.158776 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c1be3-5ca8-460b-b196-4f3779471512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:03.159066 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c1be3-5ca8-460b-b196-4f3779471512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:03.159355 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c1be3-5ca8-460b-b196-4f3779471512 admin admin] PATH_INFO: `/v3/users/1e53fd16be0f49918b604d8f254220f6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:03.160578 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c1be3-5ca8-460b-b196-4f3779471512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e53fd16be0f49918b604d8f254220f6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:03.162504 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c1be3-5ca8-460b-b196-4f3779471512 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:03.332061 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b94c1be3-5ca8-460b-b196-4f3779471512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e53fd16be0f49918b604d8f254220f6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:03.332708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b94c1be3-5ca8-460b-b196-4f3779471512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e53fd16be0f49918b604d8f254220f6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:03.415368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b94c1be3-5ca8-460b-b196-4f3779471512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e53fd16be0f49918b604d8f254220f6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:03.422990 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b94c1be3-5ca8-460b-b196-4f3779471512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e53fd16be0f49918b604d8f254220f6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:03.424290 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b94c1be3-5ca8-460b-b196-4f3779471512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e53fd16be0f49918b604d8f254220f6'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:03.442568 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1456/2855] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:17:03 2022] DELETE /identity/v3/users/1e53fd16be0f49918b604d8f254220f6 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:17:03.863922 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441b529-d241-493d-ad1e-0c7adc908a50 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:03.868828 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8441b529-d241-493d-ad1e-0c7adc908a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:03.878876 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441b529-d241-493d-ad1e-0c7adc908a50 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:03.935200 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c87e8-5d96-41be-9e2a-d05c2bb0c7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:03.936084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c87e8-5d96-41be-9e2a-d05c2bb0c7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:03.936366 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c87e8-5d96-41be-9e2a-d05c2bb0c7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:03.936642 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c87e8-5d96-41be-9e2a-d05c2bb0c7c6 admin admin] PATH_INFO: `/v3/projects/e71f4d5404654f89ad9316f952648d83` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:03.937800 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c87e8-5d96-41be-9e2a-d05c2bb0c7c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e71f4d5404654f89ad9316f952648d83)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:03.939767 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c87e8-5d96-41be-9e2a-d05c2bb0c7c6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:04.038779 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d89c87e8-5d96-41be-9e2a-d05c2bb0c7c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71f4d5404654f89ad9316f952648d83', 'request_id': 'req-d89c87e8-5d96-41be-9e2a-d05c2bb0c7c6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:04.044410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d89c87e8-5d96-41be-9e2a-d05c2bb0c7c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71f4d5404654f89ad9316f952648d83', 'request_id': 'req-d89c87e8-5d96-41be-9e2a-d05c2bb0c7c6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:04.118130 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d89c87e8-5d96-41be-9e2a-d05c2bb0c7c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71f4d5404654f89ad9316f952648d83', 'request_id': 'req-d89c87e8-5d96-41be-9e2a-d05c2bb0c7c6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:04.128989 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d89c87e8-5d96-41be-9e2a-d05c2bb0c7c6 admin admin] The token cache is being invalidate because project e71f4d5404654f89ad9316f952648d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:17:04.129284 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d89c87e8-5d96-41be-9e2a-d05c2bb0c7c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:04.129911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d89c87e8-5d96-41be-9e2a-d05c2bb0c7c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:04.131483 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1400/2856] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:17:03 2022] DELETE /identity/v3/projects/e71f4d5404654f89ad9316f952648d83 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:17:04.136512 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be834087-d040-4f56-b177-b8a5c1ccfc70 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:04.136983 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be834087-d040-4f56-b177-b8a5c1ccfc70 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:04.137103 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be834087-d040-4f56-b177-b8a5c1ccfc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:04.155708 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-be834087-d040-4f56-b177-b8a5c1ccfc70 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:17:04.159398 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-be834087-d040-4f56-b177-b8a5c1ccfc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:04.180484 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:04.214587 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1457/2857] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:17:04.223411 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fd2d3-0cfc-4f4a-993c-fb72dcc7b9f0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:04.223732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fd2d3-0cfc-4f4a-993c-fb72dcc7b9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:04.224053 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fd2d3-0cfc-4f4a-993c-fb72dcc7b9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:04.242267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-569fd2d3-0cfc-4f4a-993c-fb72dcc7b9f0 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:17:04.243458 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-569fd2d3-0cfc-4f4a-993c-fb72dcc7b9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:04.251229 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1401/2858] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:17:04.256003 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be834087-d040-4f56-b177-b8a5c1ccfc70 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:04.265301 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be834087-d040-4f56-b177-b8a5c1ccfc70 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:04.270635 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118aa3-f0bd-4711-85d4-22e8011ff7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:04.271277 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118aa3-f0bd-4711-85d4-22e8011ff7cb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:04.271561 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118aa3-f0bd-4711-85d4-22e8011ff7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:04.271841 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118aa3-f0bd-4711-85d4-22e8011ff7cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:04.272599 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97118aa3-f0bd-4711-85d4-22e8011ff7cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:17:04.273113 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97118aa3-f0bd-4711-85d4-22e8011ff7cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:04.275187 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97118aa3-f0bd-4711-85d4-22e8011ff7cb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:04.286545 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1458/2859] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:17:04.290633 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fd2d3-0cfc-4f4a-993c-fb72dcc7b9f0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:04.300272 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fd2d3-0cfc-4f4a-993c-fb72dcc7b9f0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:04.305001 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565c5ac-23ae-4d5b-bfd1-dd1c00e6be2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:04.305655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565c5ac-23ae-4d5b-bfd1-dd1c00e6be2d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:04.305946 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565c5ac-23ae-4d5b-bfd1-dd1c00e6be2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:04.306228 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565c5ac-23ae-4d5b-bfd1-dd1c00e6be2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:04.306920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565c5ac-23ae-4d5b-bfd1-dd1c00e6be2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:04.308873 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565c5ac-23ae-4d5b-bfd1-dd1c00e6be2d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:04.448998 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1402/2860] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:17:04 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:17:04.453072 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118aa3-f0bd-4711-85d4-22e8011ff7cb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:04.463756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118aa3-f0bd-4711-85d4-22e8011ff7cb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:04.518658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976e647-efb6-4265-a4db-121bb91a2120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:04.519325 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976e647-efb6-4265-a4db-121bb91a2120 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:04.519617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976e647-efb6-4265-a4db-121bb91a2120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:04.519903 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976e647-efb6-4265-a4db-121bb91a2120 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:04.520627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976e647-efb6-4265-a4db-121bb91a2120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:04.522609 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976e647-efb6-4265-a4db-121bb91a2120 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:04.626302 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1459/2861] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:17:04 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:17:04.628270 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565c5ac-23ae-4d5b-bfd1-dd1c00e6be2d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:04.638972 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565c5ac-23ae-4d5b-bfd1-dd1c00e6be2d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:04.643920 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd19ad-37c3-41fa-91a4-603ba9b65f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:04.644606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd19ad-37c3-41fa-91a4-603ba9b65f03 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:04.644894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd19ad-37c3-41fa-91a4-603ba9b65f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:04.645176 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd19ad-37c3-41fa-91a4-603ba9b65f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:04.645894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd19ad-37c3-41fa-91a4-603ba9b65f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:04.647476 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd19ad-37c3-41fa-91a4-603ba9b65f03 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:04.657702 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1403/2862] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:17:04.661631 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976e647-efb6-4265-a4db-121bb91a2120 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:04.671710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976e647-efb6-4265-a4db-121bb91a2120 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:04.676821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773de7f6-2f2b-424b-9ea4-14f889634e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:04.677465 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773de7f6-2f2b-424b-9ea4-14f889634e6b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:04.677756 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773de7f6-2f2b-424b-9ea4-14f889634e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:04.678036 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773de7f6-2f2b-424b-9ea4-14f889634e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:04.678787 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773de7f6-2f2b-424b-9ea4-14f889634e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:04.680423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773de7f6-2f2b-424b-9ea4-14f889634e6b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:04.690966 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1460/2863] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:17:04.694882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd19ad-37c3-41fa-91a4-603ba9b65f03 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:04.704783 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd19ad-37c3-41fa-91a4-603ba9b65f03 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:04.709677 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186fa9e-c523-4248-a901-188685be1b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:04.710544 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186fa9e-c523-4248-a901-188685be1b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:04.710829 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186fa9e-c523-4248-a901-188685be1b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:04.711107 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186fa9e-c523-4248-a901-188685be1b9a admin admin] PATH_INFO: `/v3/projects/178f0e5e15384e7ca2a96b4c753d31a0/users/c0ea33879a874c72a194b6cae3f42653/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:04.725350 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186fa9e-c523-4248-a901-188685be1b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=178f0e5e15384e7ca2a96b4c753d31a0, user_id=c0ea33879a874c72a194b6cae3f42653, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:04.728047 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186fa9e-c523-4248-a901-188685be1b9a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:04.810508 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1404/2864] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:17:04 2022] PUT /identity/v3/projects/178f0e5e15384e7ca2a96b4c753d31a0/users/c0ea33879a874c72a194b6cae3f42653/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:17:04.821375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333b934-bd00-485a-ae1f-436fb2c3fe24 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:04.821684 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333b934-bd00-485a-ae1f-436fb2c3fe24 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:04.822007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333b934-bd00-485a-ae1f-436fb2c3fe24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:04.848250 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a333b934-bd00-485a-ae1f-436fb2c3fe24 None None] MFA Rules not processed for user `c0ea33879a874c72a194b6cae3f42653`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:17:04.849510 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a333b934-bd00-485a-ae1f-436fb2c3fe24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:04.912662 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1461/2865] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:17:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:17:04.917087 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186fa9e-c523-4248-a901-188685be1b9a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:04.935034 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:04.978593 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186fa9e-c523-4248-a901-188685be1b9a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:04.983297 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b4e42-9bfb-43df-81ea-511256de5fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:04.983951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b4e42-9bfb-43df-81ea-511256de5fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:04.984285 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b4e42-9bfb-43df-81ea-511256de5fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:04.984569 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b4e42-9bfb-43df-81ea-511256de5fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:04.985267 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b4e42-9bfb-43df-81ea-511256de5fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:04.987222 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b4e42-9bfb-43df-81ea-511256de5fc8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:05.105516 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1405/2866] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:17:04 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:17:05.107886 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333b934-bd00-485a-ae1f-436fb2c3fe24 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:05.119283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333b934-bd00-485a-ae1f-436fb2c3fe24 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:05.138526 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:05.174665 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4c1da-be32-4f25-8f2a-af43bc10f3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:05.175267 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4c1da-be32-4f25-8f2a-af43bc10f3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:05.175600 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4c1da-be32-4f25-8f2a-af43bc10f3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:05.175874 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4c1da-be32-4f25-8f2a-af43bc10f3b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:05.177181 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4c1da-be32-4f25-8f2a-af43bc10f3b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:05.179085 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4c1da-be32-4f25-8f2a-af43bc10f3b0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:05.239726 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1462/2867] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:17:05 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:17:05.243536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b4e42-9bfb-43df-81ea-511256de5fc8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:05.253956 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b4e42-9bfb-43df-81ea-511256de5fc8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:05.258655 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535b97f-5b5b-47ac-9e2f-3d672c83f0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:05.259310 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535b97f-5b5b-47ac-9e2f-3d672c83f0ab admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:05.259600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535b97f-5b5b-47ac-9e2f-3d672c83f0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:05.259888 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535b97f-5b5b-47ac-9e2f-3d672c83f0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:05.260673 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535b97f-5b5b-47ac-9e2f-3d672c83f0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:05.262269 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535b97f-5b5b-47ac-9e2f-3d672c83f0ab admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:05.273670 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1406/2868] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:17:05.277695 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4c1da-be32-4f25-8f2a-af43bc10f3b0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:05.288087 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4c1da-be32-4f25-8f2a-af43bc10f3b0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:05.292681 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89ab28-2524-406b-845a-1a73ec3645cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:05.293551 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89ab28-2524-406b-845a-1a73ec3645cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:05.293834 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89ab28-2524-406b-845a-1a73ec3645cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:05.294111 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89ab28-2524-406b-845a-1a73ec3645cb admin admin] PATH_INFO: `/v3/projects/437b828a1a914e05b8e51d3d4f0b9d4a/users/40ee1848139e4b65bee940662e3acf0a/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:05.309221 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89ab28-2524-406b-845a-1a73ec3645cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=437b828a1a914e05b8e51d3d4f0b9d4a, user_id=40ee1848139e4b65bee940662e3acf0a, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:05.312005 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89ab28-2524-406b-845a-1a73ec3645cb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:05.381761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1463/2869] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:17:05 2022] PUT /identity/v3/projects/437b828a1a914e05b8e51d3d4f0b9d4a/users/40ee1848139e4b65bee940662e3acf0a/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:17:05.385744 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535b97f-5b5b-47ac-9e2f-3d672c83f0ab admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:05.396510 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535b97f-5b5b-47ac-9e2f-3d672c83f0ab admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:05.450127 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb51960-729e-4e70-a454-67b950e45faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:05.450711 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb51960-729e-4e70-a454-67b950e45faf admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:05.450997 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb51960-729e-4e70-a454-67b950e45faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:05.451276 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb51960-729e-4e70-a454-67b950e45faf admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:05.452017 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb51960-729e-4e70-a454-67b950e45faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:05.453723 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb51960-729e-4e70-a454-67b950e45faf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:05.463745 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1407/2870] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:17:05.468600 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89ab28-2524-406b-845a-1a73ec3645cb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:05.479935 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89ab28-2524-406b-845a-1a73ec3645cb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:05.484571 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621d45b-a43d-438b-b20a-71994c578a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:05.485453 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621d45b-a43d-438b-b20a-71994c578a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:05.485738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621d45b-a43d-438b-b20a-71994c578a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:05.486018 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621d45b-a43d-438b-b20a-71994c578a9f admin admin] PATH_INFO: `/v3/projects/437b828a1a914e05b8e51d3d4f0b9d4a/users/40ee1848139e4b65bee940662e3acf0a/roles/415d634cdffe4a578b9c65fc960bbf59` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:05.488011 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621d45b-a43d-438b-b20a-71994c578a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=437b828a1a914e05b8e51d3d4f0b9d4a, user_id=40ee1848139e4b65bee940662e3acf0a, role_id=415d634cdffe4a578b9c65fc960bbf59)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:05.490650 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621d45b-a43d-438b-b20a-71994c578a9f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:05.501213 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1464/2871] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:17:05 2022] PUT /identity/v3/projects/437b828a1a914e05b8e51d3d4f0b9d4a/users/40ee1848139e4b65bee940662e3acf0a/roles/415d634cdffe4a578b9c65fc960bbf59 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:17:05.512258 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cb111-edfb-4756-8066-00c56c81699d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:05.512551 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cb111-edfb-4756-8066-00c56c81699d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:05.512832 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cb111-edfb-4756-8066-00c56c81699d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:05.540058 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b41cb111-edfb-4756-8066-00c56c81699d None None] MFA Rules not processed for user `40ee1848139e4b65bee940662e3acf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:17:05.541260 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b41cb111-edfb-4756-8066-00c56c81699d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:05.610259 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1408/2872] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:17:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:17:05.620767 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621d45b-a43d-438b-b20a-71994c578a9f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:05.622466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7621d45b-a43d-438b-b20a-71994c578a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:05.678810 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621d45b-a43d-438b-b20a-71994c578a9f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:05.682405 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164fbff3-166b-4323-bcb5-4285599288cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:05.683029 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fbff3-166b-4323-bcb5-4285599288cd service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:05.683313 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fbff3-166b-4323-bcb5-4285599288cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:05.683592 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164fbff3-166b-4323-bcb5-4285599288cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:05.692814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fbff3-166b-4323-bcb5-4285599288cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:05.694228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164fbff3-166b-4323-bcb5-4285599288cd service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:05.703462 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1465/2873] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:17:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:17:06.235959 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cb111-edfb-4756-8066-00c56c81699d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:06.248927 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:06.297385 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cb111-edfb-4756-8066-00c56c81699d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:06.302478 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036238d9-1571-4406-9264-c2982146fbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:06.303355 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036238d9-1571-4406-9264-c2982146fbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:06.303623 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036238d9-1571-4406-9264-c2982146fbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:06.303902 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036238d9-1571-4406-9264-c2982146fbc6 admin admin] PATH_INFO: `/v3/users/c0ea33879a874c72a194b6cae3f42653` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:06.305108 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036238d9-1571-4406-9264-c2982146fbc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ea33879a874c72a194b6cae3f42653)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:06.307068 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036238d9-1571-4406-9264-c2982146fbc6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:06.522074 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-036238d9-1571-4406-9264-c2982146fbc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ea33879a874c72a194b6cae3f42653'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:06.533627 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-036238d9-1571-4406-9264-c2982146fbc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ea33879a874c72a194b6cae3f42653'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:06.534286 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-036238d9-1571-4406-9264-c2982146fbc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ea33879a874c72a194b6cae3f42653'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:06.541515 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-036238d9-1571-4406-9264-c2982146fbc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ea33879a874c72a194b6cae3f42653'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:06.546282 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-036238d9-1571-4406-9264-c2982146fbc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ea33879a874c72a194b6cae3f42653'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:06.645260 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1409/2874] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:17:06 2022] DELETE /identity/v3/users/c0ea33879a874c72a194b6cae3f42653 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:17:06.649950 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6c978-3c55-4a0a-b8eb-6cbbf2dbf157 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:06.650449 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6c978-3c55-4a0a-b8eb-6cbbf2dbf157 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:06.650552 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6c978-3c55-4a0a-b8eb-6cbbf2dbf157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:06.668380 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-65f6c978-3c55-4a0a-b8eb-6cbbf2dbf157 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:17:06.669573 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-65f6c978-3c55-4a0a-b8eb-6cbbf2dbf157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:06.727751 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1466/2875] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:17:06.737153 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036238d9-1571-4406-9264-c2982146fbc6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:06.738560 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-036238d9-1571-4406-9264-c2982146fbc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:06.796525 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036238d9-1571-4406-9264-c2982146fbc6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:06.799951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0ed22-075b-48e9-b611-16398ab5efec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:06.800623 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0ed22-075b-48e9-b611-16398ab5efec service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:06.800973 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0ed22-075b-48e9-b611-16398ab5efec service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:06.801265 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0ed22-075b-48e9-b611-16398ab5efec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:06.810169 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0ed22-075b-48e9-b611-16398ab5efec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:06.811606 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0ed22-075b-48e9-b611-16398ab5efec service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:06.820910 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1410/2876] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:17:07.235137 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6c978-3c55-4a0a-b8eb-6cbbf2dbf157 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:07.236657 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-65f6c978-3c55-4a0a-b8eb-6cbbf2dbf157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:07.253598 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6c978-3c55-4a0a-b8eb-6cbbf2dbf157 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:07.254989 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a7bd5-c198-4993-9704-de693c4d3f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:07.255905 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a7bd5-c198-4993-9704-de693c4d3f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:07.256232 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a7bd5-c198-4993-9704-de693c4d3f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:07.256515 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a7bd5-c198-4993-9704-de693c4d3f03 admin admin] PATH_INFO: `/v3/projects/178f0e5e15384e7ca2a96b4c753d31a0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:07.264466 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a7bd5-c198-4993-9704-de693c4d3f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=178f0e5e15384e7ca2a96b4c753d31a0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:07.266449 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a7bd5-c198-4993-9704-de693c4d3f03 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:07.283403 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:07.400007 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ac8a7bd5-c198-4993-9704-de693c4d3f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178f0e5e15384e7ca2a96b4c753d31a0', 'request_id': 'req-ac8a7bd5-c198-4993-9704-de693c4d3f03'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:07.461255 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ac8a7bd5-c198-4993-9704-de693c4d3f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178f0e5e15384e7ca2a96b4c753d31a0', 'request_id': 'req-ac8a7bd5-c198-4993-9704-de693c4d3f03'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:07.467649 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ac8a7bd5-c198-4993-9704-de693c4d3f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178f0e5e15384e7ca2a96b4c753d31a0', 'request_id': 'req-ac8a7bd5-c198-4993-9704-de693c4d3f03'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:07.478219 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ac8a7bd5-c198-4993-9704-de693c4d3f03 admin admin] The token cache is being invalidate because project 178f0e5e15384e7ca2a96b4c753d31a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:17:07.478507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ac8a7bd5-c198-4993-9704-de693c4d3f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:07.479142 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ac8a7bd5-c198-4993-9704-de693c4d3f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:07.480715 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1467/2877] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:17:07 2022] DELETE /identity/v3/projects/178f0e5e15384e7ca2a96b4c753d31a0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:17:07.484675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0ed22-075b-48e9-b611-16398ab5efec service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:07.495103 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0ed22-075b-48e9-b611-16398ab5efec service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:07.526044 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:07.552039 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005d1c1-6f62-4706-965a-6620b38df886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:07.552913 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d1c1-6f62-4706-965a-6620b38df886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:07.553200 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d1c1-6f62-4706-965a-6620b38df886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:07.553493 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d1c1-6f62-4706-965a-6620b38df886 admin admin] PATH_INFO: `/v3/users/40ee1848139e4b65bee940662e3acf0a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:07.554722 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005d1c1-6f62-4706-965a-6620b38df886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ee1848139e4b65bee940662e3acf0a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:07.556701 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005d1c1-6f62-4706-965a-6620b38df886 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:07.824759 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1005d1c1-6f62-4706-965a-6620b38df886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ee1848139e4b65bee940662e3acf0a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:07.836668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1005d1c1-6f62-4706-965a-6620b38df886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ee1848139e4b65bee940662e3acf0a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:07.837354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1005d1c1-6f62-4706-965a-6620b38df886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ee1848139e4b65bee940662e3acf0a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:07.844204 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1005d1c1-6f62-4706-965a-6620b38df886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ee1848139e4b65bee940662e3acf0a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:07.844848 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1005d1c1-6f62-4706-965a-6620b38df886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ee1848139e4b65bee940662e3acf0a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:07.914618 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1411/2878] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:17:07 2022] DELETE /identity/v3/users/40ee1848139e4b65bee940662e3acf0a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:17:08.326851 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a7bd5-c198-4993-9704-de693c4d3f03 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:08.328336 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ac8a7bd5-c198-4993-9704-de693c4d3f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:08.343516 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a7bd5-c198-4993-9704-de693c4d3f03 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:08.403168 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b5711-7e52-4fb1-9941-86cceed29980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:08.404077 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b5711-7e52-4fb1-9941-86cceed29980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:08.404365 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b5711-7e52-4fb1-9941-86cceed29980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:08.404645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b5711-7e52-4fb1-9941-86cceed29980 admin admin] PATH_INFO: `/v3/projects/437b828a1a914e05b8e51d3d4f0b9d4a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:08.405824 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b5711-7e52-4fb1-9941-86cceed29980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=437b828a1a914e05b8e51d3d4f0b9d4a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:08.407738 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b5711-7e52-4fb1-9941-86cceed29980 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:08.548959 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-224b5711-7e52-4fb1-9941-86cceed29980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '437b828a1a914e05b8e51d3d4f0b9d4a', 'request_id': 'req-224b5711-7e52-4fb1-9941-86cceed29980'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:08.622288 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-224b5711-7e52-4fb1-9941-86cceed29980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '437b828a1a914e05b8e51d3d4f0b9d4a', 'request_id': 'req-224b5711-7e52-4fb1-9941-86cceed29980'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:08.628583 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-224b5711-7e52-4fb1-9941-86cceed29980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '437b828a1a914e05b8e51d3d4f0b9d4a', 'request_id': 'req-224b5711-7e52-4fb1-9941-86cceed29980'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:08.639416 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-224b5711-7e52-4fb1-9941-86cceed29980 admin admin] The token cache is being invalidate because project 437b828a1a914e05b8e51d3d4f0b9d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:17:08.639706 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-224b5711-7e52-4fb1-9941-86cceed29980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:08.640368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-224b5711-7e52-4fb1-9941-86cceed29980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:08.642179 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1468/2879] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:17:08 2022] DELETE /identity/v3/projects/437b828a1a914e05b8e51d3d4f0b9d4a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 16:17:08.647537 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e181bac-e6de-42fa-ae38-a7b77dec0291 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:08.648064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e181bac-e6de-42fa-ae38-a7b77dec0291 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:08.648165 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e181bac-e6de-42fa-ae38-a7b77dec0291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:08.665338 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0e181bac-e6de-42fa-ae38-a7b77dec0291 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:17:08.666538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0e181bac-e6de-42fa-ae38-a7b77dec0291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:08.724495 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1412/2880] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:17:08.732202 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aabb70-b8f0-49f5-882a-2af7e6ff2b3b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:08.732495 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aabb70-b8f0-49f5-882a-2af7e6ff2b3b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:08.732776 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aabb70-b8f0-49f5-882a-2af7e6ff2b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:08.750822 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d9aabb70-b8f0-49f5-882a-2af7e6ff2b3b None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:17:08.752047 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d9aabb70-b8f0-49f5-882a-2af7e6ff2b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:08.760560 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1469/2881] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:17:08.764814 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e181bac-e6de-42fa-ae38-a7b77dec0291 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:08.776264 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e181bac-e6de-42fa-ae38-a7b77dec0291 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:08.780871 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ee303-b744-467a-9176-4dfae2485526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:08.781536 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ee303-b744-467a-9176-4dfae2485526 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:08.781820 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ee303-b744-467a-9176-4dfae2485526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:08.782100 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ee303-b744-467a-9176-4dfae2485526 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:08.782824 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ee303-b744-467a-9176-4dfae2485526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:17:08.783134 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ee303-b744-467a-9176-4dfae2485526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:08.784766 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ee303-b744-467a-9176-4dfae2485526 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:08.796371 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1413/2882] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:17:08.800761 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aabb70-b8f0-49f5-882a-2af7e6ff2b3b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:08.809995 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aabb70-b8f0-49f5-882a-2af7e6ff2b3b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:08.814563 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec021c2a-fcaf-4795-b0db-8fb3cc498c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:08.815204 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec021c2a-fcaf-4795-b0db-8fb3cc498c89 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:08.815486 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec021c2a-fcaf-4795-b0db-8fb3cc498c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:08.815763 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec021c2a-fcaf-4795-b0db-8fb3cc498c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:08.816477 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec021c2a-fcaf-4795-b0db-8fb3cc498c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:08.818887 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec021c2a-fcaf-4795-b0db-8fb3cc498c89 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:08.932174 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1470/2883] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:17:08 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:17:08.936168 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ee303-b744-467a-9176-4dfae2485526 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:08.946772 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ee303-b744-467a-9176-4dfae2485526 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:08.984738 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:09.002732 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dce2a9-723f-43e6-adb0-17c6fa752474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:09.003391 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dce2a9-723f-43e6-adb0-17c6fa752474 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:09.003675 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dce2a9-723f-43e6-adb0-17c6fa752474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:09.003954 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dce2a9-723f-43e6-adb0-17c6fa752474 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:09.005248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dce2a9-723f-43e6-adb0-17c6fa752474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:09.007255 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dce2a9-723f-43e6-adb0-17c6fa752474 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:09.070605 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1414/2884] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:17:08 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 16:17:09.071821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec021c2a-fcaf-4795-b0db-8fb3cc498c89 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:09.078442 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:09.082102 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec021c2a-fcaf-4795-b0db-8fb3cc498c89 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:09.086762 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5343f2-c90e-4230-8b1c-cb442cf6c2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:09.087410 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5343f2-c90e-4230-8b1c-cb442cf6c2ba admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:09.087701 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5343f2-c90e-4230-8b1c-cb442cf6c2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:09.087980 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5343f2-c90e-4230-8b1c-cb442cf6c2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:09.088721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5343f2-c90e-4230-8b1c-cb442cf6c2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:09.090316 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5343f2-c90e-4230-8b1c-cb442cf6c2ba admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:09.100377 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1471/2885] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:17:09.105900 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dce2a9-723f-43e6-adb0-17c6fa752474 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:09.116384 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dce2a9-723f-43e6-adb0-17c6fa752474 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:09.121022 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a844163-2e3a-41a9-a6f3-79d125625987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:09.121785 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a844163-2e3a-41a9-a6f3-79d125625987 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:09.122086 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a844163-2e3a-41a9-a6f3-79d125625987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:09.122365 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a844163-2e3a-41a9-a6f3-79d125625987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:09.123083 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a844163-2e3a-41a9-a6f3-79d125625987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:09.124786 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a844163-2e3a-41a9-a6f3-79d125625987 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:09.135273 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1415/2886] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:17:09.147721 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5343f2-c90e-4230-8b1c-cb442cf6c2ba admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:09.157689 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5343f2-c90e-4230-8b1c-cb442cf6c2ba admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:09.162275 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3842c6-cfb9-497a-b5e5-4e5db11ef356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:09.163143 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3842c6-cfb9-497a-b5e5-4e5db11ef356 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:09.163423 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3842c6-cfb9-497a-b5e5-4e5db11ef356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:09.163700 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3842c6-cfb9-497a-b5e5-4e5db11ef356 admin admin] PATH_INFO: `/v3/projects/81445b5fee7a40988450757ae7fe7331/users/f24c3ebc18bb4afb8a3f6050739f4348/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:09.178590 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3842c6-cfb9-497a-b5e5-4e5db11ef356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81445b5fee7a40988450757ae7fe7331, user_id=f24c3ebc18bb4afb8a3f6050739f4348, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:09.181385 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3842c6-cfb9-497a-b5e5-4e5db11ef356 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:09.278316 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1472/2887] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:17:09 2022] PUT /identity/v3/projects/81445b5fee7a40988450757ae7fe7331/users/f24c3ebc18bb4afb8a3f6050739f4348/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:17:09.288782 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571558bb-1285-42ca-beae-a39930738901 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:09.288941 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571558bb-1285-42ca-beae-a39930738901 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:09.289248 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571558bb-1285-42ca-beae-a39930738901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:09.315874 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-571558bb-1285-42ca-beae-a39930738901 None None] MFA Rules not processed for user `f24c3ebc18bb4afb8a3f6050739f4348`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:17:09.317737 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-571558bb-1285-42ca-beae-a39930738901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:09.382600 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1416/2888] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:17:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:17:09.393946 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3842c6-cfb9-497a-b5e5-4e5db11ef356 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:09.395789 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ca3842c6-cfb9-497a-b5e5-4e5db11ef356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:09.451617 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3842c6-cfb9-497a-b5e5-4e5db11ef356 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:09.455230 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a263d-1331-48d5-9ea4-8e324c8923eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a5157588644972a6a4554b3a9f1d76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:09.455866 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a263d-1331-48d5-9ea4-8e324c8923eb service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:09.456185 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a263d-1331-48d5-9ea4-8e324c8923eb service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:09.456469 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a263d-1331-48d5-9ea4-8e324c8923eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:09.464723 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a263d-1331-48d5-9ea4-8e324c8923eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:09.466151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a263d-1331-48d5-9ea4-8e324c8923eb service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:09.475318 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1473/2889] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:17:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:17:19.379582 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=48,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:19.470825 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:24.386612 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571558bb-1285-42ca-beae-a39930738901 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:24.448709 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571558bb-1285-42ca-beae-a39930738901 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:24.453190 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1584d-b54f-4cce-af8c-cb3dfdc88a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:24.454055 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1584d-b54f-4cce-af8c-cb3dfdc88a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:24.454337 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1584d-b54f-4cce-af8c-cb3dfdc88a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:24.454612 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1584d-b54f-4cce-af8c-cb3dfdc88a2e admin admin] PATH_INFO: `/v3/users/f24c3ebc18bb4afb8a3f6050739f4348` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:24.455787 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1584d-b54f-4cce-af8c-cb3dfdc88a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f24c3ebc18bb4afb8a3f6050739f4348)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:24.457721 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1584d-b54f-4cce-af8c-cb3dfdc88a2e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:24.636680 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a5d1584d-b54f-4cce-af8c-cb3dfdc88a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f24c3ebc18bb4afb8a3f6050739f4348'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:24.648462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a5d1584d-b54f-4cce-af8c-cb3dfdc88a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f24c3ebc18bb4afb8a3f6050739f4348'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:24.649142 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a5d1584d-b54f-4cce-af8c-cb3dfdc88a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f24c3ebc18bb4afb8a3f6050739f4348'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:24.655866 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a5d1584d-b54f-4cce-af8c-cb3dfdc88a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f24c3ebc18bb4afb8a3f6050739f4348'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:24.656534 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a5d1584d-b54f-4cce-af8c-cb3dfdc88a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f24c3ebc18bb4afb8a3f6050739f4348'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:24.759625 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1417/2890] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:17:24 2022] DELETE /identity/v3/users/f24c3ebc18bb4afb8a3f6050739f4348 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:17:24.764233 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba79a2-42f1-459f-b2fe-5d20ef8d0e9a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:24.764717 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba79a2-42f1-459f-b2fe-5d20ef8d0e9a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:24.764837 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba79a2-42f1-459f-b2fe-5d20ef8d0e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:24.782230 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4fba79a2-42f1-459f-b2fe-5d20ef8d0e9a None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:17:24.783445 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4fba79a2-42f1-459f-b2fe-5d20ef8d0e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:24.840402 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1474/2891] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:17:24.849882 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1584d-b54f-4cce-af8c-cb3dfdc88a2e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:24.851275 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a5d1584d-b54f-4cce-af8c-cb3dfdc88a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:24.907942 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1584d-b54f-4cce-af8c-cb3dfdc88a2e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:24.911473 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc81e1-678d-47fb-87f6-f446c219568c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:24.912139 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc81e1-678d-47fb-87f6-f446c219568c service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:24.912430 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc81e1-678d-47fb-87f6-f446c219568c service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:24.912730 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc81e1-678d-47fb-87f6-f446c219568c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:24.921887 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc81e1-678d-47fb-87f6-f446c219568c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:24.923342 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc81e1-678d-47fb-87f6-f446c219568c service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:24.933325 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1418/2892] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:17:25.309234 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba79a2-42f1-459f-b2fe-5d20ef8d0e9a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:25.310658 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4fba79a2-42f1-459f-b2fe-5d20ef8d0e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:25.322666 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba79a2-42f1-459f-b2fe-5d20ef8d0e9a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:25.327283 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e3711-904e-484d-acba-a5116765d3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:25.328273 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3711-904e-484d-acba-a5116765d3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:25.333707 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3711-904e-484d-acba-a5116765d3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:25.333707 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3711-904e-484d-acba-a5116765d3bc admin admin] PATH_INFO: `/v3/projects/81445b5fee7a40988450757ae7fe7331` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:25.333707 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e3711-904e-484d-acba-a5116765d3bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=81445b5fee7a40988450757ae7fe7331)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:25.333707 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e3711-904e-484d-acba-a5116765d3bc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:25.445710 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e86e3711-904e-484d-acba-a5116765d3bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81445b5fee7a40988450757ae7fe7331', 'request_id': 'req-e86e3711-904e-484d-acba-a5116765d3bc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:25.525368 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e86e3711-904e-484d-acba-a5116765d3bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81445b5fee7a40988450757ae7fe7331', 'request_id': 'req-e86e3711-904e-484d-acba-a5116765d3bc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:25.531662 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e86e3711-904e-484d-acba-a5116765d3bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81445b5fee7a40988450757ae7fe7331', 'request_id': 'req-e86e3711-904e-484d-acba-a5116765d3bc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:25.542725 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e86e3711-904e-484d-acba-a5116765d3bc admin admin] The token cache is being invalidate because project 81445b5fee7a40988450757ae7fe7331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:17:25.543012 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e86e3711-904e-484d-acba-a5116765d3bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:25.543636 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e86e3711-904e-484d-acba-a5116765d3bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:25.545194 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1475/2893] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:17:25 2022] DELETE /identity/v3/projects/81445b5fee7a40988450757ae7fe7331 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:17:25.550296 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcf170-0ca2-4cd3-8d84-c89244611671 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:25.550791 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcf170-0ca2-4cd3-8d84-c89244611671 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:25.550894 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcf170-0ca2-4cd3-8d84-c89244611671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:25.568210 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b0bcf170-0ca2-4cd3-8d84-c89244611671 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:17:25.569410 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b0bcf170-0ca2-4cd3-8d84-c89244611671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:25.586855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:25.628219 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1419/2894] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:17:25.689068 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4941f9-fbea-4852-a569-247009fbf696 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:25.689361 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4941f9-fbea-4852-a569-247009fbf696 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:25.689645 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4941f9-fbea-4852-a569-247009fbf696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:25.707627 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2c4941f9-fbea-4852-a569-247009fbf696 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:17:25.708794 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2c4941f9-fbea-4852-a569-247009fbf696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:25.717082 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1476/2895] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:17:25.721249 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcf170-0ca2-4cd3-8d84-c89244611671 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:25.731535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcf170-0ca2-4cd3-8d84-c89244611671 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:25.736122 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767eede-ad3e-4faf-8f47-de4eb7caeaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:25.736773 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767eede-ad3e-4faf-8f47-de4eb7caeaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:25.737061 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767eede-ad3e-4faf-8f47-de4eb7caeaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:25.737343 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767eede-ad3e-4faf-8f47-de4eb7caeaa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:25.738067 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767eede-ad3e-4faf-8f47-de4eb7caeaa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 16:17:25.738385 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767eede-ad3e-4faf-8f47-de4eb7caeaa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:25.740009 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767eede-ad3e-4faf-8f47-de4eb7caeaa6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:25.751429 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1420/2896] 10.222.0.50 () {58 vars in 1152 bytes} [Thu Jun 2 16:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 16:17:25.755491 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4941f9-fbea-4852-a569-247009fbf696 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:25.765228 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4941f9-fbea-4852-a569-247009fbf696 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:25.770220 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166534d9-4419-47e5-9d92-04b88dda9419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:25.770861 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166534d9-4419-47e5-9d92-04b88dda9419 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:25.771151 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166534d9-4419-47e5-9d92-04b88dda9419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:25.771436 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166534d9-4419-47e5-9d92-04b88dda9419 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:25.772154 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166534d9-4419-47e5-9d92-04b88dda9419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:25.774688 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166534d9-4419-47e5-9d92-04b88dda9419 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:25.852082 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1477/2897] 10.222.0.50 () {60 vars in 1152 bytes} [Thu Jun 2 16:17:25 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:17:25.855884 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767eede-ad3e-4faf-8f47-de4eb7caeaa6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:25.866081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767eede-ad3e-4faf-8f47-de4eb7caeaa6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:25.922714 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3df31b-cc22-4286-99d8-a150297dd7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:25.923378 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3df31b-cc22-4286-99d8-a150297dd7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:25.923666 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3df31b-cc22-4286-99d8-a150297dd7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:25.923951 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3df31b-cc22-4286-99d8-a150297dd7d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:25.924668 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3df31b-cc22-4286-99d8-a150297dd7d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:25.926581 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3df31b-cc22-4286-99d8-a150297dd7d3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:26.021823 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1421/2898] 10.222.0.50 () {60 vars in 1143 bytes} [Thu Jun 2 16:17:25 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 16:17:26.025886 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166534d9-4419-47e5-9d92-04b88dda9419 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:26.036232 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166534d9-4419-47e5-9d92-04b88dda9419 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:26.040866 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43b710-7531-4715-a4d5-22bbb31f545d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:26.041524 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43b710-7531-4715-a4d5-22bbb31f545d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:26.041814 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43b710-7531-4715-a4d5-22bbb31f545d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:26.042098 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43b710-7531-4715-a4d5-22bbb31f545d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:26.042821 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43b710-7531-4715-a4d5-22bbb31f545d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:26.044479 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43b710-7531-4715-a4d5-22bbb31f545d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:26.055718 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1478/2899] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 16:17:26.059504 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3df31b-cc22-4286-99d8-a150297dd7d3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:26.069923 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3df31b-cc22-4286-99d8-a150297dd7d3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:26.075084 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85481d-e7fa-469f-aa46-021e68a1b0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:26.075739 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85481d-e7fa-469f-aa46-021e68a1b0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:26.076064 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85481d-e7fa-469f-aa46-021e68a1b0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:26.076354 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85481d-e7fa-469f-aa46-021e68a1b0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:26.077081 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85481d-e7fa-469f-aa46-021e68a1b0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:26.078681 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85481d-e7fa-469f-aa46-021e68a1b0c3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:26.089226 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1422/2900] 10.222.0.50 () {58 vars in 1121 bytes} [Thu Jun 2 16:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 16:17:26.093076 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43b710-7531-4715-a4d5-22bbb31f545d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:26.103010 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43b710-7531-4715-a4d5-22bbb31f545d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:26.107610 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f7851-bf49-4105-bba6-cdeb394a252f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:26.108505 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f7851-bf49-4105-bba6-cdeb394a252f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:26.108790 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f7851-bf49-4105-bba6-cdeb394a252f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:26.109067 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f7851-bf49-4105-bba6-cdeb394a252f admin admin] PATH_INFO: `/v3/projects/5bb0d9cfcdf24af4b3ae3fecf3bef69a/users/24ef44947758436385142765af7369ae/roles/6cae5979d0aa4dcca6467a7ba544d4b1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:26.123441 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f7851-bf49-4105-bba6-cdeb394a252f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb0d9cfcdf24af4b3ae3fecf3bef69a, user_id=24ef44947758436385142765af7369ae, role_id=6cae5979d0aa4dcca6467a7ba544d4b1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:26.126083 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f7851-bf49-4105-bba6-cdeb394a252f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:26.193300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1479/2901] 10.222.0.50 () {60 vars in 1482 bytes} [Thu Jun 2 16:17:26 2022] PUT /identity/v3/projects/5bb0d9cfcdf24af4b3ae3fecf3bef69a/users/24ef44947758436385142765af7369ae/roles/6cae5979d0aa4dcca6467a7ba544d4b1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:17:26.204824 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55491238-0ca5-4eac-9b07-5281efd8a61a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:26.205111 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55491238-0ca5-4eac-9b07-5281efd8a61a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:26.205357 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55491238-0ca5-4eac-9b07-5281efd8a61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:26.231674 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-55491238-0ca5-4eac-9b07-5281efd8a61a None None] MFA Rules not processed for user `24ef44947758436385142765af7369ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:17:26.232911 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-55491238-0ca5-4eac-9b07-5281efd8a61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:26.295780 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1423/2902] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:17:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:17:26.306881 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f7851-bf49-4105-bba6-cdeb394a252f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:26.308656 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d06f7851-bf49-4105-bba6-cdeb394a252f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:26.330687 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:26.366260 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f7851-bf49-4105-bba6-cdeb394a252f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:26.370882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08893ba7-9276-4f3e-84e5-05d6e8ac999c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4c3818af2794f598c21ee4aab4b3a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:26.370882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08893ba7-9276-4f3e-84e5-05d6e8ac999c service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:26.370882 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08893ba7-9276-4f3e-84e5-05d6e8ac999c service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:26.371300 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08893ba7-9276-4f3e-84e5-05d6e8ac999c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:26.379675 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08893ba7-9276-4f3e-84e5-05d6e8ac999c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:26.381208 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08893ba7-9276-4f3e-84e5-05d6e8ac999c service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:26.390596 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1480/2903] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:17:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:17:30.545757 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55491238-0ca5-4eac-9b07-5281efd8a61a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:30.565433 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:30.615487 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55491238-0ca5-4eac-9b07-5281efd8a61a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:30.620201 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15902ab1-2f93-4ebc-8142-fff33dcc983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:30.621053 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902ab1-2f93-4ebc-8142-fff33dcc983a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:30.621339 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902ab1-2f93-4ebc-8142-fff33dcc983a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:30.621618 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902ab1-2f93-4ebc-8142-fff33dcc983a admin admin] PATH_INFO: `/v3/users/24ef44947758436385142765af7369ae` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:30.622810 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15902ab1-2f93-4ebc-8142-fff33dcc983a admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ef44947758436385142765af7369ae)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:30.624763 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15902ab1-2f93-4ebc-8142-fff33dcc983a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:30.864228 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-15902ab1-2f93-4ebc-8142-fff33dcc983a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ef44947758436385142765af7369ae'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:30.876349 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-15902ab1-2f93-4ebc-8142-fff33dcc983a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ef44947758436385142765af7369ae'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:30.876969 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-15902ab1-2f93-4ebc-8142-fff33dcc983a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ef44947758436385142765af7369ae'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:30.883807 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-15902ab1-2f93-4ebc-8142-fff33dcc983a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ef44947758436385142765af7369ae'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:30.884462 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-15902ab1-2f93-4ebc-8142-fff33dcc983a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ef44947758436385142765af7369ae'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:30.948011 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1424/2904] 10.222.0.50 () {58 vars in 1223 bytes} [Thu Jun 2 16:17:30 2022] DELETE /identity/v3/users/24ef44947758436385142765af7369ae => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:17:30.952507 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9968f6c-8bae-43d1-a9bd-1bcee280c719 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:30.953001 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9968f6c-8bae-43d1-a9bd-1bcee280c719 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:30.953123 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9968f6c-8bae-43d1-a9bd-1bcee280c719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:30.971375 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e9968f6c-8bae-43d1-a9bd-1bcee280c719 None None] MFA Rules not processed for user `1c6d5baab170407ca73cb1da472cac82`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 16:17:30.972646 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e9968f6c-8bae-43d1-a9bd-1bcee280c719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:31.030826 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1481/2905] 10.222.0.50 () {58 vars in 957 bytes} [Thu Jun 2 16:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 16:17:31.040538 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15902ab1-2f93-4ebc-8142-fff33dcc983a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:31.042030 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-15902ab1-2f93-4ebc-8142-fff33dcc983a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:31.099089 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15902ab1-2f93-4ebc-8142-fff33dcc983a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:31.102640 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7312-1349-4f65-a38a-355ade466ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3ec010ab4c5414a8782cecf202fbcfe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:31.103281 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7312-1349-4f65-a38a-355ade466ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:31.103571 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7312-1349-4f65-a38a-355ade466ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:31.103855 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b7312-1349-4f65-a38a-355ade466ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:31.112898 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b7312-1349-4f65-a38a-355ade466ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:31.114323 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b7312-1349-4f65-a38a-355ade466ed1 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:31.123981 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1425/2906] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:17:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:17:31.498287 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9968f6c-8bae-43d1-a9bd-1bcee280c719 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:17:31.499759 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e9968f6c-8bae-43d1-a9bd-1bcee280c719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:17:31.514303 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9968f6c-8bae-43d1-a9bd-1bcee280c719 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:17:31.519225 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d32dc9-3a31-4ae9-b7f8-20abb45b32bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6d5baab170407ca73cb1da472cac82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cbd1e15210e404da74f1144aa119ef8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:17:31.520145 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d32dc9-3a31-4ae9-b7f8-20abb45b32bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:17:31.520434 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d32dc9-3a31-4ae9-b7f8-20abb45b32bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:17:31.520714 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d32dc9-3a31-4ae9-b7f8-20abb45b32bb admin admin] PATH_INFO: `/v3/projects/5bb0d9cfcdf24af4b3ae3fecf3bef69a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:17:31.521904 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d32dc9-3a31-4ae9-b7f8-20abb45b32bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bb0d9cfcdf24af4b3ae3fecf3bef69a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:17:31.523807 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d32dc9-3a31-4ae9-b7f8-20abb45b32bb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:17:31.656554 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-52d32dc9-3a31-4ae9-b7f8-20abb45b32bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bb0d9cfcdf24af4b3ae3fecf3bef69a', 'request_id': 'req-52d32dc9-3a31-4ae9-b7f8-20abb45b32bb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:31.759325 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-52d32dc9-3a31-4ae9-b7f8-20abb45b32bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bb0d9cfcdf24af4b3ae3fecf3bef69a', 'request_id': 'req-52d32dc9-3a31-4ae9-b7f8-20abb45b32bb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:31.765647 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-52d32dc9-3a31-4ae9-b7f8-20abb45b32bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bb0d9cfcdf24af4b3ae3fecf3bef69a', 'request_id': 'req-52d32dc9-3a31-4ae9-b7f8-20abb45b32bb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:31.776297 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-52d32dc9-3a31-4ae9-b7f8-20abb45b32bb admin admin] The token cache is being invalidate because project 5bb0d9cfcdf24af4b3ae3fecf3bef69a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 16:17:31.776729 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-52d32dc9-3a31-4ae9-b7f8-20abb45b32bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:31.777358 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-52d32dc9-3a31-4ae9-b7f8-20abb45b32bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 16:17:31.778898 dv-cinder-797608-27-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1482/2907] 10.222.0.50 () {58 vars in 1232 bytes} [Thu Jun 2 16:17:31 2022] DELETE /identity/v3/projects/5bb0d9cfcdf24af4b3ae3fecf3bef69a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 16:17:41.119729 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:17:41.773274 dv-cinder-797608-27-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 16:19:09.858496 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7312-1349-4f65-a38a-355ade466ed1 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 16:19:09.859979 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-971b7312-1349-4f65-a38a-355ade466ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:19:09.998748 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b7312-1349-4f65-a38a-355ade466ed1 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 16:19:10.058348 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba514f-60dd-46ca-aa8e-c5bc1e18ec18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d60a2abffc04ba59b65d5fca5e318a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2775777647e4323a554bb3a5d045fc0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 16:19:10.059000 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba514f-60dd-46ca-aa8e-c5bc1e18ec18 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 16:19:10.059294 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba514f-60dd-46ca-aa8e-c5bc1e18ec18 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 16:19:10.059582 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba514f-60dd-46ca-aa8e-c5bc1e18ec18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 16:19:10.061505 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6fba514f-60dd-46ca-aa8e-c5bc1e18ec18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 16:19:10.072931 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba514f-60dd-46ca-aa8e-c5bc1e18ec18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 16:19:10.074535 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba514f-60dd-46ca-aa8e-c5bc1e18ec18 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 16:19:10.084706 dv-cinder-797608-27-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1426/2908] 10.222.0.50 () {60 vars in 1365 bytes} [Thu Jun 2 16:19:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 16:19:20.080208 dv-cinder-797608-27-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}